Weights & Biases product for tracking LLM calls and application logic with automatic tracing and cost tracking, scorer-based evaluation and comparison tools, plus pre- and post-response safeguards. Platform controls include role-based access at team or project level, SSO via OIDC, SCIM provisioning and scoped service accounts.
commercial · generally available · Research snapshot 2026-09-06
Show me a traced LLM application with cost tracking, and demonstrate restricting project access to a named team using SSO-provisioned users.
Capabilities and evidence
Support labels reflect the supplied research. Documentation and vendor claims are not independent product tests. “Not established” means the researcher did not find support; it does not prove a capability is absent.
Documented by provider
Weave tracks LLM calls and application logic to debug and analyse production systems, with automatic tracing and cost tracking when connected to existing LLM providers, and supports evaluation with custom or pre-built scorers plus comparison tools.
Limit: Docs home does not state capture of tool calls, multi-agent handoffs, sessions or token-level metrics.
Platform documentation states role-based access control configurable at team or project level, SSO with public and enterprise identity providers over OIDC, a SCIM API and Python SDK for user and team management, team-based logical separation, a restricted project scope, scoped service accounts, SOC 2 Type II compliance for both platforms and HIPAA compliance for Dedicated Cloud.
Limit: Audit logs, retention settings and PII masking are not stated, and the secure storage connector (BYOB) is explicitly unavailable for Weave.