Execution tracing for AI agents is substantially standardized in 2026 — decision accountability is not

Asked (summary):
What is the state of observability for AI agents in 2026 — OpenTelemetry integration for agents and standard event schemas that capture intent, tool calls, and decisions? What exists today and what is missing?

This is a researched snapshot as of 2026-10-08, not an exhaustive census of every vendor integration. It rests on 154 evidence rows across multiple independent hosts: 4 official OpenTelemetry GenAI specification pages (all four in Development status), 52 rows on GenAI event conventions, deprecations, and migration, 97 rows of OpenInference convention evidence treated as one corpus rather than 97 standards, and 1 concrete Pydantic AI integration example.

Coverage and maturity matrix: what each layer defines, allows, or lacks

Defined in the convention Possible via custom attributes ×Missing Hover or tap a cell for the evidence behind it
Layer / standard
OTLP interop
Agent identity / topology
Prompts / messages
Tool calls / results
Retrieval
Errors / usage
Evaluation
Normalized intent
Decision / rationale / policy
Approval / authorization
Post-condition / provenance
Maturity
Official OTel GenAI conventions
×
×
×
×
Development status
OpenInference
×
×
Project convention, stable in practice
Framework & vendor extensions (Pydantic AI example)
×
×
×
Custom namespace + GenAI attributes
Vendor-neutral decision schema
×
×
×
×
×
×
×
×
×
×
×
Not found in this corpus

The left half of the matrix — transport, agent identity, messages, tool calls, retrieval, errors, evaluation — is green: execution can be reconstructed. The right half — intent, rationale, approval, post-condition — is missing in every layer. Current telemetry can say what model or tool was called, with which inputs, outputs, timing, and tokens; it usually cannot establish why a choice was made. Raw chain-of-thought is neither reliably exposed nor an appropriate universal primitive; useful decision observability needs concise decision summaries, alternatives considered, policy references, evidence, approvals, and outcome links instead.

All four focused official OTel GenAI specification documents in this corpus are in Development status, yet tool execution is already concretely modeled: execute_tool is an INTERNAL span carrying tool name, call ID, arguments, and result, and message content is opt-in because of PII risk. opentelemetry.io
The event model is still moving: v1.37.0 deprecated the five per-message gen_ai.* chat events in favor of structured span attributes or the gen_ai.client.inference.operation.details event, v1.38.0 added an evaluation event, v1.41.0 an exception event, and v1.42.0 moved all GenAI material to a dedicated repository. github.com
OpenInference is the strongest deployed complement: explicit AGENT, TOOL, CHAIN, LLM, RETRIEVER, RERANKER, GUARDRAIL, EVALUATOR, and PROMPT span kinds on ordinary OTel spans — but it is a project convention, and its framework instrumentations do not all emit identical agent topology (one auto-instrumentor puts the agent name in graph.node.id instead of agent.name). github.com
Custom namespaces remain common in practice: the Pydantic AI instrumentor mixes its own pydantic_ai.* span attributes (run id, agent instructions, tool args, stream chunk counts) with official gen_ai.* model and token-usage attributes in the same spans. pypi.org

How the pieces stack: one pipe, competing semantic layers

Agent runtime / frameworkPydantic AI, OpenAI Agents SDK,LangChain and other instrumentors OTel SDK + OTLPtrace and span context,spans, events, metrics Collectorredaction, routing,batching Backendany OTLP-compatibletrace store Semantic layers riding on the same spans: Official OTel GenAI conventionsgen_ai.* — Development status OpenInferenceopeninference.span.kind, llm.*, tool.*, agent.* Framework / vendor extensionspydantic_ai.*, other custom namespaces

A practical 2026 baseline while the standards converge

  1. Adopt trace/span context and OTLP as the only transport; version every schema you emit.
  2. Emit agent, inference, tool-execution, and retrieval spans using the official GenAI operation names or OpenInference span kinds.
  3. Propagate session, task, and tool-call IDs across every span so runs can be stitched end to end.
  4. Keep prompt and message payload capture opt-in and redacted — the official conventions already treat content as sensitive by default.
  5. Add organization-level records the standards do not yet carry: decision summaries, policy and evidence references, approvals, state transitions, outcomes, and evaluation results, linked to trace IDs until vendor-neutral schemas mature.

Evidence rows behind this snapshot

CorpusDocumentSource
OTel GenAI spec pagesSemantic conventions for AWS Bedrock operationsopentelemetry.io
OTel GenAI spec pagesSemantic conventions for Azure AI Inference client operationsopentelemetry.io
OTel GenAI spec pagesSemantic conventions for generative client AI spansopentelemetry.io
OTel GenAI spec pagesSemantic conventions for OpenAI client operationsopentelemetry.io
GenAI event conventionsReleases · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionssemantic-conventions/CHANGELOG.md at main · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionssemantic-conventions/docs/gen-ai/gen-ai-events.md at v1.36.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionsRelease v1.37.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionsModel AI chat events as a list of request/response messages, with each message containing a list of partsgithub.com
GenAI event conventionssemantic-conventions/CHANGELOG.md at release/v1.41.x · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionssemantic-conventions/CHANGELOG.md at 838e414e11e30bc4f67d733b2b0baf2887d12d31 · open-telemetry/semantic-con…redirect.github.com
GenAI event conventionsSemantic conventions for generative AI systemsopentelemetry.io
GenAI event conventionsSemantic conventions for Generative AI exceptionsopentelemetry.io
GenAI event conventionsUsing attributes for chat history on gen_ai spans and events by lmolkova · Pull Request #2179 · open-teleme…github.com
GenAI event conventionsSemantic Conventions for LLM requestsopentelemetry.io
GenAI event conventionsUsing attributes for chat history on gen_ai spans and events by lmolkova · Pull Request #2179 · open-teleme…github.com
GenAI event conventionschangelog · open-telemetry/semantic-conventions@092db44github.com
GenAI event conventionsUsing attributes for chat history on gen_ai spans and events (#2179) · open-telemetry/semantic-conventions@…github.com
GenAI event conventionssemantic-conventions/docs/gen-ai/gen-ai-events.md at 8b4f210f43136e57c1f6f47292eb6d38e3bf30bb · open-teleme…github.com
GenAI event conventionsIntroduce per-message structured GenAI events instead of prompt/compl… · open-telemetry/semantic-convention…github.com
GenAI event conventionsclean up and add sys instructions json · open-telemetry/semantic-conventions@1ce1548github.com
GenAI event conventionsRelease v1.42.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionsMove GenAI semantic conventions to its own dedicated repository (#3696) · open-telemetry/semantic-conventio…github.com
GenAI event conventionsgen-ai: remove evaluation outcome and align with score-based model · open-telemetry/semantic-conventions@d2…github.com
GenAI event conventionsgen-ai: remove evaluation outcome and align with score-based model · open-telemetry/semantic-conventions@11…github.com
GenAI event conventionsgen-ai: remove evaluation outcome and align with score-based model · open-telemetry/semantic-conventions@6b…github.com
GenAI event conventionsgen-ai: add evaluation outcome attributes · open-telemetry/semantic-conventions@9b4b176github.com
GenAI event conventionsIntroduce gen_ai.request.seed as needed by cohere (#1710) · open-telemetry/semantic-conventions@05b4c17github.com
GenAI event conventionsgen-ai: simplify outcome attribute and remove multiple_outcomes · open-telemetry/semantic-conventions@691ff36github.com
GenAI event conventionssemantic-conventions/docs/gen-ai at v1.38.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionsDefine gen_ai exception event for client operations (#3436) · open-telemetry/semantic-conventions@6a43c1cgithub.com
GenAI event conventionssemantic-conventions/docs/gen-ai/gen-ai-spans.md at 459fbdbe0aca27d39547de7ff0887d01332b81e6 · open-telemet…github.com
GenAI event conventionsAdd JSON Schema Definition for gen_ai.tool.definitions (#3378) · open-telemetry/semantic-conventions@cca1231github.com
GenAI event conventionssemantic-conventions/docs/gen-ai/gen-ai-spans.md at v1.27.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionssemantic-conventions/docs/gen-ai at v1.37.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionsfix(gen-ai): clarify evaluation.outcome semantics and remove guardrai… · open-telemetry/semantic-convention…github.com
GenAI event conventionsCreate genai-evaluation-events · open-telemetry/semantic-conventions@b937f02github.com
GenAI event conventionsgen-ai: drop StrippedPart, extend existing parts with stripped_reason · open-telemetry/semantic-conventions…github.com
GenAI event conventionsHistory for docs/gen-ai - open-telemetry/semantic-conventionsgithub.com
GenAI event conventionssemantic-conventions/docs/gen-ai/README.md at v1.38.0 · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionsGenAI: mark sampling-relevant attributes (#2994) · open-telemetry/semantic-conventions@2945b0bgithub.com
GenAI event conventionsReleases · open-telemetry/semantic-conventionsgithub.com
GenAI event conventionschangelog · open-telemetry/semantic-conventions@8113a4fgithub.com
GenAI event conventionsfix: llm -> gen-ai · open-telemetry/semantic-conventions@81ed4a4github.com
GenAI event conventionsfix: llm -> gen-ai · open-telemetry/semantic-conventions@b642c4cgithub.com
GenAI event conventionsDefine gen_ai exception event for client operations by trask · Pull Request #3436 · open-telemetry/semantic…github.com
GenAI event conventionsfix: llm -> gen-ai · open-telemetry/semantic-conventions@b7ddb90github.com
GenAI event conventionsfix: prompt/completion format · open-telemetry/semantic-conventions@5c6df3egithub.com
GenAI event conventionsfix: prompt/completion format · open-telemetry/semantic-conventions@905bdc2github.com
GenAI event conventionsgen-ai: add multimodal additions (document modality, byte_size, Strip… · open-telemetry/semantic-convention…github.com
GenAI event conventionsMove score to the attribute · open-telemetry/semantic-conventions@a538723github.com
GenAI event conventionsIntroduce generic `gen_ai.output.type` instead of `gen_ai.openai.request.response_format` by lmolkova · Pul…github.com
GenAI event conventionsgen-ai: drive multimodal additions from models.ipynb + add example · open-telemetry/semantic-conventions@ae…github.com
GenAI event conventionsUpdate gen-ai.yaml · open-telemetry/semantic-conventions@5e777afgithub.com
GenAI event conventionsone event · open-telemetry/semantic-conventions@d3712a6github.com
GenAI event conventionsSupport for Multi modal inputs and generationsgithub.com
OpenInference corpusGitHub - Arize-ai/openinference: OpenTelemetry Instrumentation for AI Observabilitygithub.com
OpenInference corpusOpenInference and OpenTelemetry for LLM Tracing: A Practical Guideinference.net
OpenInference corpusOpenInference Best Practices - Arize AX Docsarize.com
OpenInference corpusOpenInference Best Practices - Phoenixarize.com
OpenInference corpusOpenInference Span Kindsarize.com
OpenInference corpusopeninference/spec/semantic_conventions.md at main · Arize-ai/openinferencegithub.com
OpenInference corpusSemantic Conventionsarize-ai.github.io
OpenInference corpusEcosyste.ms: Awesomeawesome.ecosyste.ms
OpenInference corpusOpenInference Best Practices - Phoenixarizeai-433a7140-claude-release-notes-2026-07-29.mintlify.site
OpenInference corpusOpeninference Semantic Conventions - Arize AX Docsarize.com
OpenInference corpusopeninference/spec/semantic_conventions.md at d773c1ac1c7bcfef565e6280932af68d388531e7 · Arize-ai/openinfer…github.com
OpenInference corpusfeat(semconv): add span-kind-independent image attributes · Arize-ai/openinference@0ff0af2github.com
OpenInference corpusConfigure Your Tracerarize.com
OpenInference corpusScalekit Tool Tracing in Arize with OpenInferencescalekit.com
OpenInference corpusopeninference/js/packages/openinference-semantic-conventions/src/trace/SemanticConventions.ts at main · Ari…github.com
OpenInference corpusTracing and Evaluating Voice Applicationsdocs.arize.com
OpenInference corpusGitHub - Arize-ai/openinference: OpenTelemetry Instrumentation for AI Observabilityredirect.github.com
OpenInference corpusopeninferencegitea.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-pydantic-ai/src/openinference/instrument…github.com
OpenInference corpusGitHub - context-labs/openinference: OpenTelemetry Instrumentation for AI Observabilitygithub.com
OpenInference corpusfeat: support OTel GenAI plan operation (#3165) · Arize-ai/openinference@52f368dgithub.com
OpenInference corpusConfigure Your Tracerarize.com
OpenInference corpusopeninference/python/openinference-semantic-conventions/src/openinference/semconv/trace/__init__.py at main…github.com
OpenInference corpusGitHub - arizedatngo/openinference: OpenTelemetry Instrumentation for AI Observabilitygithub.com
OpenInference corpusGet started with OpenInference and AI Observabilitydocs.dynatrace.com
OpenInference corpusGitHub - Arize-ai/openinference: OpenTelemetry Instrumentation for AI Observabilitygithub.com
OpenInference corpusopeninference/spec/semantic_conventions.md at main · context-labs/openinferencegithub.com
OpenInference corpusopeninference/README.md at main · Arize-ai/openinferencegithub.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-openllmetry/src/openinference/instrument…github.com
OpenInference corpusopeninference/python/openinference-semantic-conventions/src/openinference/semconv/trace/__init__.py at b827…github.com
OpenInference corpusopeninference/python/openinference-semantic-conventions/src/openinference/semconv/trace/__init__.py at 828b…github.com
OpenInference corpusopeninference/python/openinference-semantic-conventions/src/openinference/semconv/trace/__init__.py at b95d…github.com
OpenInference corpusGitHub - Arize-ai/openinference: OpenTelemetry Instrumentation for AI Observabilityarize.com
OpenInference corpusGitHub - Arize-ai/openinference: OpenTelemetry Instrumentation for AI Observabilityhattasimae.online
OpenInference corpusopeninference/java/instrumentation/openinference-instrumentation-langchain4j/src/main/java/com/arize/instru…github.com
OpenInference corpusSemantic Conventionsdeepwiki.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-smolagents/src/openinference/instrumenta…github.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-bedrock/src/openinference/instrumentatio…github.com
OpenInference corpusTracing and Evaluating Voice Applications - Arize AX Docsarize.com
OpenInference corpusOpenInference.NET 1.0.0nuget.org
OpenInference corpusList of all items in this cratedocs.rs
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-autogen-agentchat/src/openinference/inst…github.com
OpenInference corpusVercel AI SDK (v6 and earlier)arize.com
OpenInference corpusfeat(genai): Add optional OITracer GenAI semconv export (#3024) · Arize-ai/openinference@584cb4agithub.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-agno/src/openinference/instrumentation/a…github.com
OpenInference corpusSemantic Conventionsmintlify.com
OpenInference corpussemconv package - github.com/Arize-ai/openinference/go/openinference-semantic-conventions - Go Packagespkg.go.dev
OpenInference corpusopeninference/python/openinference-instrumentation/src/openinference/instrumentation/_attributes.py at b95d…github.com
OpenInference corpusopeninference/java/openinference-semantic-conventions/src/main/java/com/arize/semconv/trace/SemanticConvent…github.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-agno/src/openinference/instrumentation/a…github.com
OpenInference corpusYour First Tracesarize.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-litellm/src/openinference/instrumentatio…github.com
OpenInference corpusInfrastructure Instrumentationsdeepwiki.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-litellm/src/openinference/instrumentatio…github.com
OpenInference corpusinstrumentation package - github.com/Arize-ai/openinference/go/openinference-instrumentation - Go Packagespkg.go.dev
OpenInference corpusTranslating Semantic Conventionsarize.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-google-genai/src/openinference/instrumen…github.com
OpenInference corpusAgent Framework Instrumentationsdeepwiki.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-bedrock/src/openinference/instrumentatio…github.com
OpenInference corpusfeat(go): add openinference-semantic-conventions + openinference-inst… · Arize-ai/openinference@881e3acgithub.com
OpenInference corpusarize — skill by kundengsharedcontext.ai
OpenInference corpusopeninference/python/openinference-instrumentation/src/openinference/instrumentation/_tracers.py at b95d3f7…github.com
OpenInference corpusfeat(google_genai): Enable Tracing Support For Embedding Operations (… · Arize-ai/openinference@02b39e5github.com
OpenInference corpusopeninference/python/instrumentation/openinference-instrumentation-llama-index/src/openinference/instrument…github.com
OpenInference corpus@tangle-network/agent-trace-contractnpm.io
OpenInference corpusInstrument LiteLLM agentsarize.com
OpenInference corpus@tangle-network/agent-trace-contractnpmjs.com
OpenInference corpustrace/SemanticConventions | OpenInference JSarize-ai.github.io
OpenInference corpusGraphitearize.com
OpenInference corpusLangSmith, Arize Phoenix & OpenInferencecosmiclearn.com
OpenInference corpusotelobserver package - github.com/liliang-cn/agent-go/v3/pkg/otelobserver - Go Packagespkg.go.dev
OpenInference corpusWhy This Works: Deep Divegunbark.dev
OpenInference corpusAntigravityarize.com
OpenInference corpusA Runtime for Composable Intelligencegunbark.dev
OpenInference corpusMulti-Language Supportdeepwiki.com
OpenInference corpusWhy This Works: Deep Divegunbark.dev
OpenInference corpuscoding-harness-tracing/README.md at main · Arize-ai/coding-harness-tracinggithub.com
OpenInference corpus@tangle-network/agent-trace-contract - npm Package Security ...socket.dev
OpenInference corpusfreshcrate — open source packages for agentsfreshcrate.ai
OpenInference corpusopeninference/spec/semantic_conventions.md at 828b556d9cbb5b6e30537d4b05945ca93016007d · Arize-ai/openinfer…github.com
OpenInference corpusGitHub - Arize-ai/coding-harness-tracing: Trace coding harnesses like claude-code, cursor, and codex to Ari…github.com
OpenInference corpusOrchestration and RAG Frameworksdeepwiki.com
OpenInference corpusopeninference package - github.com/envoyproxy/ai-gateway/internal/tracing/openinference - Go Packagespkg.go.dev
OpenInference corpuscoding-harness-tracing/README.md at main · Arize-ai/coding-harness-tracinggithub.com
OpenInference corpusA Runtime for Composable Intelligencegunbark.dev
OpenInference corpusFramework Instrumentationsdeepwiki.com
OpenInference corpusClaude Codearize.com
OpenInference corpusAdd attributes, metadata and tags - Arize AX Docsarize.com
OpenInference corpusArchitecturedeepwiki.com
OpenInference corpusBase Instrumentation Librariesdeepwiki.com
OpenInference corpusStreaming Performance Breakthroughgunbark.dev
OpenInference corpusindex | OpenInference JSarize-ai.github.io
OpenInference corpusPhoenix Tracingskillshub.space
OpenInference corpusInstrumentationsmintlify.com
OpenInference corpusWhy This Works: Deep Divegunbark.dev
OpenInference corpusCustomize Your Tracesarize.com
OpenInference corpusWhy This Works: Deep Divegunbark.dev
Framework integrationtraceai-pydantic-aipypi.org

Method: researched snapshot assembled 2026-10-08 from 154 evidence rows spanning multiple independent hosts — 4 official OpenTelemetry GenAI specification pages, 52 rows on GenAI event conventions and deprecations, 97 OpenInference convention evidence rows (used as a corpus, not 97 standards), and 1 Pydantic AI integration example. Matrix cells summarize what each layer's documents define, allow via custom attributes, or lack; they are qualitative readings of the cited pages, not counts. Full span, attribute, and event text was cut for space; each row links its source. Not an exhaustive census of every vendor integration.

This report was generated automatically by Keenable SELECT at a user's request, from publicly available web sources linked herein. Keenable does not review, verify, or endorse its contents and makes no representation as to accuracy, completeness, or timeliness; AI-based extraction may contain errors. Nothing in this report is investment, legal, financial, or other professional advice. All trademarks and referenced content remain the property of their respective owners; no affiliation or endorsement is implied. To report an error, rights concern, or request removal: legal@keenable.ai.

Keenable SELECTAsk your own question
Made with Keenable SELECT