All videos
0:00 / 0:00
ai

AI Observability with OpenAI Agents SDK

James Briggs16 June 2026Watch on YouTube

Part of series

Ep. 5 · Agents Openai Sdk

View the series

Description

Agents SDK integrates with OpenAI's built-in Traces dashboard found within the OpenAI Platform for out-of-the-box observability and telemetry of our AI agents. In this video, we'll take a look at both the default tracing enabled by default whenever we use Agents SDK (with an OpenAI API key present), and custom tracing. 📖 Full Course: https://www.aurelio.ai/course/agents-sdk 🔗 Article: https://www.jamesbriggs.io/agents-sdk-tracing 📌 Code: https://github.com/aurelio-labs/agents-sdk-course/blob/main/chapters/02-tracing.ipynb 💡 Subscribe for Latest Courses and Tutorials: https://www.aurelio.ai/subscribe 👋🏼 AI Consulting: https://aurelio.ai 👾 Discord: https://discord.gg/c5QtDB9RAP Twitter: https://twitter.com/jamescalam LinkedIn: https://www.linkedin.com/in/jamescalam/ #ai #aiagents #programming 00:00 Agents SDK Tracing 00:17 OpenAI Traces Dashboard 02:03 Agents SDK Tracing Setup 03:00 Access to OpenAI Traces 04:03 Creating Agents SDK Traces 05:29 Custom Traces 08:24 Tracing Agent Tools 12:15 Conclusion

What you'll learn

  • Agents SDK integrates automatic tracing with OpenAI's Traces dashboard for direct observability of AI agents.
  • Default tracing is automatically enabled when you use Agents SDK with an OpenAI API key.
  • Custom tracing allows you to add tailored monitoring to agent interactions and workflows.
  • Tracing enables you to monitor and debug agent tools to optimize performance and behavior.
  • The Traces dashboard in the OpenAI Platform provides telemetry insights for troubleshooting agent runs.

Frequently asked questions

How do I enable tracing for Agents SDK?
Tracing is automatically enabled when you use Agents SDK with a valid OpenAI API key. No additional setup is required for default tracing.
Where can I view my agent traces?
You can view your agent traces in the Traces dashboard located within the OpenAI Platform. This shows telemetry and observability data from your AI agents.
What is the difference between default tracing and custom tracing?
Default tracing is automatically enabled and records standard agent activities. Custom tracing allows you to add tailored monitoring to specific agent interactions and workflows.
How can I monitor agent tools with tracing?
The video covers how to use tracing to monitor agent tools. This helps you understand tool behavior and performance, and identify potential issues.

Topics

In this video

Related reads