Note: you will need an OpenAI API key to run this colab.
Use the W&B OpenAI integration to monitor OpenAI API calls and understand how your projects and teams are leveraging LLMs. In this example, we'll generate templated Weave Boards: LLM usage monitoring dashboards which you can explore and customize from the UI.
- automatically track LLM usage and aggregate useful metrics like cost, latency and throughput across your projects/teams
- dynamically query and derive insights from the logs of all your OpenAI API calls
- iterate visually to slice, aggregate, and explore your data; customize panels to focus on interesting patterns; share progress more easily with your team through an interactive dashboard
Install dependencies, login to W&B so you can save and share your work, and authenticate with OpenAI.