Hi all. My team has been using Codex a lot recently, and I realized there are a lot of usage related metrics that are pretty important to track that we didn't have insight on. Things like:

• how many tokens are being used during Codex calls?

• how efficient is the token cache utlization?

• how many conversations are happening?

• which users are using Codex and when?

• what are the success rates and user decisions(accept or reject) of individual Codex commands?

• how long are Codex calls taking?

I noticed that Codex actually leverages OpenTelemetry to export telemetry data from its usage. All i had to do was point the data to my own OpenTelemetry compatible platform and I could begin visualizing logs and creating dashboards.

I followed this Codex observability guide to get set up, and ended up creating a pretty useful dashboard:

It tracks useful metrics like:

• token usage(including cache)

• # of conversations and model calls

• which users are using Codex

• Terminal type

• success rate of calls

• user decisions of calls

• # of requests over time

• request duration

• additional conversation details

I’m curious what other people here think about this and if there are any more metrics you would find useful to track that aren't included here?

Thanks!