PromptTokensDetails

@Serializable
data class PromptTokensDetails(val cachedTokens: Int? = null, val audioTokens: Int? = null)

Breakdown of prompt token usage.

Constructors

Link copied to clipboard
constructor(cachedTokens: Int? = null, audioTokens: Int? = null)

Properties

Link copied to clipboard
@SerialName(value = "audio_tokens")
val audioTokens: Int? = null

Audio input tokens.

Link copied to clipboard
@SerialName(value = "cached_tokens")
val cachedTokens: Int? = null

Tokens served from the prompt cache.