ChatPromptCacheOptions

@Serializable
data class ChatPromptCacheOptions(val mode: String? = null, val ttl: String? = null)

Prompt caching mode and minimum lifetime; supported values depend on the model.

Constructors

Link copied to clipboard
constructor(mode: String? = null, ttl: String? = null)

Properties

Link copied to clipboard
@SerialName(value = "mode")
val mode: String? = null

Implicit or explicit cache boundary selection.

Link copied to clipboard
@SerialName(value = "ttl")
val ttl: String? = null

Minimum lifetime for cached prefixes.