ktoken/com.aallam.ktoken.encoding/O200KBase

O200KBase

data class O200KBase(val file: String = "o200k_base.tiktoken") : Encoding

Default configuration of cl100k_base encoding.

Constructors

Link copied to clipboard
constructor(file: String = "o200k_base.tiktoken")

Properties

Link copied to clipboard
open override val file: String

The encoding file path.

Functions

Link copied to clipboard
open override fun encodingConfig(ranks: Map<ByteString, Int>): EncodingConfig

Retrieve token encoding utilizing the provided BpeLoader.