ktoken

com.aallam.ktoken.encoding

ktoken/com.aallam.ktoken.encoding

Package-level declarations

Types

data class CL100KBase(val file: String = "cl100k_base.tiktoken") : Encoding

Default configuration of cl100k_base encoding.

data class O200KBase(val file: String = "o200k_base.tiktoken") : Encoding

Default configuration of cl100k_base encoding.

data class P50KBase(val file: String = "p50k_base.tiktoken") : Encoding

Default configuration of p50k_base encoding.

data class P50KEdit(val file: String = "p50k_base.tiktoken") : Encoding

Default configuration of p50k_edit encoding.

data class R50KBase(val file: String = "r50k_base.tiktoken") : Encoding

Default configuration of r50k_base encoding.