StaticChunking

@Serializable
data class StaticChunking(val maxChunkSizeTokens: Int, val chunkOverlapTokens: Int)

Sizes used when splitting a file into overlapping chunks.

Constructors

Link copied to clipboard
constructor(maxChunkSizeTokens: Int, chunkOverlapTokens: Int)

Properties

Link copied to clipboard
@SerialName(value = "chunk_overlap_tokens")
val chunkOverlapTokens: Int

Tokens shared by adjacent chunks.

Link copied to clipboard
@SerialName(value = "max_chunk_size_tokens")
val maxChunkSizeTokens: Int

Maximum tokens per chunk.