Interface: TextGenerationStreamToken
Properties
id
• id: number
Token ID from the model tokenizer
Defined in
inference/src/tasks/nlp/textGenerationStream.ts:7
logprob
• logprob: number
Logprob
Defined in
inference/src/tasks/nlp/textGenerationStream.ts:11
special
• special: boolean
Is the token a special token Can be used to ignore tokens when concatenating
Defined in
inference/src/tasks/nlp/textGenerationStream.ts:16
text
• text: string
Token text