1 reference to Vocabulary
Microsoft.ML.Tokenizers (1)
Model\CodeGenTokenizer.cs (1)
1752
vocab = JsonSerializer.Deserialize(vocabularyStream, ModelSourceGenerationContext.Default.
Vocabulary
);