4 references to Default
Microsoft.ML.Tokenizers (4)
Model\BPETokenizer.cs (2)
1102
? await JsonSerializer.DeserializeAsync(vocab, ModelSourceGenerationContext.
Default
.DictionaryStringSpanOrdinalKeyInt32, cancellationToken).ConfigureAwait(false)
1103
: JsonSerializer.Deserialize(vocab, ModelSourceGenerationContext.
Default
.DictionaryStringSpanOrdinalKeyInt32);
Model\CodeGenTokenizer.cs (1)
1752
vocab = JsonSerializer.Deserialize(vocabularyStream, ModelSourceGenerationContext.
Default
.Vocabulary);
Model\EnglishRobertaTokenizer.cs (1)
184
vocab = JsonSerializer.Deserialize(vocabularyStream, ModelSourceGenerationContext.
Default
.DictionaryStringSpanOrdinalKeyInt32);