1 reference to CreateBpeTokenizerFromJson
Microsoft.ML.Tokenizers.Tests (1)
BpeTests.cs (1)
857
private static BpeTokenizer _deepSeekR1Tokenizer =
CreateBpeTokenizerFromJson
();