1 reference to CreateBpeTokenizerFromJson
Microsoft.ML.Tokenizers.Tests (1)
BpeTests.cs (1)
800
private static BpeTokenizer _deepSeekR1Tokenizer =
CreateBpeTokenizerFromJson
();