2 references to BpeOptions
Microsoft.ML.Tokenizers.Tests (2)
BpeTests.cs (2)
261BpeOptions bpeOptions = new BpeOptions(vocabFile, mergesFile) 894BpeOptions options = new BpeOptions(Path.Combine(@"Gpt-2", "vocab.json"), Path.Combine(@"Gpt-2", "merges.txt"))