1 reference to CreateUnigramTokenizer
Microsoft.ML.Tokenizers.Tests (1)
UnigramTests.cs (1)
20
private static SentencePieceTokenizer _unigramTokenizer =
CreateUnigramTokenizer
();