2 references to Create
Microsoft.ML.Tokenizers.Tests (2)
UnigramTests.cs (2)
27
return SentencePieceTokenizer.
Create
(remoteStream);
59
return SentencePieceTokenizer.
Create
(remoteStream, specialTokens: