2 references to Create
Microsoft.ML.Tokenizers.Tests (2)
UnigramTests.cs (2)
28
return SentencePieceTokenizer.
Create
(remoteStream);
101
return SentencePieceTokenizer.
Create
(remoteStream, specialTokens: