2 references to CreateAsync
Microsoft.ML.Tokenizers (2)
Model\WordPieceTokenizer.cs (2)
227
await
CreateAsync
(
262
await
CreateAsync
(vocabStream, preTokenizer, normalizer, specialTokens, unknownToken, continuingSubwordPrefix, maxInputCharsPerWord, cancellationToken, disposeStream: false).ConfigureAwait(false);