3 references to MaxWordLengthToCache
Microsoft.ML.Tokenizers (3)
Model\BPETokenizer.cs (3)
1000if (text.Length <= MaxWordLengthToCache) 1075if (text.Length <= MaxWordLengthToCache) 1108if (text.Length <= MaxWordLengthToCache)