3 references to MaxWordLengthToCache
Microsoft.ML.Tokenizers (3)
Model\BPETokenizer.cs (3)
950
if (text.Length <=
MaxWordLengthToCache
)
1018
if (text.Length <=
MaxWordLengthToCache
)
1044
if (text.Length <=
MaxWordLengthToCache
)