1 reference to O200kBaseRegexPattern
Microsoft.ML.Tokenizers (1)
Model\TiktokenTokenizer.cs (1)
1268
[GeneratedRegex(
O200kBaseRegexPattern
, RegexOptions.None, PreTokenizer.DefaultTimeOutInMilliseconds)]