1 reference to WhiteSpaceOrPunctuationPattern
Microsoft.ML.Tokenizers (1)
PreTokenizer\PreTokenizer.cs (1)
52
private static Regex WhiteSpaceOrPunctuationRegex() => new Regex(
WhiteSpaceOrPunctuationPattern
, RegexOptions.Compiled, TimeSpan.FromMilliseconds(DefaultTimeOutInMilliseconds));