1 reference to WordOrNonWordPattern
Microsoft.ML.Tokenizers (1)
PreTokenizer\PreTokenizer.cs (1)
81
private static Regex WordOrNonWordRegex() => new Regex(
WordOrNonWordPattern
, RegexOptions.Compiled, TimeSpan.FromMilliseconds(DefaultTimeOutInMilliseconds));