1 reference to WordOrNonWordPattern
Microsoft.ML.Tokenizers (1)
PreTokenizer\PreTokenizer.cs (1)
78
private static Regex WordOrNonWordRegex() => new Regex(
WordOrNonWordPattern
, RegexOptions.Compiled, TimeSpan.FromMilliseconds(DefaultTimeOutInMilliseconds));