1 reference to WordTokenize
Microsoft.Extensions.AI.Evaluation.NLP (1)
Common\SimpleWordTokenizer.cs (1)
32
return
WordTokenize
(text.AsMemory());