2 references to IMEnd
Microsoft.ML.Tokenizers.Tests (2)
TiktokenTests.cs (2)
29
{
IMEnd
, 100265},
749
string text = $"{IMStart}Hello{IMSep} World{
IMEnd
}<|dummy_85|>";