2 references to IMStart
Microsoft.ML.Tokenizers.Tests (2)
TiktokenTests.cs (2)
28
{
IMStart
, 100264},
749
string text = $"{
IMStart
}Hello{IMSep} World{IMEnd}<|dummy_85|>";