1 reference to Instance
Microsoft.ML.Tokenizers (1)
Model\TiktokenTokenizer.cs (1)
182
encoder = new Dictionary<ReadOnlyMemory<byte>, int>(suggestedCapacity, ReadOnlyMemoryByteComparer.
Instance
);