1 reference to FromBase64String
Microsoft.ML.Tokenizers (1)
Model\TiktokenTokenizer.cs (1)
218
AddData(Helpers.
FromBase64String
(line, 0, spaceIndex), rank);