1 reference to Phi2TokenizerHelper
Microsoft.ML.GenAI.Phi.Tests (1)
Phi2Tests.cs (1)
44
var tokenizer =
Phi2TokenizerHelper
.Create(modelWeightFolder, addBeginOfSentence: true);