BuildInputsWithSpecialTokens

4 references to BuildInputsWithSpecialTokens

Microsoft.ML.Tokenizers.Tests (4)

BertTokenizerTests.cs (4)

287bertTokenizer.BuildInputsWithSpecialTokens(ids1)); 302bertTokenizer.BuildInputsWithSpecialTokens(ids1, ids2)); 325bertTokenizer.BuildInputsWithSpecialTokens(ids1)); 342bertTokenizer.BuildInputsWithSpecialTokens(ids1, ids2));