Base:
property
Normalizer
Microsoft.ML.Tokenizers.Tokenizer.Normalizer
4 references to Normalizer
Microsoft.ML.Tokenizers.Tests (4)
BertTokenizerTests.cs (3)
49
Assert.NotNull(tokenizer.
Normalizer
);
120
Assert.NotNull(tokenizer.
Normalizer
);
192
Assert.NotNull(tokenizer.
Normalizer
);
WordPieceTests.cs (1)
40
Assert.Null(tokenizer.
Normalizer
);
