Base:
property
Normalizer
Microsoft.ML.Tokenizers.Tokenizer.Normalizer
3 references to Normalizer
Microsoft.ML.Tokenizers.Tests (3)
BertTokenizerTests.cs (2)
35
Assert.NotNull(tokenizer.
Normalizer
);
102
Assert.NotNull(tokenizer.
Normalizer
);
WordPieceTests.cs (1)
40
Assert.Null(tokenizer.
Normalizer
);
