网页
综合
更新时间 2026-11-14 05:30:55
KerasHub Tokenizers
Tokenizers convert raw string input into integer input suitable for a Keras Embedding layer. They can also convert back from predicted integer sequences to raw string output.
All tokenizers subclass keras_hub.tokenizers.Tokenizer, which in turn subclasses keras.layers.Layer. Tokenizers should generally be applied inside a tf.data.Dataset.map for training, and can be included inside a keras.Model for inference.
All tokenizers subclass keras_hub.tokenizers.Tokenizer, which in turn subclasses keras.layers.Layer. Tokenizers should generally be applied inside a tf.data.Dataset.map for training, and can be included inside a keras.Model for inference.
本页为82搜索生成的网页快照，内容来自站内索引；演示数据的原文链接仅作示例。