Overview
Tutorials
Embeddings
Advanced Use Cases
API
About
Table of Contents
Generators
CorpusGenerator
BatchDataSet
kashgari.generators.
Bases: kashgari.generators.ABCGenerator
kashgari.generators.ABCGenerator
__init__
Initialize self. See help(type(self)) for accurate signature.
x_data (List) –
y_data (List) –
buffer_size (int) –
None
sample
Iterator[Tuple[Any, Any]]
Bases: collections.abc.Iterable, typing.Generic
collections.abc.Iterable
typing.Generic
corpus (kashgari.generators.CorpusGenerator) –
text_processor (ABCProcessor) –
label_processor (ABCProcessor) –
seq_length (int) –
max_position (int) –
segment (bool) –
batch_size (int) –
take
take batches from the dataset
batch_count (int) – number of batch count, iterate forever when batch_count is None.
Any