datumaro.plugins.data_formats.datumaro.importer#

Classes

DatumaroImporter()

class datumaro.plugins.data_formats.datumaro.importer.DatumaroImporter[source]#

Bases: Importer

PATH_CLS#: alias of DatumaroPath

classmethod detect(context: FormatDetectionContext) → FormatDetectionConfidence | None[source]#

classmethod find_sources(path) → List[Dict][source]#

classmethod get_file_extensions() → List[str][source]#

property can_stream: bool#: Flag to indicate whether the importer can stream the dataset item or not.

get_extractor_merger() → Type[ExtractorMerger][source]#

Extractor merger dedicated for the data format

Datumaro import process spawns multiple DatasetBase for the detected sources. We can find a bunch of the detected sources from the given directory path. It is usually each detected source is corresponded to the subset of dataset in many data formats.

Parameters:: stream – There can exist a branch according to stream flag
Returns:: If None, use Dataset.from_extractors() to merge the extractors, Otherwise, use the return type to merge the extractors.