Challenge Creation#

Base classes and helpers to create new challenges.

BaseChallenge()

Base class for all challenges.

Functions#

collect_cv_results(cv_results)

Collect the cross-validation results into a pandas DataFrame.

collect_cv_metadata(dataset)

Collect the cross-validation metadata.

collect_opti_results(cv_results)

Collect the optimization results.

save_cv_results(cv_results, cv_metadata, ...)

Save CV results extracted using collect_cv_results and collect_cv_metadata to a folder.

save_opti_results(opti_results, folder_path)

Save optimization results extracted using collect_opti_results to a folder.

load_cv_results(folder_path[, filename, ...])

Load the results of a cross-validation from a folder.

load_opti_results(folder_path[, filename])

Load the results of an optimization from a folder.

resolve_dataset(dataset, path_or_dataset_class)

Resolve a dataset-instance given a path or an instance of the dataset class.

Types#

CvMetadata

Metadata about the cross-validation.