DikeBenchmarker package
Subpackages
- DikeBenchmarker.benchmarkadaptors package
- DikeBenchmarker.data package
- DikeBenchmarker.dataadaptors package
- Submodules
- DikeBenchmarker.dataadaptors.competition_dataadaptor module
- DikeBenchmarker.dataadaptors.csv_dataadaptor module
- DikeBenchmarker.dataadaptors.dataadaptor module
- DikeBenchmarker.dataadaptors.inmemory_dataadaptor module
- DikeBenchmarker.dataadaptors.merge_dataadaptor module
- DikeBenchmarker.dataadaptors.sqlite_dataadaptor module
- Module contents
- DikeBenchmarker.infrastructureadaptors package
- DikeBenchmarker.performancemodels package
- DikeBenchmarker.resultconsumers package
- DikeBenchmarker.solveradaptors package
- Submodules
- DikeBenchmarker.solveradaptors.abstractexecutable module
AbstractExecutableAbstractExecutable.format_command()AbstractExecutable.from_dict()AbstractExecutable.get_binaries()AbstractExecutable.get_checker()AbstractExecutable.get_format_string()AbstractExecutable.get_ids()AbstractExecutable.parse_result()AbstractExecutable.read_registry()AbstractExecutable.register()AbstractExecutable.registryAbstractExecutable.to_dict()
- DikeBenchmarker.solveradaptors.checkeradaptor module
- DikeBenchmarker.solveradaptors.executionwrapper module
- DikeBenchmarker.solveradaptors.solveradaptor module
- Module contents
Submodules
DikeBenchmarker.benchmarkatoms module
Basic benchmarking job and result representation
- class DikeBenchmarker.benchmarkatoms.Job(job_producer: AbstractBenchmarker, benchmark_id: str, solver_id: str, checker_id: str, logroot: str, retries: int = 3)[source]
Bases:
objectBenchmarking Job that behaves like a future.
Identity: benchmark_id, solver_id, created_at (ctor time).
Lifecycle:
- CREATED (initial)
–[put into JobLog]–> SUBMITTED –[start working on]–> RUNNING –[finish working on]–> FINISHED | FAILED
CREATED/SUBMITTED -> CANCELLED
- cancel_local() bool[source]
Mark the job as cancelled. Called by the benchmarker to prevent the job from being submitted to the external system.
- clone_retry(decrement: int = 1) Job[source]
Create a clone of this job with identical benchmark_id, solver_id, checker_id, and logroot. The cloned job will have a new created_at timestamp and will be in the CREATED state. The retries count will be decremented by the specified amount.
- mark_running() None[source]
Mark the job as running. Called by the infrastructure adaptor once the job started to run.
- mark_submitted() None[source]
Mark the job as submitted. Called by the infrastructure adaptor upon receiving the job.
- class DikeBenchmarker.benchmarkatoms.JobState(value)[source]
Bases:
EnumPossible states of a Job.
- CANCELLED = 6
- CREATED = 1
- FAILED = 5
- FINISHED = 4
- RUNNING = 3
- SUBMITTED = 2