- Updated config setup
- Added basic docstrings
- Created get_run_struct To set up the run directory, and set the paths to results types and catalogs. Checks if they exist already
- Added option to serialize catalog, and read it it flagged
- Created the run experiment main code:
- Gets the results manifest
- Check if the tests are individual, comparative or matrix type.
- Runs the evaluation
- Serializes the evaluation and store it within the class
- Loads the evaluation if already exist
Main todos:
- Handle parent directory of the experiment repo @wsavran help with this please.
- Serialize experiment configuration, and create classmethod .from_yml
- Create the forecasts outside the testing loop
- Create and write run log (yaml, json or logging module?)
- Create plotting function