The autoreload extension is already loaded. To reload it, use:
%reload_ext autoreloadExperiments class
Class to retrieve comet experiment data.
# nothingCometExperimentManager
CometExperimentManager (api_key:str=None, workspace:str=None)
Initialize self. See help(type(self)) for accurate signature.
# Initialize the manager
workspace = 'lunarlandercontinuous-v2'
project_name = 'refinputs-smooth'
manager = CometExperimentManager(workspace=workspace)
# Test get_all_artifacts_sorted
artifact_results = manager.get_all_artifacts_indexed()
# print("Artifacts sorted by source experiment key:", artifacts)
# Test get_experiments_by_metrics
experiments = manager.get_experiments_by_metrics(project_name=project_name, score_threshold=0.05, reward_threshold=10.0)
print("Filtered experiments:", experiments)COMET WARNING: As you are running in a Jupyter environment, you will need to call `experiment.end()` when finished to ensure all metrics and code are logged before exiting. COMET INFO: Experiment is live on comet.com https://www.comet.com/lunarlandercontinuous-v2/general/01e2d222f6d44c56b93a45c409dbf07a COMET INFO: Experiment is live on comet.com https://www.comet.com/lunarlandercontinuous-v2/general/01e2d222f6d44c56b93a45c409dbf07a COMET INFO: The process of logging environment details (conda environment, git patch) is underway. Please be patient as this may take some time. COMET INFO: The process of logging environment details (conda environment, git patch) is underway. Please be patient as this may take some time.
Error retrieving artifact ga-000.238-s002-3x1-m000-LL0001-d9aaf2358a62b99f9bbd6e7db60e631d.properties: Artifact {'consumer_experiment_key': '01e2d222f6d44c56b93a45c409dbf07a', 'experiment_key': '01e2d222f6d44c56b93a45c409dbf07a', 'name': 'ga-000.238-s002-3x1-m000-LL0001-d9aaf2358a62b99f9bbd6e7db60e631d.properties', 'version_or_alias': None, 'workspace': None} is not in a finalized state and cannot be accessed.COMET INFO: --------------------------------------------------------------------------------------- COMET INFO: Comet.ml Experiment Summary COMET INFO: --------------------------------------------------------------------------------------- COMET INFO: Data: COMET INFO: display_summary_level : 1 COMET INFO: Comet.ml Experiment Summary COMET INFO: --------------------------------------------------------------------------------------- COMET INFO: Data: COMET INFO: display_summary_level : 1 COMET INFO: name : only_bee_5002 COMET INFO: url : https://www.comet.com/lunarlandercontinuous-v2/general/01e2d222f6d44c56b93a45c409dbf07a COMET INFO: Uploads: COMET INFO: name : only_bee_5002 COMET INFO: url : https://www.comet.com/lunarlandercontinuous-v2/general/01e2d222f6d44c56b93a45c409dbf07a COMET INFO: Uploads: COMET INFO: environment details : 1 COMET INFO: filename : 1 COMET INFO: git metadata : 1 COMET INFO: environment details : 1 COMET INFO: filename : 1 COMET INFO: git metadata : 1 COMET INFO: git-patch (uncompressed) : 1 (1.90 MB) COMET INFO: installed packages : 1 COMET INFO: notebook : 1 COMET INFO: source_code : 1 COMET INFO: git-patch (uncompressed) : 1 (1.90 MB) COMET INFO: installed packages : 1 COMET INFO: notebook : 1 COMET INFO: source_code : 1 COMET INFO: COMET INFO: COMET INFO: Please wait for assets to finish uploading (timeout is 10800 seconds) COMET INFO: Still uploading 1 file(s), remaining 861.60 KB/1.06 MB COMET INFO: Please wait for assets to finish uploading (timeout is 10800 seconds) COMET INFO: Still uploading 1 file(s), remaining 861.60 KB/1.06 MB COMET INFO: no such metrics: 'reward_avg'; ignoring query, returning no matches COMET INFO: no such metrics: 'reward_avg'; ignoring query, returning no matches
Added 1 new artifacts to cache
Filtered experiments: []# import random
# Test run_experiments_and_record_results
if experiments:
output_csv = "/tmp/artifacts/experiment_results.csv"
manager.run_experiments_and_record_results(experiments=experiments, project_name=project_name, artifact_results=artifact_results, num_runs=2, output_csv=output_csv)
print(f"Results saved to {output_csv}")