ClientΒΆ
Note
When running the client, you can supply either the configuration yaml file, or the CLI arguments. You do not need to supply both.
Use the command diagnose -h to view all usage of the CLI helper at any time. Specific argument descriptions and explanations can be found on the Configuration page.
usage: diagnose [-h] [--config CONFIG] [--model_path MODEL_PATH] [--model_engine {SBIModel}] [--data_path DATA_PATH] [--data_engine {H5Data,PickleData}]
[--simulator SIMULATOR] [--out_dir OUT_DIR] [--metrics [{CoverageFraction,AllSBC,LC2ST}]]
[--plots [{CDFRanks,CoverageFraction,Ranks,TARP,LC2ST,PPC}]]
options:
-h, --help show this help message and exit
--config CONFIG, -c CONFIG
.yaml file with all arguments to run.
--model_path MODEL_PATH, -m MODEL_PATH
String path to a model. Must be compatible with your model_engine choice.
--model_engine {SBIModel}, -e {SBIModel}
Way to load your model. See each module's documentation page for requirements and specifications.
--data_path DATA_PATH, -d DATA_PATH
String path to data. Must be compatible with data_engine choice.
--data_engine {H5Data,PickleData}, -g {H5Data,PickleData}
Way to load your data. See each module's documentation page for requirements and specifications.
--simulator SIMULATOR, -s SIMULATOR
String name of the simulator to use with generative metrics and plots. Must be pre-register with the `utils.register_simulator` method.
--out_dir OUT_DIR Where the results will be saved. Path need not exist, it will be created.
--metrics [{CoverageFraction,AllSBC,LC2ST}]
List of metrics to run. To not run any, supply `--metrics `
--plots [{CDFRanks,CoverageFraction,Ranks,TARP,LC2ST,PPC}]
List of plots to run. To not run any, supply `--plots `