tree: 096e29ddb25aea182cbfa5ac7d80f118ca763715 [path history] [tgz]
  1. gen_data_mixed_mm.py
  2. gen_mixedmm_heuristic_a100.sh
  3. gen_mixedmm_heuristic_h100.sh
  4. generate_heuristic_mixedmm.sh
  5. get_mixedmm_dataset.sh
  6. README.md
  7. test_mixed_mm.py
  8. train_decision_mixedmm.py
torchgen/_autoheuristic/mixed_mm/README.md

If you just want to re-generate existing heuristics with already collected data for mixed_mm for A100/H100, run the following scripts:

bash get_mixedmm_dataset.sh # Downloads A100 and H100 datasets bash gen_mixedmm_heuristic_a100.sh # Generates A100 heuristic bash gen_mixedmm_heuristic_h100.sh # Generates H100 heuristic

If you want to collect new data, or generate a heuristic for another GPU, use the generate_heuristic.sh script: First, go into the generate_heuristic.sh and modify the variables according to the comments. Then run the script to perform benchmarks and collect training data:

bash generate_heuristic.sh collect

Depending on how many GPUs you are using, this might take a day. Afterwards, run the script in order to learn the heuristic:

bash generate_heuristic.sh generate