All pull requests

Pull requests

• fix(e2e-rag): drop the duplicated second half of QSL.py

  #2673·Anai-Guo opened Sep 11, 2026·

  ·
  1

• Default --audit-conf to audit.config in the reference entry points

  #2672·100-JM opened Sep 11, 2026·

  ·
  1

• llama3.1-8b: fix run scripts and the README accuracy flow

  #2671·100-JM opened Sep 11, 2026·

  ·
  2

• llama3.1-8b: use TokensPrompt in the Offline vLLM SUT and fail fast on worker death

  #2670·100-JM opened Sep 11, 2026·

  ·
  3

• Pin anthropic<1.0 in the DeepSeek-R1 evaluation requirements

  #2669·100-JM opened Sep 11, 2026·

  ·
  2

• Bound and pre-load the DeepSeek-R1 LiveCodeBench grader workers

  #2668·100-JM opened Sep 11, 2026·

  ·
  1

• fix: NameError 'has_reranker' in e2e-rag single-shot result display

  #2667·Anai-Guo opened Sep 9, 2026·

  ·
  1

• fix(TEST01): NameError in verify_performance when the loadgen log reports errors

  #2666·Anai-Guo opened Sep 9, 2026·

  ·
  1

• Restore IMAGE_EXTENSIONS in the text_to_image FID helper

  #2665·David-Wu1119 opened Sep 3, 2026·

  ·
  3

• Fix two NameErrors in the e2e-rag reference implementation

  #2664·David-Wu1119 opened Sep 3, 2026·

  ·
  3

• Fix NameError on every async query in the llama2-70b API SUT

  #2663·David-Wu1119 opened Sep 3, 2026·

  ·
  3

• Fix three defects in tools/submission/log_parser.py

  #2662·David-Wu1119 opened Sep 3, 2026·

  ·
  6

• Fix Loadgen Over the Network (LON) Demo

  #2647·mkandes opened Jul 29, 2026·

  ·
  1

• Remove old submodule

  #2594·pgmpablo157321 opened May 26, 2026Contributor·

  ·
  7

• Add optional energy efficiency reporting schema for inference benchmarks

  #2587·hongping-zh opened May 14, 2026·

  ·
  8

• Add PyTorch TorchScript backend for vision benchmarks

  #2578·amd-arsuresh opened Apr 20, 2026·

  ·
  2

• Add shellcheck to format pass.

  #2570·arav-agarwal2 opened Apr 6, 2026Contributor·

  ·
  1

  

• Enable llama3.1-8b on CPU

  #2567·cfRod opened Mar 31, 2026Contributor·

  ·
  2

• Add better logging for performance range mode testing

  #2560·arav-agarwal2 opened Mar 11, 2026Contributor·

  ·
  1

• Remove shell=True calls across the repo.

  #2556·arav-agarwal2 opened Feb 26, 2026Contributor·

  ·
  1

  1

• Update os.system calls in vision

  #2554·arav-agarwal2 opened Feb 26, 2026Contributor·

  ·
  1

• feat(llama3.1-8b): expose vLLM engine params as CLI arguments

  #2553·ssaketh-ch opened Feb 26, 2026Member·

  ·
  9

• Update submission_checker to use loguru formatting

  #2546·arav-agarwal2 opened Feb 23, 2026Contributor·

  ·
  3

• Update run_mlperf.py | We should not call FromConfig using audit.conf…

  #2541·arjunsuresh opened Feb 17, 2026Contributor·

  ·
  1

• Add pre-commit config.

  #2536·arav-agarwal2 opened Feb 11, 2026Contributor·

  ·
  1