#755 `run_designs.py` should exit with a nonzero code if a design fails New issue created by donn Prompt

run_designs.py

,

make test_design_list

and its derivatives,

make fastest_test_set

and

make extended_test_set

, all exit with a zero exit code even if any of the designs fail. This aliases failures on the OpenROAD team's Jenkins CI, as they don't use

.github/scripts/run_tests.py

. Proposal A flag should be added to

run_designs.py

for a nonzero exit, and this flag should be used by the Makefile. The-OpenROAD-Project/OpenLane