I have created a shipyard tool, which splits up a large number of test-cases into several Caravels (as many as needed), then it builds those caravels (from the Caravel project template), fills them with their respective test-cases, builds them to GDS2, and sends all those Caravels off to GitHub.