[FEA] Routing Test Execution Optimization in CI/CD and Nightly runs

[anandhkb]

Optimize routing CI/CD test execution in PRs.
Use selective triggers for PRs; run full tests nightly.

[bala-bhargav]

@anandhkb
can i work on this ??

[anandhkb]

@anandhkb can i work on this ??

Hello @bala-bhargav
We welcome your interest and contributions! Please do!

[bala-bhargav]

Hey @anandhkb

I've gone through the repo and the CI setup to understand this issue better. Before I start working on it, just wanted to make sure we're on the same page:

About the nightly side — From what I can see, the nightly pipeline already runs the full test suite (C++ tests, Python tests, wheel tests, notebooks — everything). So I'm assuming this issue is mainly about making the PR pipeline smarter, and the nightly doesn't need any changes. Is that right, or is there something more you'd like on the nightly side too?

How deep should the selective testing go? — Right now, the PR pipeline already skips things at a high level (e.g., it won't run C++ tests if you only changed Python files). But once routing tests are triggered, all 25 Python routing tests and all the C++ routing tests run together — there's no way to pick and choose. Are you looking for us to build a mapping between specific source files and their related tests, so for example if someone only touches re_routing.py, we only run test_re_routing.py? And should this cover both C++ and Python, or just one of them?

[rgsl888prabhu]

Thank you @bala-bhargav for showing the interest in contributing to cuOpt,

For nightly we would like to run complete suite without any exceptions since we are also testing dependencies along with other things.

For PR, I would say lets keep it more easier to manage manner, like if you touch routing folder then run routing tests, if you touch linear programming then those tests, lets not map it too much since it will cause too much of burden on managing it.

[rgsl888prabhu]

@bala-bhargav Are you working on this problem ? Please create a draft PR so we can provide early feedback.