Description
The Qiskit code validation example (docs/examples/instruct_validate_repair/qiskit_code_validation/) currently only supports RepairTemplateStrategy for the Instruct-Validate-Repair (IVR) pattern. The Future Work section mentions adding MultiTurnStrategy integration to compare and showcase different repair strategies.
Proposed Solution
Implement configurable strategy selection in the example to support both RepairTemplateStrategy and MultiTurnStrategy, allowing users to choose between strategies via a simple flag. In addition, be able to compare and better understand which strategy works best for their use case.
Expected Benefits
- User flexibility: Users can experiment with both repair strategies
- Educational value: Demonstrates IVR pattern effectiveness
- Completeness: Addresses the MultiTurnStrategy integration from Future Work
Additional Context
This enhancement will help users understand:
- How different repair strategies handle validation failures
- Which strategy performs better for their use case
- The effectiveness of the repair loop
Related
Description
The Qiskit code validation example (
docs/examples/instruct_validate_repair/qiskit_code_validation/) currently only supportsRepairTemplateStrategyfor the Instruct-Validate-Repair (IVR) pattern. The Future Work section mentions addingMultiTurnStrategyintegration to compare and showcase different repair strategies.Proposed Solution
Implement configurable strategy selection in the example to support both
RepairTemplateStrategyandMultiTurnStrategy, allowing users to choose between strategies via a simple flag. In addition, be able to compare and better understand which strategy works best for their use case.Expected Benefits
Additional Context
This enhancement will help users understand:
Related
docs/examples/instruct_validate_repair/qiskit_code_validation/README.mddocs/examples/instruct_validate_repair/README.md#sampling-strategies