[AI Reviewer] Comments without a specific rule are sometimes posted

[adamgrzybowski]

Context

We want the AI reviewer to stick to our defined rules and avoid posting more general or unrelated comments to reduce noise. Currently, it's not 100% enforced

This task will require researching and testing a more structured and consistent prompt that prevents Claude from posting comments that are outside the scope of the defined rules

Examples

• Fix mobile selection mode isn't turned off when all values are deleted #74630 (comment)
• Create OpenPolicyRulesPage read command #73915 (comment)

[adamgrzybowski]

I am linking this blog post as it may suggest the proper solution for our problem
https://www.greptile.com/blog/make-llms-shut-up

[melvin-bot]

This issue has not been updated in over 15 days. @adamgrzybowski eroding to Monthly issue.

P.S. Is everyone reading this sure this is really a near-term priority? Be brave: if you disagree, go ahead and close it out. If someone disagrees, they'll reopen it, and if they don't: one less thing to do!

[adamgrzybowski]

PR for this issue was merged two days ago