“I don't want it to say yes to something that is a no but it's fine for me to for it to say no to something that that might be a yes I don't care about the the false negatives that those are acceptable because I have like 20,000 podcast episodes coming in in a day”

Pick the asymmetric error tolerance before tuning the prompt

When the input firehose is big, optimize the prompt for precision, not recall. A wrong 'yes' burns user trust on every notification; a missed 'yes' is invisible. Encode that asymmetry directly into the eval scoring before tuning — penalize false positives ~10x more than false negatives, then chase that number. Arvid hit 99.8% on a podcast-classifier doing exactly this.