“you have to kind of approach it more like um a researcher studying human behavior in a way you know you have to kind of um kind of observe what's happening in different um extreme cases um and then uh and then and then you start to form a pattern”

Treat the model like a tribe to observe, not code to debug

Models aren't deterministic functions — they refuse, hallucinate, and drift for no apparent reason. Working with them is closer to anthropology than software engineering: observe edge cases, log refusals, note the percentage of weird outputs, build a mental model over many trials. The blackbox doesn't yield to debugging, only to patient observation.