AI debugging is increasingly challenging, often stemming from complex, interconnected codebases and the difficulty in pinpointing the root cause of errors. This article explores the frustrations of debugging in the context of AI-powered applications, highlighting the challenges of understanding the full system and the reliance on RAG for context.