Forensics Tool ‘Reanimates’ the ‘Brains’ of AIs That Fail in Order to Understand What Went Wrong

There are techniques for inspecting AI systems, but they require access to the AI system’s internal data. Our team at the Georgia Institute of Technology has built a system, AI Psychiatry, or AIP, that can recreate the scenario in which an AI failed in order to determine what went wrong. Our team tested AI Psychiatry on 30 AI models, 24 of which were intentionally “backdoored” to produce incorrect outcomes under specific triggers. AI Psychiatry can also serve as a valuable tool for conducting audits on AI systems before problems arise. With a tool like AI Psychiatry in hand, auditors can apply a consistent forensic methodology across diverse AI platforms and deployments.