AI Reports · GovAI (Oxford) · 2026-10-17 · Research paper
AI Lab Policy Auditing Large Language Models: A Three‐Layered Approach May 2023 Research Paper Jakob Mökander, Jonas Schuett, Hannah Rose Kirk, & Luciano Floridi Previous research has pointed toward a
The article proposes a blueprint for auditing large language models (LLMs) in three layers: governance audits of technology providers, model audits of LLMs after pre-training but before release, and application audits of LLM-based applications. The authors argue these layers complement each other and can help manage some ethical and social risks. They also discuss the limitations of this approach and of auditing LLMs in general.