Supreme Court says AI-generated hallucinated precedents ‘catastrophic’ to judicial process, sets aside NCLT order

This judgment directly intersects with the concept of the Rule of Law, which forms part of the Basic Structure of the Constitution. The common law system heavily relies on the Doctrine of Stare Decisis (the legal principle of determining points in litigation according to precedent). When judicial or quasi-judicial bodies like the National Company Law Tribunal rely on 'hallucinated' (fabricated) precedents generated by Artificial Intelligence, the fundamental predictability and legality of the justice system are subverted. The Supreme Court of India, exercising its appellate and supervisory jurisdiction, has recognized that the unquestioned adoption of technological outputs undermines judicial independence and the essential human reasoning required for adjudication. The court's reference to the Draft Regulations for Use of Artificial Intelligence in Courts, 2026 indicates an ongoing institutional effort to regulate technology, ensuring AI remains strictly an assistive tool rather than supplanting the core adjudicatory functions of a judge. Aspirants must prepare for questions on the balance between technological integration in courts (e-Courts project) and maintaining judicial integrity.

From a governance standpoint, this incident highlights the significant risks associated with the rapid adoption of emerging technologies by statutory bodies and tribunals. The Insolvency and Bankruptcy Code (IBC) relies on swift and accurate decision-making by the National Company Law Tribunal to resolve corporate distress efficiently. The revelation that the NCLT conducted 'own research' yielding fake precedents points to a systemic vulnerability where the pressure for speedy disposal might lead to over-reliance on unverified AI tools. The Supreme Court's directive to the Bar Council of India (BCI) to formulate norms represents a crucial regulatory intervention. The BCI, as the apex statutory body regulating legal education and professional standards under the Advocates Act, is now tasked with creating ethical guidelines and disciplinary mechanisms for technology use. This underscores the need for capacity building and digital literacy within the legal ecosystem—both for the Bar (lawyers) and the Bench (judges)—to ensure meaningful human oversight is maintained at every stage of the dispute resolution process.

The Supreme Court's observations offer a profound critique of human reliance on machines, warning against the 'habit' of delegating 'thinking' to Artificial Intelligence. This touches upon the core ethical concept of human agency and accountability in public service. The court argues that the capacity for reasoning is uniquely human, shaped through deliberate training, and cannot be ethically relinquished to algorithms. The comparison of AI hallucinations to a 'catastrophic' gas leak emphasizes the invisible yet profound damage caused when integrity and probity in decision-making are compromised. The draft regulations' prohibition on using AI in sentencing or bail decisions highlights the ethical consensus that matters concerning human liberty require empathy, moral judgment, and contextual understanding—qualities absent in AI. This case serves as a vital case study for GS Paper 4 on the ethical dimensions of technology in governance, demonstrating how the pursuit of efficiency must never override the fundamental requirements of fairness, transparency, and truth in public administration.