A Sky News investigation has uncovered widespread use of artificial intelligence (AI) software by doctors for recording and transcribing patient meetings, despite much of this technology failing to meet minimum standards set by NHS England. This alarming revelation comes amidst growing controversy surrounding AI tools, specifically Ambient Voice Technology (AVT), which captures, transcribes, and summarizes patient conversations. Initially, NHS England had promoted the benefits of AVT for its potential to free up doctors' time, allowing them to concentrate more on patients. However, just weeks after this promotion, the same body issued a stark warning, demanding that GPs and hospitals cease using unapproved AI software due to potential breaches of data protection rules and risks to patient safety.

A letter dated June 9, from the national chief clinical information officer of NHS England, explicitly highlighted the dangers posed by non-compliant AVT solutions that are still widely employed in clinical practice. The letter warned that numerous AVT suppliers were approaching NHS organizations without adhering to basic NHS governance standards. The use of such unapproved software, the letter stressed, jeopardizes clinical safety, exposes the NHS to data protection breaches and financial risks, and could fragment the broader NHS digital strategy. Concerns were further amplified by previous Sky News revelations regarding AI "hallucinations," where the technology fabricates information, a phenomenon that could have perilous consequences in a healthcare setting.

Amidst this rapidly evolving technological landscape, healthcare professionals are calling for more proactive guidance from NHS England. Dr. David Wrigley, deputy chair of the British Medical Association’s GP committee, articulated the need for external expertise to vet these products. He emphasized that while doctors are generally pro-AI for its potential to aid patients and colleagues, its implementation must be safe and secure to prevent data loss or leakage. Matthew Taylor, chief executive of the NHS Confederation, described NHS England's warning letter as a "significant moment," advocating for government assistance in procurement decisions and clear advice on which AI systems are safe for medical use. Taylor noted that the "let a thousand flowers bloom" approach to ambient voice technology has proven to have its limitations, underscoring the urgent need for structured oversight.

Despite the current controversies, the Health Secretary, Wes Streeting, plans to position AI at the core of the NHS's 10-year reform strategy. Streeting even anecdotally noted clinicians' enthusiasm for AI, with some already using ambient AI for note-taking even before their practices or trusts officially adopt it. While not encouraging unapproved use, he views this as a sign that staff are not resistant to change but are actively seeking technological solutions to improve their workflow.

Conversely, doctors who utilize AI software compliant with national standards report significant benefits. Dr. Anil Mehta, a GP, highlighted that AI helps reduce paperwork, which consumes approximately 30% of his week. He asserted that after explaining the process, patients are highly reassured, and the confidentiality of doctor-patient consultations remains uncompromised. An NHS spokesperson reaffirmed the potential of Ambient Voice Technology to transform care and improve efficiency, stating that the NHS is actively collaborating with organizations and suppliers to ensure all AVT products comply with NHS standards for clinical safety and data security.