HHS Secretary Robert F. Kennedy Jr. has promoted the use of generative AI at agencies including the FDA and said AI will be used to approve drugs âvery, very quickly,â while also testifying to a House subcommittee in June that AI is already being used to âincrease the speed of drug approvals.â
CNN reported, based on interviews with six current and former FDA employees, that the FDAâs AI tool âElsaâ can generate nonexistent studies and misrepresent research. Three employees described using Elsa for tasks such as meeting notes and summaries, and three reported that it âhallucinatesâ by inventing citations and giving confident but incorrect answers to basic questions, including drug-approval counts for children.
FDA Commissioner Marty Makary deployed Elsa across the agency on June 2. An internal slide leaked to Gizmodo described the tool as âcost-effective,â with a reported cost of $12,000 in its first four weeks. Makary told CNN Elsa could âpotentially hallucinate,â and FDA official William Maloney said CNN mischaracterized the information but did not specify inaccuracies when asked.