Man tricks OpenAI’s voice bot into duet of The Beatles’ “Eleanor Rigby” [Ars Technica]

OpenAI doesn’t want its chatbot to sing, but sometimes the ability slips through.

Enlarge / A screen capture of AJ Smith doing his Eleanor Rigby duet with OpenAI’s Advanced Voice Mode through the ChatGPT app. (credit: AJ Smith / Getty Images)

OpenAI’s new Advanced Voice Mode (AVM) of its ChatGPT AI assistant rolled out to subscribers on Tuesday, and people are already finding novel ways to use it, even against OpenAI’s wishes. On Thursday, a software architect named AJ Smith tweeted a video of himself playing a duet of The Beatles’ 1966 song “Eleanor Rigby” with AVM. In the video, Smith plays the guitar and sings, with the AI voice interjecting and singing along sporadically, praising his rendition.

“Honestly, it was mind-blowing. The first time I did it, I wasn’t recording and literally got chills,” Smith told Ars Technica via text message. “I wasn’t even asking it to sing along.”

Smith is no stranger to AI topics. In his day job, he works as associate director of AI Engineering at S&P Global. “I use [AI] all the time and lead a team that uses AI day to day,” he told us.

AI,Biz & IT,Advanced Voice Mode,AI copyright,AI fair use,AI prompt injection,AJ Smith,audio synthesis,copyright,Eleanor Rigby,fair use,large language models,machine learning,music synthesis,openai,Paul McCartney,prompt injection,The Beatles,voice synthesis

openai