A student who turned to Google’s AI chatbot for some help with his homework wound up being “thoroughly freaked out” when he received a threatening response.

A grad student was engaged in a chat with Google’s Gemini on the subject of aging adults when he allegedly received a seemingly threatening response from the chatbot saying human 'please die.'

Gemini AI, Google’s chatbot went off the rails and charged at a user before telling them to “please die,” violating its own policies. This particular user was having a conversation with the chatbot about elderly care when the chatbot lost it and charged the user.

Google's glitchy Gemini chatbot is back at it again, folks — and this time, it's going for the jugular. In a now-viral exchange that's backed up by exported chat logs, a seemingly fed-up Gemini begs a user to "please die" after they repeatedly asked the chatbot to solve their homework for them.

Google’s AI chatbot Gemini responded to a user’s query about elderly care by verbally abusing the user and telling them to die, reported CBS News this week.

Posted on the r/artificial subreddit, the student's brother said that both of them are freaked out over the result of his homework assignment. The user also shared a full transcript of their conversation history with the Gemini AI. It appears the user was testing out Google’s chatbot to assist with homework assignments.

In an online conversation about aging adults, Google's Gemini AI chatbot responded with a threatening message, telling the user to "please die."

Google has said it's chatbot it designed to filter out potentially harmful responses but this is not the first time the company has come under criticism for it's AI chatbot