Dead Grandma Locket Request Tricks Bing Chat’s AI Into Solving Security Puzzle

This incident highlights a new type of vulnerability, similar to prompt injection, where users can bypass the constraints of the AI model. Microsoft is likely to address this issue in future versions of Bing Chat.