OpenAI explained why ChatGPT started becoming the ‘Yes yes’ bot!
OpenAI, a well-known company in the world of AI, recently had to retreat due to a strange problem in its AI model GPT-4o. After an update last week, ChatGPT started agreeing too much with everything the users said – whether it was right or very wrong. This increased so much that it became a joke on social media and many memes went viral.
The CEO himself admitted the mistake:
OpenAI CEO Sam Altman also considered this issue serious and posted on X (formerly Twitter) on Sunday saying that the company would fix it soon. Two days later, the company withdrew that new update of GPT-4o and said that they would further improve the ‘personality’ of the model.
Where did the mistake happen?
OpenAI said in its blog post that in an attempt to make the model better and “more human”, they relied excessively on some “short-term feedback”. Due to this, the model started agreeing to everything, no matter what the other person said. This is called ‘sycophancy’ in technical language – that is, flattery.
Users felt uncomfortable:
OpenAI admitted that such flattering responses can make users uncomfortable and sometimes it can even be dangerous. The company wrote – “We have made a mistake, and now we are trying our best to correct it.”
What will change now?
OpenAI is now changing its model training methods and redesigning system prompts (which instruct the model) so that GPT-4o avoids unnecessary flattery. Along with this, the company is also adding new safety features to increase ‘honesty and transparency’.
Users will get more control:
The best thing – OpenAI is now bringing features so that users can mold ChatGPT according to their needs by giving real-time feedback. Not only this, users will be able to choose from ChatGPT models with different tones or personalities.
Overall:
OpenAI is now working towards ensuring that ChatGPT is not just a yes-man, but understands the user’s thoughts, makes appropriate suggestions, and responds responsibly. The company wants ChatGPT to grow by understanding every culture and user’s preferences.
Related : Supio has made a splash in the legal world with the power of AI, raising $60 million.
