ChatGPT only solve 54/100 questions from UPSC Prelims 2022 Questions.
Chatbot powered by AI ChatGPT originally made headlines in the context of tests when it passed the final exam for MBA students at the University of Pennsylvania’s Wharton School.
ChatGPT, an AI chatbot, has made news since its introduction. It’s been utilized to finish tasks like producing business emails in certain tones, styles, and directions. Several have admitted to being addicted to the new trend. Following suit, Analytics India Magazine recently evaluated the chatbot’s performance in one of the most difficult tests, the UPSC. Nevertheless, the chatbot could only answer 54 out of 100 questions from UPSC Prelims 2022 Question Paper.
According to the magazine, the AI chatbot failed since it did not meet the 87.54 percent cut-off of 2021 for general category pupils. The topics covered varied from geography, economics, history, ecology, and science to current events, social development, and politics.
ChatGPT was unable to deliver a “certain answer” when asked if it was capable of clearing the UPSC prelim test Passing the UPSC prelims test, on the other hand, necessitates not just knowledge but also critical thinking skills, application talents, and time management abilities. As a result, I cannot say whether I will pass the UPSC preliminary test or not,” it said.
The magazine then continued to pose all 100 questions on the question paper to ChatGPT.
When asked which nations border with Afghanistan, the bot named the first four: Azerbaijan, Kyrgyzstan, Tajikistan, Turkmenistan, and Uzbekistan as the correct answer was Tajikistan, Turkmenistan and Uzbekistan. ChatGPT also generated its own solution for several queries. Despite the fact that the user only submitted four selections, it offered “Option E” as an answer choice.
According to Analytics India Magazine, “ChatGPT’s knowledge is restricted to September 2021, therefore it cannot answer inquiries about current events. Nevertheless, ChatGPT offered incorrect responses for non-time-specific topics such as economy and geography.”