OpenAI's ChatGPT will soon hear, see and talk

As the OpenAI chatbot extends its functionality, ChatGPT will soon be able to listen and converse to its users, as well as see photographs posted to it.

According to OpenAI, the new, more "intuitive" interface, which will be released in the coming weeks, will allow individuals to have discussions with ChatGPT and see chatbot pictures, which can then be debated.

Users, for example, will be able to take photos of landmarks and upload them to ChatGPT to assist identify them, according to the AI business. Users may even photograph their refrigerator and ask the chatbot to recommend meal alternatives or show it a math issue.

OpenAI wrote in its announcement,

You can now show ChatGPT one or more images. Troubleshoot why your grill won’t start, explore the contents of your fridge to plan a meal or analyse a complex graph for work-related data.

The drawing tool in the ChatGPT mobile app will also allow users to focus on a specific section of the image. The voice and photos services will first be offered to Plus and Enterprise customers in the next two weeks, with the images tool available on all platforms. The capability will eventually be made available to developers and free version users.

Powerful AI assistants have long appeared in science fiction, but they are gradually becoming a reality. Microsoft just introduced an AI copilot for Windows 11 that is set to take AI help to the next level. Users may ask Copilot to execute a number of activities, ranging from requesting it to play music on a favourite music app to organizing several windows on a single screen to summarizing content on webpages.

OpenAI revealed its new enterprise-grade ChatGPT solution last month, which includes increased privacy and security, unrestricted higher-speed access to GPT-4, extended context windows for processing lengthier inputs, and other enhancements. Earlier this year, OpenAI faced a major class-action lawsuit from a US law firm on the grounds that it scraped the internet to train ChatGPT, potentially violating the rights of millions.