There are many users who have adopted ChatGPT on a daily basis as a personal assistant to whom they can ask any question, not related to current affairs, that will soon be our new mobile assistant.
OpenAI has just announced two new features that will make ChatGPT the favorite assistant for all users who have grown tired of Siri’s typical “this is what I found on the Internet” response or Google Assistant’s long silences when it can’t find an appropriate answer to the question.
As announced by the company, the ChatGPT application for iOS and Android mobile devices has begun to receive a new function that will allow establishing voice conversations with this Artificial Intelligence. But it doesn’t end there, since it will also include a function that will allow it to recognize the images we send it.
How the ChatGPT assistant works
OpenAI has posted a video on X (Twitter) to show how the ChatGPT mobile app’s image rendering will work. In this you can see how a user asks this AI how he can raise the seat of his bicycle and what tools he needs, of which he has available through an image, to be able to carry out the process.
OpenAI
@OpenAI
ChatGPT can now see, hear, and speak. Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms).
https://t.co/uNZjgbR5Bm https://t.co/paG0hMshXbSeptember 26, 2023 • 17:02
32.2K
3.7K
OoenAI has used the same AI-powered technology used in Be My Eyes, a mobile app that helps visually impaired users describe the object they are pointing their camera at alongside ChatGPT’s neural network.
As the months go by and the number of users using this new ChatGPT function increases, the possible errors that the application may make when correctly identifying the objects shown in an image will be reduced.
Regarding voice, ChatGPT uses Whisper, an open source voice recognition system trained by professional voice actors to offer much more realistic voice results that are far from the typical synthetic voice of the current assistants currently available.
This function is capable of recognizing all types of objects from photographs, screenshots or even images from books. This is just one new function of the almost infinite possibilities that any AI makes available to us and that will undoubtedly be very useful on a daily basis.
Availability
ChatGPT has begun to implement both functions through an update of its servers and it is expected to be available to all users in the next two weeks, as long as we are users of the ChatGPT Plus paid plan that has a monthly price of 20 Dollars. This feature is also available for Enterprise plan users.
The company has not announced whether OpenAI plans to offer these new functions for free in the future. If this were the case, both Siri and Google Assistant would definitely take a back seat for most users.
