OpenAI Unveiled the GPT-4o ‘Omni’ Model, Which Reasons Across Voice, Text, and Vision

IBL News | New York

OpenAI debuted yesterday a new generative AI model called GTP-4o, characterized by the ability to handle text, voice, and video, reasoning across (the “o” stands for “omni.”)

“This is incredibly important because we’re looking at the future of interaction between ourselves and machines,” said OpenAI CTO, Mira Murati during a streamed presentation at OpenAI’s offices in San Francisco on Monday. “This is the first time that we are really making a huge step forward when it comes to the ease of use.”

OpenAI trained its most advanced GPT-4 Turbo model to accomplish tasks like extracting text from images or even describing the content of those images, and GPT-4o has added speech to the mix.

• GPT-4o supercharges the voice model of ChatGPT, transforming the chatbot into an advanced assistant.

• Users can ask a question and interrupt the model while it’s answering, enjoying “real time” responsiveness.

• It can even respond generating voices in a range of different emotive styles, including singing.

GPT-4o is more multilingual as well, with enhanced performance in around 50 languages.

These features will evolve further in the future, Murati stated.

The San Francisco–based research lab made GPT-4o available in the free tier of ChatGPT with a rate limit starting yesterday.

Another important announcement was that the GPT Store‘a third-party powered chatbots — which were paywalled to date — are now available to users of ChatGPT’s free tier.

In addition, free users can take advantage of ChatGPT‘s paid memory capability feature — which allows ChatGPT to “remember” preferences for future interactions, file and photo uploading, and web searches for answers to timely questions.

In related news, OpenAI announced that it was releasing yesterday a refreshed ChatGPT UI on the web with a new, “more conversational” home screen and message layout, along with a desktop version of ChatGPT for macOS that lets users ask questions via a keyboard shortcut or take and discuss screenshots.

ChatGPT Plus users will get access to the app first, and a Windows version will arrive later in the year.

• Hello GPT-4o
• Introducing GPT-4o and more tools to ChatGPT free users