IBL News | New York
Google’s main Gemini AI demo video released — see it below — last week was fabricated, misrepresenting the model’s capabilities. The company admitted it in a report issued by Bloomberg.
“Google’s video made it look like you could show different things to Gemini Ultra in real time and talk to it. You can’t,” Bloomberg’s reported wrote in a tweet.
Google researchers interacted with Gemini through text, not voice, then picked the best interactions and edited them together with voice synthesis to make the video.
As a result, the Internet giant is now facing controversy among AI experts.
Running still images and text through LLM is computationally intensive and makes real-time video largely impractical. That was one of the clues that led experts to detect that the video was misleading.
As Ars Technica reports, “OpenAI has embarrassed Google in generative AI over the last year.”
On December 6th, Gemini was introduced as the first true rival to OpenAI’s GPT-4.
The stock of the company went up 5% amidst comments about Google’s model “sophisticated reasoning capabilities,” supported by multiple benchmarks.
The contested video, titled “Hands-on with Gemini: Interacting with multimodal AI,” shows that the AI model sees, accompanied by the AI model’s responses on the right side of the screen. The viewer hears a voice, apparently of Gemini Ultra, responding to the questions.
Additionally, on the next day, TechCrunch reported that users were very disappointed with Gemini Pro’s performance on Bard.
ArsTechnica‘s tests showed that Google’s AI system improved in the eight months but “ChatGPT is still the winner”.
.
That demo was incredibly edited to suggest that Gemini is far more capable that it is.
You’ve been deceived, Chris. And shame on them for so doing.
— Grady Booch (@Grady_Booch) December 7, 2023
