Short answer: Jordan Metzner says his Mirror Mirror on the Wall app uses real-time speech to text, sends it to Gemini, then reads the reply with text to speech. It was slow and named Microsoft instead of Nvidia as the most valuable company.
Watch this answer from Episode 19 (starts at 2:35) · Episode 19 notes and transcript
From Episode 19: Mirror, Mirror on the Wall… Who Built the Smartest AI of All?, starting at 2:35.
Jordan Metzner [2:35]: Okay. Cool. So this is built using Google's new AI build studio and we'll talk about that just a little bit more. But let me jump into the mirror on the wall. Let's see how this goes. So I'm going to make my chat bar a little smaller here and allow my camera. There we go. Okay. Cool. Alright. Mirror on the wall. Who is the smartest of them all? Okay. So there's my mirror on the wall. You can see every time I say something, it's kinda pulling in my words in real time. But let me just refresh so we can do another query. Maybe we can ask it something that Mirror on the wall, who is the most valuable company on the stock market today? Okay. So it didn't get it right. It said it was Microsoft here. It looks like it says that it's Microsoft instead of Nvidia. But, and it's a little slow and laggy. But you can imagine this inside like a little mirror. All of this is powered by Gemini. It's using real time speech to text and then sending it out to Gemini and then Gemini is replying and then it's doing some text to speech as well. What do you think of my spooky mirror?
Sam Nadler [4:35]: I think it's cute. I know you live on a street where there's a lot of Halloween activity. I'm curious if you could set up a little webcam and a monitor and a microphone and have some kids do some mirror, interactions with this product. But, yeah, it's a fun, quick build.
Jordan Metzner [4:59]: That sounds like a cool idea. I don't know, like, I gotta think about it a little bit, but I guess you're right. It sounds pretty feasible, so I'm trying to think, like, a monitor, a camera, and some speakers maybe, and we could pull it off. Yeah.
