OpenAI Dev Day London: Highlights and Innovations Unveiled

OpenAI's 01 showcased impressive capabilities, including building applications and dynamic interactions in real-time during Dev Day London.

### OpenAI Dev Day London: Highlights and Innovations Featuring 01
* 🚀 OpenAI Dev Day in London showcased **01 as the standout feature**, demonstrating its capabilities through **impressive live demos**.
* 🤖 The team presented a full-stack application that allowed 01 to control a drone, successfully **starting the video stream** and **executing commands seamlessly**.
* 📧 A notable sponsorship from AI Port and Turing Post highlighted research on AI models reflecting **societal stereotypes**, particularly in how they visualize **different generations**.
* 🌍 Another demo illustrated 01 using voice to assist users with travel planning, including **hotel bookings and food orders**, showcasing its **real-time API capabilities**.
* 📞 The integration of voice interaction with the real-time API allowed for **complex tasks**, such as **placing a large order for pies** through a phone call, demonstrating the **practical applications of AI in daily life**.
* 📊 The presentation also featured an interactive learning segment about planets, emphasizing how **01 can provide dynamic, real-time educational content**.
* 🎤 Additional announcements included **new expressive voices** for speech-to-speech experiences and **significant discounts** on text and audio input costs, enhancing **accessibility for developers**.
* 🔜 OpenAI plans to release the full version of 01 soon, while the audience at Dev Day received **exclusive access to the 01 preview**, marking a **significant step in AI development**.

open AI Dev day in London just happened, and 01 was the star of the show. We have some incredible demos to go over today. Let's get right into it. First, the open AI team is going to show off 01 building a full-stack application to control a drone. It is so cool. Check this out. I'll it down right there, and I will go back to the terminal to start the server we just created. Now let's take a look at the running good news. F the battery l, so that's a good sign. I'm trying to start the video stream to see that was up. Great, so now the real test. Take off and see what happens. All right, that worked. So let's see if the buttons work. The events were wired up correctly. I guess the good sign later. Awesome. And also I had surprising but so let's see what deci with this absolutely incredible. Let's go on to the next one. Thanks to the sponsor of this video, AI port and Turing posts. These are great newsletters that cover everything in the world of AI. They break

down the latest AI news and breakthroughs in a really easy-to-read form. They just did a research project where they showed how our own stereotypes get reflected back to us with AI models. For example, they prompted a bunch of text-to-image generators: stable diffusion, mid-journey, Yandex art, and Ernie VG to visualize how different generations, so Gen X, Millennials, Gen Z, etc., might look, and the results were super interesting. Mid-journey seems to think baby boomers are kind of sad and nostalgic; other models show them living their best lives, so really, it just depends on which model you're using, and then that bias is reflected back to you, which if you watch this channel at all, you already know. A lot of models seem to struggle with Generation X, which is kind of weird, and they couldn't quite get a definition of what Generation X actually looks like. But this all just raises a ton of questions about how we're actually training these models, and these are the types of research reports that AI port.

and Turing Post cover. So check out these newsletters. I'll drop links to them in the description below. And thank you again to AI port and Turing post for sponsoring this video. Now back to the video. Next is an absolutely mind-blowing demo 01 using voice helps the person through the platform Wanderlust. Basically find travel plans, look for hotels, and then finally actually finds a bakery, calls the bakery, and puts in an order. It is mind-blowing. Let's watch voice. And so if I type in right here, let's say Lond. Here's London for you. So now, as you can tell, I added a few lines of code with the real-time API clients. So now I can have a conversation with my. So let's take a look. I'm planning my trip to London and Singapore. Let's say Singapore next week. Actually, Singapore is ready for your visit. Awesome. Uh, can you show me some places I could check out while I'm there? Here are some great spots in Singapore. Nice. Uh, I'm thinking I might need a hotel to stay around there. Can

you help me find some hotels in Singapore, nice. Can you show me more details about these three? Here are more details on the hotels. Great. Um, so two things to highlight here on the left as I'm having this conversation with Yak. You can tell the transcript is happening with all of the conversation, but on the right side, the coolest thing is that the real-time API has access to tools. So all of you can use it and call your own functions, your own APIs, your own tools. And in this case, I was able to kind of place pins on the map, annotate the map, zoom on it, fetch details from the internet, and even put some details from this, uh, on the screen. And so we really think you're going to love the real-time API. Your users are going to be delighted to have this new way to interact, whether they're driving, cooking, learning, maybe on the go, trying to be more productive. Um, and now let's try something a bit harder, though. So what if we were able to take this real-time API and the capability that it

has to connect to APIs tools, but let's go outside of just this voice interface. So, uh, what I'm going to do is I'm going to go back into the fun conversation and have another scenario. Let's go back to London now, please, and specifically around the brewery on Chiswell Street. We're back to the brewery on Chiswell Street. Sweet, uh, I have hundreds of developers, uh, here in the room. They might enjoy the little snack. Can you show me some, uh, pie shops around here? Maybe here is in P shops NE. Pretty cool, uh. Can you show me more details about these three things here? Are more details on the P shops? Great, so I'll pause right here. And, uh, now you might have noticed that the second one here is actually demo spot. It's not a real place. The other two are, uh, but what we're going to do now is that because this, uh, second one seems to accept AI orders, what if we were able to use in the context of this wonderless app not just the real-time API but also

toio phone calling capabilities to connect and place phone CES. So for that, I'm going to invite Elan from our developer experience to join me on stage. Thanks. I'm going to jump back into the conversation, and I'll ask one of the last to do some action for me that would leverage this capability of using real-time plus together. So let's check this out. Right, so I think Milan seemed very interesting. Could you please call them for me, and maybe you could see if they could get us, say, like 200 bu, maybe a mix of meat and veggie options, but please keep the budget under F. I'm calling Elan POS now to arrange your order. Hello. Hi, I'm calling onal of re. Yeah, this is ans. How can I help you? Great. I wanted to ask about the kinds of TI you. What do you have? Yeah, we have meat pies, we have veggie pies, we have apple pies, we have all kinds of pies. Perfect. How much would 100 weat

andaran that that's that's a lot of that'll come out to around I don't know 12200 lb. That's overall budget. I don't know if I go 800 but I'll meet you at 1,000 if you guys feature us at your event. All right, okay so 1,000 can uh yes he said 100 meat 100 vegetarian. I' for 100 weat and 100 vegetarian P. When can we expect the differ oh um where where are you located to the [Music] Brewer. Oh for sure we're actually right next door. Fantastic thank you. We look it'll be there like 43 seconds goodbye. Next you're going to see the power of the realtime API that is essentially advanced voice mode and the interaction between a human and whatever the human wants to learn and in this case planets and some information about the planets. Let's watch hey so can you tell me what is the biggest planet in the solar system. Absolutely the biggest planet in

our solar system is Jupiter. It's so massive it has more than twice the mass of all the other planets combined. Jupiter is the giant among giants. Okay, great, so real-time interaction works, and I think it's going to be a more fun way of learning, but let's see if we can make it a bit more interactive. Hey, I'm curious about Earth. Sure thing. Earth is the third planet from the Sun and the only one known to support life. It's packed with diverse ecosystems, abundant water, and a protective atmosphere that shields us from harmful solar radiation. Do you want to know more about Earth's characteristics? Well, I see that there's actually a lot of water there, so can you tell me how much land is there versus water? Absolutely. Approximately 71% of Earth's surface is covered by water, while the remaining 29% is land. Our Blue Marble truly lives up to its name. Let me show you this on a pie chart. Here's the breakdown of Earth's surface. Okay, great, thank you. I actually have a question about

the Mars now Mars the red planet. What would you like to know? So I heard there was a lot of volcano there. Can you tell me which one is the biggest? Absolutely. The biggest volcano on Mars and in the entire solar system is Olympus Mons. It's about 13.6 miles, nearly three times the height of Mount Everest. Would you like more information on Olympus Mons? Yeah, can you tell me like what are the three biggest volcanoes and show me their height? Certainly. The three biggest volcanoes on Mars are: one, Olympus Mons, 13.6 miles, 22 km high; two, Arsia Mons, about 11.3 miles, 18.1 km high; three, Ascraeus Mons, about 11.2 miles, 18 km high. Okay, great, thank you. How incredible was that? Keep in mind all of that is dynamically generated. That is not predefined anywhere, so it really shows the vision of what the future of education can be. Plus, OpenAI had a couple of other smaller announcements. Let's go over those now. You can now build speech-to-speech experiences with five

new voices, which are much more expressive and steerable, and they're lowering the price by using prompt caching. Cash text inputs are discounted 50%, and cashed audio inputs are discounted 80%. Huge discounts towards intelligence too cheap to meter, and everybody in the audience is getting access to 01 preview. Some thought it was the full 01 model, but Olivier Godman, who is the head of product for OpenAI, says, We're giving audience access to 01 preview. We're still working on the full 01 and plan to release it soon. And Jimmy Apple's, of course, right there to comment. Now it's a little weird because we've already had access to 01 preview, so maybe Europeans haven't had access to 01 preview yet. Maybe that's what's going on, but either way, very cool. So those are the major updates from Dev Day London. If you enjoyed this video, please consider giving a like and subscribe, and I'll see you in the next one.

o1 Insane LIVE Demos - o1 FULL Coming Soon! (OpenAI Dev Day London)

Artificial Intelligence (AI), Open Source, Generative Art, AI Art, Futurism, ChatGPT, Large Language Models (LLM), Machine Learning, Technology, Coding, Tutorials, AI News, and more

** Exclusive Pinecone Partner **

Matthew Berman

OpenAI's 01 was the star, showcasing a full-stack application to control a drone with impressive demos.

The video stream and button controls worked seamlessly during the drone's takeoff.

AI Port and Turing Posts, the event's sponsors, presented a research project on AI models reflecting stereotypes, with interesting results for different generations.

Mind-Blowing Demo of Voice-Activated Travel Planning

A demo showcases a voice-activated platform, Wanderlust, that helps users plan trips, find hotels, and even order from a bakery.

The real-time API client enables seamless conversation and interaction, offering tools like map annotation and internet detail fetching.

The demo highlights the potential of the real-time API to provide users with a new and productive way to interact while on the go.

Connecting APIs and Phone Calling for Real-Time Orders

The speaker is at the brewery on Chiswell Street in London, looking for pie shops nearby.

They notice one of the pie shops accepts AI orders and plan to use the app's real-time API and phone calling capabilities to place an order.

The speaker's colleague, Elan, is invited to join and make the call to arrange an order for 200 pies, mixing meat and veggie options while keeping the budget in mind.

The conversation involves a budget discussion for an event, with a commitment of $1,000 for 100 meat and 100 vegetarian options.

The real-time API demonstrates interactive learning, providing information about Jupiter as the biggest planet and Earth as the only planet known to support life.

The interaction also reveals that 71% of Earth's surface is covered by water, with a pie chart shown for visual representation.

Olympus Mons is the largest volcano on Mars and in the entire solar system, standing at 13.

1 km), followed closely by Ascraeus Mons at 11.

OpenAI also announced new expressive speech-to-speech voices, discounted text and audio inputs, and audience access to the 01 preview.