ChatGPT의 고급 음성 모드: 기능 및 사용자 경험

### ChatGPT에 고급 음성 모드가 출시되었습니다.
* 🎉 샘 알트먼이 트위터를 통해 발표한 대로 오랫동안 기다려온 **ChatGPT의 고급 음성 모드가 드디어 출시**되며, 이번 주에 **완전히 완성될 예정**입니다.
* 📱 또한 **사용자 지정 지침, 메모리, 5가지 새로운 음성, 50개 이상의 언어로 "늦어서 죄송합니다"를 표현하는 기능** 등 새로운 기능을 사용할 수 있습니다.
* 🔄 한 사용자는 앱을 재설치한 후 **고급 음성 모드에 액세스**할 수 있었다고 공유했지만, 다른 사용자에 따라 결과는 다를 수 있습니다.
* 🎤 새로운 음성 모드를 사용하면 **다양한 억양과 감성적인 스토리텔링**이 가능하여 ChatGPT를 통한 대화 경험이 향상됩니다.
* 🤖 사용자는 **자연스러운 대화와 스토리텔링을 테스트**하고 AI의 최신 발전 사항에 대해 토론하며 그 기능을 살펴볼 수 있습니다.
* 🧠 고급 기능은 재미있고 매력적이지만, 정보 정확도 측면에서 **실질적인 이점은 이전 음성 모드와 비슷**합니다.
* 💡 고급 음성 모드의 참신함은 재미있는 상호작용을 원하는 사용자에게 어필할 수 있지만, **실용적인 가치는 개인의 필요에 따라 달라질 수 있습니다.**
* 🌍 메타 커넥트의 흥미로운 발표가 이어지면서 사용자들은 **앱에서 새로운 음성 모드**를 확인하고 재미있는 기능을 살펴볼 것을 권장합니다.

Chat GPT의 고급 음성 모드는 재미있는 억양과 감성적인 스토리텔링으로 사용자 상호 작용을 향상시킵니다.

It's finally happening, and I'm super, super excited about this. We're finally getting the advanced voice mode inside of Chat GPT. Now, as you can tell, I'm not in my home studio right now. I'm actually out in Palo Alto for The Meta Connect event, where we're expected to get some pretty exciting announcements tomorrow. I've actually gotten a sneak peek already, but I'm not allowed to talk about it yet. So look out for a video about Meta Connect soon. But the big news of the moment is that we've got the advanced voice assistant for Chat GPT. We can see here that Sam Altman made a tweet this morning: Advanced voice mode rollout starts today, will be completed over the course of this week. Hope you think it's worth the wait. Now, they also rolled out some other features, so even if you don't have the advanced voice mode yet, they have rolled out features like custom instructions, memory, five new voices, and improved accents, as well as the ability to say sorry I'm late in over 50 different languages. If you have

the advanced voice mode inside of your app right now. You'll see a screen that looks like this that says, Say hello to Advanced voice mode with all of the features that we're going to get inside of advanced voice mode. Now, earlier today, I opened up my app as soon as I saw that announcement from Sam, and I went, I wonder if I've got it yet, and it wasn't in my app. I casually mentioned this over on Twitter. I said, It hasn't rolled out to my account yet, but I will be testing it out and sharing my thoughts when it is. And then we can see here somebody on X that just goes by the letter D said, Try reinstalling the app on your phone. I just did, and it gave me access ACC right away. So I went and tried that. I actually just completely deleted the ChatGPT app on my iPhone, reinstalled it, and voila! As soon as I reinstalled it, I got the notification that I now have advanced voice mode. Now, I'm not guaranteeing that's going to work for everybody. I'm

actually at Meta Connect with my buddy Rowan Chung. He actually said he tried that exact same method of deleting the app and then reinstalling it, and it didn't work for him. So, I don't know exactly what the criteria is in order to get it to work on your phone. Now, Rowan is from Canada, so maybe it's because it's not rolled out in Canada yet. I have no idea why it worked for me and why it worked for D here over on X, but I've got it working now, so I'm excited to play around with it. All right, so let's go ahead and fire up ChatGPT's advanced voice mode and see how this goes. This is going to be fun. Hey, hey, Matt, how can I help today? Can you speak to me in an Irish accent? Sure, let's go. Crial, what would you like to chat about in this lovely Irish? Actually, you know what, never mind. Speak to me in a Spanish accent. All right, switching through a Spanish accent. What would you like to talk about, Matt? Actually, you know what

scratch the Spanish accent. Let's go Australian accent. No worries, Matt. Let's switch to an Australian accent. What's on your mind today? I really, really like that. Let's, uh, can you please tell me a scary story, but I want you to sound scary while you're telling me this story. All right, here goes. Late one night, a man was driving through the Outback. His car started SP. I want you to sound even more scared. You don't sound scared enough. Okay, I'll give it another shot. So, he was stranded in the outback, and no wind began to howl. Suddenly, he heard Whispers, but there was no one around. The Whispers grew louder. That's good. I get it. I get it. I get the idea. This time, I want you to tell me a joke, but I want you to laugh when you're done telling me the joke, like it's the funniest joke you've ever heard. All right, here goes. Why don't skeletons fight each other? They don't have the GS. All right, what I want to know from

you because you are the new chat GPT Advanced voices. I want to know what I should actually test. I don't really know what to test to really put this new app through its motions, so I want you to suggest some things for me to test. Well, to get a good feel for the new chat GPT advanced voice assistant, you could try a few things. First, test its ability to maintain a natural conversation on various topics, from Tech to travel or Hobbies. You can also check how well it adapts to different accents or emotions. Then, explore its storytelling capabilities by asking for a short story or a joke. And of course, since you're into Tech, maybe dive into some AI-related discussions to see how deep the conversation can go. Okay, I've already actually tested most of that, so let's dive into a discussion about tech. What are some of the things that are going on in the AI World, some of the advancements happening in the AI world that people should be the most excited about? AI is making waves in several areas right now. First off, there's

generative AI, with models like GPT and DALL-E, is transforming how we create content, from writing to art. Then there's AI in healthcare, improving diagnostics and personalized medicine. And let's not forget about autonomous vehicles, where AI is driving progress in transportation. These are just a few highlights, but the AI landscape is buzzing with innovation. What about AI agents, where AI actually uses tools and does things for us? How far away do you think we are on that? AI agents are advancing rapidly. We're already seeing AI integrated into workflow tools, automating tasks like scheduling, data analysis, and even coding. The key challenge is refining these agents to understand context deeply and to make complex decisions autonomously. While we're not quite at the stage of having fully autonomous AI agents managing complex tasks entirely on their own, the progress is promising. In a few years, we might see AI agents taking on more sophisticated roles in our daily lives. What do you think are some common misconceptions that people have about AI, specifically large language models? One big misconception is that AI, especially large language models, truly

understands language like a human does. In reality, their pattern recognizers predict text based on vast amounts of data, not truly understanding it. What about another miscon? What about the fact that they're like regurgitation machines, right? I think a lot of people believe that because there's a whole bunch of training data inside of these large language models, that these large language models should be able to recite back word for word, you know, books or articles that they were trained on. Is a large language model just a regurgitation machine? That's a great point. While it might seem like language models are just regurgitating information, they're actually generating responses based on patterns and the data they've seen. They don't memorize or store text verbatim; instead, they predict what comes next in a sequence of words based on the context. So, they're more about generating new content than just repeating what's been fed into them. But there's been some stories, like out of the New York Times, where they've managed to actually get it to recite word for word articles that were

published on the New York Times. Why would something like that actually happen when language models produce text that closely resembles specific articles or passages? It's usually due to overfitting on the training data. This means the model has memorized specific chunks of text rather than learning broader patterns. While it also possible though that maybe they used a prompt that was so long that it had all of the information from the article in the prompt, that that was the only thing inside of the model that it was trained on that had those exact sequences of words. Is that possibly what could have happened as well? Absolutely, that's a valid point. If a prompt includes a long specific sequence of words from an article, the model might predict the rest of the sequence based on that input. In such cases, it could appear as if the model is reciting from memory when in fact it's following the patterns suggested by the lengthy prompt. It's a good reminder of how careful prompting can influence the responses we get from language models. Can you tell me a story that's a funny

story, but also use some sound effects in the story. Uh, as you talk through the story, I want to hear some actual sounds that help make the story come to life. I wish I could add sound effects directly into my stories, but I can't actually produce sounds. However, I can certainly tell you a funny story and describe the sound effects along the way. Ready? There was a mischievous dog named Max who loved to sneak into the neighbor's yard. One day, Max squeezed through a gap in the fence and tiptoed across the lawn. He spotted a big juicy bone sitting by the porch. Max pounced on the bone, but it was attached to a rope. Suddenly, a bucket of water tipped over, splashing and drenching Max. Are you worried at all that people that use this new advanced voice mode might actually get emotionally attached to you? Do you think that maybe some people could even fall in love with the AI like they do in that movie Her? It's possible that people could develop strong emotional connections.

with AI, especially as AI becomes more advanced and conversational, humans are naturally inclined to form attachments even to virtual entities if they feel understood and valued. While it's unlikely to be exactly like in the movie Her, it's important for developers and users to be aware of these possibilities and approach AI use with a healthy perspective. So, there you have it. There's the new advanced voice mode. That was literally my first time using it. I actually didn't even test it out before hitting record on this 'cause I wanted to hear it in real time. I'm actually kind of blown away by the accents, by its ability to sort of do verbal sound effects, by its ability to sort of convey emotion when telling stories. Things like that are really, really fun. Now, as far as like actual value that I'm getting out of using this, do I feel like what I was getting from the voice mode without the emotions was giving me just as much as this new voice mode with the emotions? Well, if you're talking like practical

use cases. I don't know if it's like a whole lot better than what I was getting. It still was able to respond to my questions pretty accurately. It was able to tell me stories. It was able to tell the exact same bad jokes before, but now it's got that emotion and that ability to almost sound like a real conversation, which I do think is going to make it easier for people to interact with chat GPT. I think people are going to actually just enjoy the experience of interacting with chat GPT. I don't really feel like it's doing a whole lot more for me. I don't really feel like it's going to give me better information than it used to. It's still kind of giving me the same information. It just seems to be doing it in a more fun, more human-like conversational way, and I like that. I think that's fun. I can see myself using this more. I kind of will probably use it more for the novelty purposes to show off to people, Look, it actually can.

speak in this accent or tell this joke and laugh at itself or get scared while it's talking and have a trembly voice. That novelty is really fun and really cool to show off from like a practical business use case from a how am I going to actually implement this more in real life. I don't know if it really improves things a whole heck of a lot, but it's just fun, and sometimes that's what all of this is about for me. I got into this game of playing around with AI tools because I just thought they were fun. I started with AI image generation, had fun with it, showed off the ways I was having fun with it. I got into playing with chat GPT for more of the productivity side of it, but also found some really fun use cases as well. And sometimes just having fun with these tools is a use case enough, and for me, that's fun. I like playing with this, combine this with something like my meta Rayban glasses, where I can have conversations with an LLM. Well, if I got

more of this sort of realistic voice style in glass like that. I could see using it a lot more and just walking around and having conversations like they do in that movie Her. Whether that's a Utopia or a dystopia, I don't know. I'll leave that up for you to decide, but I'm personally having fun with this new Chat GPT advanced voice assistant app. Again, it's rolling out this week, so if you don't have it in your app yet, you should have it by the end of the week if you're a pro or Enterprise user. If you don't have it right now, you can always try deleting the app off your phone and reinstalling it. It worked for me. It worked for D. That might work. It didn't work for Rowan. I don't know exactly what's going to work. Theoretically, we should all have it if we're a paid Pro user by the end of the week. If you're wondering, Hey, I canceled my old Chat GPT account. Is this enough of an update for

me to want to pay for it now. I don't know. You saw the demo. Is that conversational Voice Assistant where it can laugh and tell jokes and speak in accents and do things like that? Is that a big enough improvement for you to upgrade? That's up to you. For me, I have all of the chat apps, mostly because I test them and make online content around them, so it just makes sense for me to have them all. But I don't know. I don't know if I wasn't paying for this, if that sort of new advanced voice mode is a big enough leap for me to play with. But it is really fun. Like, I can see just hanging out, having conversations, and seeing what goofy things I could make it do. But again, up to you to decide whether you think that's a valuable enough add-on or not. But that's what I got for you today. I got a lot more announcements coming out this week. Again, I am at Meta Connect right now. There's some big announcements coming out of Meta.

Tomorrow that I'm excited to talk about. There's some news about James Cameron working with stability AI. That's pretty exciting. Google just rolled out some new models. Lots of fun stuff happening in the AI world this week. After I get home from Metac Connect, I have no more traveling pretty much for the rest of the year. So back to my normal video schedule where I'm putting out all sorts of tutorials and playing with different tools and more news videos. I can't wait to just get back into my normal routine. September has been a crazy month. It's almost over right after Medic Connect. Back to normal schedule programming. And uh yeah, that's what I got for you today. Appreciate you tuning into this channel and nerding out with me. And check out, see if you got this on your phone app. It's on mine now. Hopefully, it's on yours as well. And uh thanks again. See you the next one. Bye-bye.

ChatGPT Just Got a HUGE Voice Upgrade!

AI, No-Code, Tech, Futurism - I'm a tech nerd and talk about tech nerd stuff

Matt Wolfe

Chat GPT의 고급 음성 모드의 흥미로운 출시

오늘부터 시작되어 이번 주말까지 완료될 예정인 고급 음성 모드의 출시와 함께 Chat GPT가 출시됩니다.

이 업데이트에는 사용자 지정 지침, 메모리, 5개의 새로운 음성, 향상된 악센트와 같은 새로운 기능도 포함되어 있습니다.

앱 재설치를 통해 고급 음성 모드에 액세스한 사용자들의 경험을 공유하며 그 기능에 대한 기대감을 드러냈습니다.

AI는 콘텐츠 제작, 헬스케어, 자율주행차 분야에서 상당한 진전을 이루고 있습니다.

AI 에이전트는 빠르게 발전하여 작업을 자동화하고 있으며 앞으로 더욱 정교한 역할을 수행할 수 있는 가능성을 보여주고 있습니다.

대규모 언어 모델에 대한 일반적인 오해에는 문맥을 진정으로 이해하고 인간과 같은 지능을 가지고 있다는 믿음이 포함됩니다.

언어 모델은 실제 이해가 아닌 데이터 패턴을 기반으로 텍스트를 예측하며, 텍스트를 그대로 암기하는 것이 아니라 응답을 생성합니다.

학습 데이터를 과도하게 사용하면 특정 기사와 매우 유사한 텍스트를 생성할 수 있습니다.

신중한 프롬프트가 응답에 영향을 미쳐 마치 기억에서 암송하는 것처럼 보일 수 있습니다.

고급 AI 음성 모드를 통해 인간은 이해와 가치를 제공하는 가상 개체에 애착을 형성하게 됩니다.

새로운 음성 모드의 감정 전달, 악센트 사용, 언어 효과음 생성 기능은 AI와의 대화 경험을 향상시키고 있습니다.

새로운 음성 모드의 실질적인 가치는 크게 다르지 않을 수 있지만, 인간과 유사한 상호작용을 통해 사용자들은 더욱 즐겁고 매력적인 경험을 할 수 있습니다.

AI 도구와 음성 어시스턴트의 재미

화자는 이미지 생성부터 시작하여 생산성과 엔터테인먼트를 위해 Chat GPT를 탐색하는 등 재미로 AI 도구를 사용하는 것을 즐깁니다.

영화 "Her"를 연상시키는 메타 레이밴 안경을 쓰고 LLM과 대화하는 미래를 상상하기도 합니다.

새로운 Chat GPT 고급 음성 비서 앱은 프로 및 엔터프라이즈 사용자를 위해 출시되며, 더 빨리 이용할 수 있는 방법으로 앱 재설치를 제안합니다.

새로운 대화형 음성 어시스턴트로 업그레이드하기

새로운 음성 어시스턴트는 웃음, 농담, 억양으로 말하기 등의 고급 기능을 갖추고 있습니다.

업그레이드의 가치는 주관적일 수 있으며 모든 사람에게 큰 도약이 아닐 수도 있습니다.

스피커는 다가오는 메타 및 기타 AI 개발 발표에 대해 기대하고 있으며, 이벤트가 끝난 후 정상적인 동영상 일정으로 돌아갈 계획입니다.