Watch the Nvidia AI NPC Demo and imagine you're actually talking to AI game characters.
I hope it looks this good when the game and AI are completely intertwined.
At Computex 2023 in Taipei, Nvidia CEO Jensen Huang gave the world a glimpse of what it could be like when gaming and artificial intelligence collide, with a graphically breathtaking display of a cyberpunk ramen shop where you can actually talk to the owner.
Seriously, he imagines that instead of clicking through the dialogue options, you can press and hold a button, say something with your own voice, and get a response from a video game character. Nvidia calls it "a glimpse into the future of games."
Unfortunately, the actual dialogue leaves much to be desired.
Here is the full transcript of the speech:
Player: Hey Jin, how are you?
Jin: Unfortunately not that good.
How come?
I'm worried about the crimes here. It's gotten worse lately. My ramen shop has come under the crossfire.
Can I help?
If you want to do something about it, I've heard rumors that the powerful crime lord Kumon Aoki is causing all kinds of chaos in the city. He may be the source of this violence.
I will talk to him, where can I find him?
I heard you hang out at underground fight clubs on the east side of town. Try there.
Okay. I'm going.
Be careful, Kai.
When watching a single video of a single conversation, it's hard to see how this is better than choosing from an NPC dialogue tree - but the impressive part is the generative AI's response to natural speech. I hope Nvidia releases the demo so we can try it ourselves and get completely different results.
The demo includes the tools used by Nvidia and its partner Convai to create the demo, specifically for Games that can run both locally and in the cloud. Nvidia ACE (Avatar Cloud Engine)It was created to help promote a middleware package called . The entire ACE suite includes the company's NeMo tools for deploying large language models (LLMs), such as Riva speech-to-text and text-to-speech.
You may be interested in: Elon Musk Founds An Artificial Intelligence Company Called X.AI
The demo uses more of these, of course – it's built in Unreal Engine 5 with a lot of ray tracing… and it's so visually stunning that the chatbot part feels lackluster compared to me. At this point, we've seen conversations that are much more engaging than chatbots, no matter how stereotypical and derivative they are sometimes.
At the Computex preliminary briefing, Nvidia GeForce Platform VP Jason Paul said that yes, the technology could scale to multiple characters at once, and theoretically even let NPCs talk to each other - but admitted that he hadn't seen it tested.
It's unclear whether any developer will adopt the entire ACE toolkit as the demo attempts, but STALKER 2 Heart of Chernobyl and Fort Solis will use the part Nvidia calls "Omniverse Audio2Face", which attempts to match the animation of a 3D character's face with the voice actor's speech.
What do you think about this subject? Do not forget to share your thoughts with us in the comments section. For all our content The Gamer Station All Contents
The products discussed here have been independently selected by our editors. If you purchase something featured on our site, The Gamer Station may receive a share of the revenue.
The original language of the articles is Turkish. We broadcast in 18 different languages. If you see a wrong sentence or word in the content, please feel free to inform us in the comments!