NVIDIA Launches ACE Digital Human Technology At COMPUTEX 2024

Illustration of digital human avatars. (PHOTO: X @mhdempsey

JAKARTA In a series of 2024 COMPUTEX events, NVIDIA announced the launch of their latest digital human technology, NVIDIA ACE (Avatar Creation Engine). This technology allows the creation of interactive digital humans that can be used in various applications such as gaming, customer service, and virtual assistants.

NVIDIA introduced its first PC-based NVIDIA NIMTM microinference service that supports ACE technology. With NIM (NVIDIA Inference Microservices), developers can create digital humans that can operate efficiently on RTX AI-based PC devices. This technology offers understanding of natural language, speech synthesis, and realistic facial animation, so that interactions with digital humans feel more natural and responsive.

NIM PC ACE Main Feature:

Natural Language Understanding - NLU understanding: This technology allows digital humans to understand and process text or voice input from users contextually, using advanced machine learning models trained on various language data.

Synthesis of Speech (Speech Synthesis): Digital humans can respond with sounds that sound natural, thanks to advanced speech synthesis technology. This ensures more realistic and humane interactions.

Face Animation (Facial Animation): With realistic facial animation, digital humans can express their emotions and reactions that match the conversation, increasing the user's interaction experience.

Local and Efficient Inference: NIM allows all AI processes to run locally on PC devices, reduce latency and improve user privacy.

The use of Micro Service (Microservices): Modular and efficient microservices allow developers to easily integrate various AI components. This includes functions such as natural language processing, greeting synthesis, and facial animation.

Collaboration with Developing Platform: NVIDIA in collaboration with various platforms and developer tools to facilitate the application of ACE technology, including integration with Inworld AI and tools such as NVIDIA Audio2Face and NVIDIA Riva.

Technology Demo at COMPUTEX:

At this event, NVIDIA displayed ACE's digital human technology demo in the form of a game demonstration developed with Inworld AI. The demonstration demonstrates NVIDIA Audio2Face's ability for facial animation and NVIDIA Riva for automatic voice recognition, all running locally on PC devices.

This launch marks a major step in the development of digital humans that are more sophisticated and easily accessible to various applications. With NVIDIA ACE and NIM microservices, developers can create a more in-depth and realistic digital interaction experience.