NVIDIA Launches Chat With RTX, A Chatbot That Walks Locally On Your PC

NVIDIA's Chat with RTX display (photo: NVIDIA)

JAKARTA - Currently, artificial intelligence (AI)-based chatbots have been used by millions of people around the world, because of their ability to do or answer several things appropriately and quickly.

Some tech giants have even launched their own chatbots, such as Google, OpenAI, Microsoft, and even Meta. Now, it's NVIDIA's turn to introduce Chat with RTX.

Chat with RTX is a chatbot innovation supported by NVIDIA RTX for locally, quickly, and customized generative AI. This demo app will allow you to run private AI chatbots on your PC.

So, you can connect a local file on your PC as a dataset to a large open source language model like Llama 2, and then Chat with RTX will be able to provide a quick and relevant answer according to your question.

For example, if you give him a YouTube video and your own documents, Chat with RTX can create a summary or answer relevant questions based on the data.

This tool supports various file formats, including.txt,.pdf,.doc/.docx, and.xml. Direct the application to folders containing these files, and the tool will load them to the library in just seconds.

Chat with RTX allows users to integrate this knowledge into their chatbot for contextual questions. For example, asking for travel recommendations based on content from favorite influencer videos, or get a short tutorial and how based on the best educational resources," NVIDIA wrote in its announcement, quoted Thursday, February 15.

The big weakness of Chat with RTX is that this is still an initial developer demo. In fact, some people admit to failing to install this app.

In addition to the GPU GeForce RTX 30 Series or higher with a minimum VRAM of 8 GB, Chats with RTX require Windows 10 or 11, and the latest NVIDIA GPU drivers.