Have you ever wondered about using AI without needing an internet connection?
Imagine being able to find lost files or have a PDF document summarised, or even transcribe a video, all without the internet.
Well, this concept is now a reality with a new software called ‘Chat with RTX,’ developed by Nvidia.
This software is designed to run on personal computers and utilises Nvidia's powerful GeForce RTX GPUs to process natural language in real-time, without the need for an internet connection.
‘Chat with RTX’ installs a local Python server and a user-friendly web interface to handle queries.
Once installed, users can input various types of files, such as YouTube video URLs or personal documents, for the chatbot to analyse.
It can search for keywords in transcripts, summarise videos or texts, and perform other tasks.
The name ‘Chat with RTX’ hints at its reliance on the tensor cores found in GeForce RTX 30 and 40 series graphics cards.
This AI model, powered by Llama 2, operates locally, making it faster and more efficient.
It functions like a personal assistant residing within your computer, ensuring that your data remains private and secure.
In testing, ‘Chat with RTX’ has shown its ability to handle various file formats, including .txt, .pdf, and .doc.
Overall, ‘Chat with RTX’ offers a glimpse into the future of AI-powered computing, providing users with powerful capabilities directly on their personal computers.