Nvidia's ChatRTX Chatbot Gets an Upgrade: Supports Google Gemma, ChatGLM3, and OpenAI CLIP for Local Data Interaction with Voice Commands

Mountain View, California United States of America
ChatRTX uses RAG technology, TensorRT-LLM software, and RTX acceleration for quick responses based on user queries.
Google Gemma is an open local language model. ChatGLM3 is an open bilingual large language model. OpenAI CLIP recognizes visual concepts from natural language supervision.
Nvidia's ChatRTX chatbot supports Google Gemma, ChatGLM3, and OpenAI CLIP models for local data interaction with voice commands.
The chatbot runs locally on a Windows PC or workstation for data privacy and security.
Nvidia's ChatRTX Chatbot Gets an Upgrade: Supports Google Gemma, ChatGLM3, and OpenAI CLIP for Local Data Interaction with Voice Commands

Nvidia's ChatRTX chatbot, an RTX-accelerated app that lets users interact with their local data, has received a significant update. The new version of the chatbot supports Google's Gemma and ChatGLM3 models, as well as OpenAI's CLIP model for image recognition. Users can now search their local photo data using natural language queries and even interact with it using voice commands thanks to Whisper, an automatic speech recognition system.

ChatRTX uses retrieval-augmented generation (RAG) technology, NVIDIA TensorRT-LLM software, and NVIDIA RTX acceleration to provide quick responses based on the user's queries. The chatbot runs locally on a Windows PC or workstation, ensuring data privacy and security.

Google's Gemma model is an open local language model that was developed using the same research and technology as Google's Gemini models. ChatGLM3 is an open bilingual (English and Chinese) large language model based on the general language model framework. OpenAI's CLIP neural network recognizes visual concepts from natural language supervision, enabling users to interact with their images using words, terms, and phrases.

The update also includes support for voice queries in multiple languages and the ability to output responses in different languages. Users can now search their local directories for text files or documents and use ChatRTX to find relevant information quickly. The chatbot's new capabilities make it an even more powerful tool for interacting with local data, expanding its potential applications beyond just text-based queries.



Confidence

100%

No Doubts Found At Time Of Publication

Sources

100%

  • Unique Points
    • Nvidia is updating its ChatRTX chatbot with more AI models for RTX GPU owners.
    • ChatRTX can now use Google’s Gemma, ChatGLM3, and OpenAI’s CLIP model.
    • Google’s Gemma model was designed to run directly on powerful laptops or desktop PCs.
    • Nvidia’s app takes some complexity away of running these models locally.
  • Accuracy
    No Contradictions at Time Of Publication
  • Deception (100%)
    None Found At Time Of Publication
  • Fallacies (100%)
    None Found At Time Of Publication
  • Bias (100%)
    None Found At Time Of Publication
  • Site Conflicts Of Interest (100%)
    None Found At Time Of Publication
  • Author Conflicts Of Interest (100%)
    None Found At Time Of Publication

98%

  • Unique Points
    • Nvidia has released an update for ChatRTX AI chat.
    • The update expands ChatRTX’s capabilities and supports additional LLMs, including Gemma and ChatGLM3.
  • Accuracy
    No Contradictions at Time Of Publication
  • Deception (100%)
    None Found At Time Of Publication
  • Fallacies (100%)
    None Found At Time Of Publication
  • Bias (100%)
    None Found At Time Of Publication
  • Site Conflicts Of Interest (100%)
    None Found At Time Of Publication
  • Author Conflicts Of Interest (100%)
    None Found At Time Of Publication

98%

  • Unique Points
    • ChatRTX now supports voice recognition for prompts in multiple languages and the ability to output in different languages
    • ChatRTX has a feature to search images in local directories, powered by CLIP (Contrastive Language-Image Pre-training)
  • Accuracy
    • ChatRTX is the new app, while 'Chart with RTX' was just a pre-launch tech demo
    • ChatRTX can scan and analyze data in local directories (text files, documents)
    • ChatRTX supports new LLMs like Mistral 7B INT4 or Llama 2 7B INT4
  • Deception (100%)
    None Found At Time Of Publication
  • Fallacies (100%)
    None Found At Time Of Publication
  • Bias (100%)
    None Found At Time Of Publication
  • Site Conflicts Of Interest (100%)
    None Found At Time Of Publication
  • Author Conflicts Of Interest (0%)
    None Found At Time Of Publication

98%

  • Unique Points
    • ChatRTX is an RTX-accelerated chatbot app that lets users interact with their local data.
    • ChatRTX uses retrieval-augmented generation, NVIDIA TensorRT-LLM software and NVIDIA RTX acceleration.
    • New LLMs supported include Gemma and ChatGLM3.
    • ChatRTX now supports interaction with image data using Contrastive Language-Image Pre-training from OpenAI.
    • Users can chat with their data using their voice thanks to support for Whisper, an automatic speech recognition system.
  • Accuracy
    • ChatRTX can now use Google’s Gemma, ChatGLM3, and OpenAI’s CLIP model.
    • Nvidia is updating ChatRTX to support voice queries using Whisper, an AI speech recognition system.
  • Deception (100%)
    None Found At Time Of Publication
  • Fallacies (95%)
    The article by Jesse Clayton contains some inflammatory rhetoric and an appeal to authority but no formal or blatant logical fallacies. The author uses phrases like 'transforming computing', 'expands the power of this RTX-accelerated chatbot app', and 'gives NVIDIA GeForce RTX gamers an even better experience' which can be considered inflammatory rhetoric as they are subjective statements that may not be objectively true for all users. The author also mentions 'Google' and 'OpenAI' in the context of new models, implying their credibility and expertise, which is an appeal to authority.
    • ]Editor's note: This post is part of the AI Decoded series, which demystifies AI by making the technology more accessible[...] Chatbots powered by large-language AI models have transformed computing[...] Now, they can use DLSS 3.5 with Ray Reconstruction in their projects with just a few clicks[...] Make sense of what’s new and what’s next by subscribing to the AI Decoded newsletter.[]
    • [The latest version adds support for additional LLMs, including Gemma, the latest open, local LLM trained by Google.][
    • [ChatRTX also now supports ChatGLM3, an open, bilingual (English and Chinese) LLM based on the general language model framework.][
    • Thanks to support for Whisper, an automatic speech recognition system that uses AI to process spoken language[...] Learn more about the new RTX Remix beta update on the GeForce page.[
  • Bias (100%)
    None Found At Time Of Publication
  • Site Conflicts Of Interest (100%)
    None Found At Time Of Publication
  • Author Conflicts Of Interest (100%)
    None Found At Time Of Publication