LLM Chat

Chatbot

Click Playground in the left navigation bar to open the chatbot.

Once on the chatbot page, the button changes to New Chat. Click it at any time to start a fresh conversation.

The chatbot is a Large Language Model (LLM) interface. When using QAnswer's own LLM, all queries are handled securely and your data remains private.

• By default, the chatbot has no access to documents from your AI Assistants.
• Select a different LLM by clicking the model name in the bottom-right corner of the input field.

Initial ChatSecure LLMPublic LLMPublic Chat

Ask a question

Ask questions on any topic.

QuestionAnswerEdit QuestionConversation HistoryConversation Actions

• Regenerate a response by clicking Re-Generate.
• Edit a question by hovering over it and clicking .
• The left panel lists all previous conversations.

Access conversation actions via next to the conversation title:

• Rename — click .
• Share — click .
• Delete — click .

Chatbot options

The input toolbar provides the following actions:

• Add Connectors — attach documents to the current conversation
• Upload Images
• Options — toggle Web Search and Incognito mode
• Actions — open the MCP tools list

Incognito mode disables conversation history for the session.

ConnectorsImagesOptionsActionsWeb Search

Enable Web Search in Options, then include a web-search phrase in your prompt, e.g. "Search on the web for …"

AI Assistant

• Select an AI Assistant from the New Chat screen to direct your question to it.
• Alternatively, type @ followed by the assistant's name directly in the input field.
• Remove the tag by clicking X next to the assistant name in the input.
• Rate an AI Assistant response using or next to the response.

Select AI AssistantQuestionAnswer@AI AssistantFeedback

Share Conversation

Sharing

Click in the actions menu next to the conversation title.

• Select the sharing type from the available tabs.
• Link sharing lets you control whether the link is accessible to all logged-in users or restricted.
• Share directly with individual users, teams, or your organization (administrator rights required for teams and organizations).
• Search for users, teams, or organizations by name.
• Set the access level to Read only or Read and Write.
• Confirm by clicking .
• Change an existing access level from its dropdown.
• Revoke access by clicking .

Share settingsAuthorizationsShared

Receiving

• To unsubscribe from a shared conversation, click and confirm.
• Read only — the recipient can view the conversation but cannot send messages.
• Read and Write — the recipient can send messages and add data sources.
• Use only (chatbot) is equivalent to Read and Write; the distinction applies to shared AI Assistants.

ResultRead OnlyRead WriteConversation Unsubscribe

RAG Mode

When a document exceeds the LLM's context window, the chatbot switches to RAG (Retrieval-Augmented Generation) mode, retrieving only the most relevant excerpts to answer your question.

RAG modeModal Text

Why RAG Mode?

Your chatbot is currently using RAG (Retrieval-Augmented Generation) mode because your data doesn't fit entirely within the LLM's context window.

What does this mean?

In RAG mode, the system retrieves the most relevant document chunks to answer each query. The LLM does not have access to the full dataset simultaneously.

How to fix this:

• Change the LLM to one with a larger context window
• Reduce your dataset size by removing unnecessary documents

RAG mode is not a limitation - it's a powerful technique used by most production AI systems. However, upgrading to a larger context LLM can improve responses for questions requiring broader context.