Customer Service Chatbot
Build a customer service chatbot that answers questions about your product and embed it into any website.
Step 1 - Load Data into a Knowledge Table
Create a Knowledge Table:
Go to >> Project >> Knowledge Table.
Create a New Knowledge Table with your desired Table ID (table name) and pick a Text Embedding Model.
Upload Documentation:
Open the table that you have just created.
Upload your files to fill up the Knowledge Table. JamAI Base will process your files into Knowledge Rows which you can quickly search up later.
Step 2 - Create and Configure an LLM Agent
Create an LLM Agent:
Go to >> Chat Table >> Agents >> New Agent.
Add and configure your LLM Agent with the following parameters:
Agent ID: Name of your agent.
Models: LLM Model.
Temperature: Set as needed.
Max tokens: Set as needed.
Top-p: Set as needed.
Customize system prompt (optional): Define the behavior of your LLM Agent.
User message (optional): Set a first reply to your LLM Agent.
AI response (optional): Conversational opener by your LLM Agent.
Step 3 - Configure the LLM Agent to Use RAG (Retrieval-Augmented Generation)
Select the LLM Agent:
Click on the LLM Agent to bring up the Table View.
Update Configuration:
In Table View, click on the more icon of the AI (output column) and open settings.
Configure the following settings:
k: The number of maximum Knowledge Rows that can be fetched as references during RAG.
Reranking Model: Rerank the Knowledge Rows retrieved before passing them into the LLM Agent.
Knowledge Table: The table to search for Knowledge Rows as references.
Step 4 - Create a New Conversation
Start a New Conversation:
Select the LLM Agent that you have created and create a new conversation.
You will be brought to the Chat Table interface.
Toggle Between Modes:
Toggle between Conversation Mode and Table Mode using the toggle bar on the top right of the interface.
Start Chatting:
Begin interacting with your LLM Agent.
Step 5 - Deploy the Chatbot
Run the Chatbot:
You can run the chatbot within the Chat Table interface.
Embed the Chatbot:
To embed the chatbot into your website, you can generate an API call and use the LLM in your website.
Advanced Usage: Enrich Knowledge Rows
Add Output Column:
After creating a new Knowledge Table, add a new Output Column (>> Action >> Add output column).
Setup Knowledge LLM Agent:
Configure the LLM Agent to further process the text content to enrich your Knowledge Row using the following template:
Column ID: The title of the column.
Data Type: str.
Models: The LLM models.
Temperature: 0.1.
Max Tokens: 512.
Top-p: 1.0.
Customize prompt: Prompt to process the Input columns.
Start Using the Knowledge Table:
See the LLM agent magically process your Knowledge Row when you upload files to the Knowledge Table.
By following these steps, you can create a customer service chatbot using JamAIBase that leverages your documentation to answer user questions effectively.
Last updated