Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Chatbots & Messaging Bots

Chatbots & Messaging Bots

Chat with Mistral-7B Through Hugging Face

When a chat message is received, a basic LLM chain sends it to the open-source Mistral-7B model on Hugging Face and returns the answer.

What it does

## This is an example of basic LLM Chain connected to an open-source model ### The Chain is connected to the Mistral-7B-Instruct-v0.1 model, but you can change this Please note the initial prompt that guides the model: You are a helpful assistant. Please reply politely to the users. Use emojis and a text. Q: {{ $json.input }} A: This way the model "knows" that it needs to answer the question right after the A: . Since Hugging Face node is this is an inference mode, it does not support LangChain Agents at the moment. Please use Ollama Chat Model node for that

The steps

  1. When chat message received
  2. Basic LLM Chain
  3. Hugging Face Inference Model

Similar automations