WhatsApp Chatbot with llama-2-7b on Google Colab

This project demonstrates the setup of a WhatsApp chatbot powered by the llama-2-7b model, running on a Google Colab instance. The chatbot is integrated with Twilio for messaging capabilities.

Steps to run

Step 1: Run llama-2-7b API in Google Colab

Run the llama-2-7b API file in Google Colab to set up the llama-2-7b model. This will generate a ngrok endpoint.

Step 2: Use ngrok Endpoint in Twilio Chatbot File

In the Twilio chatbot file, use the ngrok endpoint generated in Step 1 in the call_llama_api function. This function will be responsible for connecting to the llama-2-7b model.

Step 3: Configure Twilio Sandbox Settings

Run the twilio chatbot file and get its ngrok endpoint. Use this endpoint in the twilio sandbox settings to make the connection

Example output: