LLAMA3

[ghostcyber11]

I would like to use ollama api to be able to use llama3.1 but I don't know how can I do that

[dosubot[bot]]

To use the Ollama API with Quivr for the LLAMA3.1 model, follow these steps:

1. Install Ollama:

   • Download and install Ollama from their website.

2. Run Ollama:

   • Start Ollama in the background with the LLAMA3.1 model:

     ollama run llama3.1

3. Configure Environment Variables:

   • Open your .env file and uncomment the OLLAMA_API_BASE_URL line:

     OLLAMA_API_BASE_URL=http://host.docker.internal:11434

4. Run Migrations:

   • Move the migration file and reset the database:

     mv supabase/migrations/local_20240107152745_ollama.sql supabase/migrations/20240107152745_ollama.sql
     supabase db reset

5. Add Ollama Model to Quivr:

   • Go to your Supabase backend and update the user_settings table to include the LLAMA3.1 model:

     [
       "ollama/llama3.1"
     ]

These steps will integrate the Ollama API with Quivr to use the LLAMA3.1 model ^[1][2][3].

To continue talking to Dosu, mention @dosu.