Running PeterG-AI with Different Models

Running Llama Models

  1. Set XAI_MODEL environment variable to: - meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo for Llama 70B - meta-llama/Meta-Llama-3.1-405B-Instruct for Llama 405B

Running Grok Models

  • Set XAI_MODEL to grok-beta for Grok models.

Running OpenAI Models

  • Set XAI_MODEL to gpt-4o-mini or gpt-4o.

Additional Requirements

Node Version: Ensure Node 20+ is installed. Check with:

node -v

Sharp Installation: npm install --include=optional sharp

Last updated