Running PeterG-AI with Different Models
Running Llama Models
Set
XAI_MODELenvironment variable to: -meta-llama/Meta-Llama-3.1-70B-Instruct-Turbofor Llama 70B -meta-llama/Meta-Llama-3.1-405B-Instructfor Llama 405B
Running Grok Models
Set
XAI_MODELtogrok-betafor Grok models.
Running OpenAI Models
Set
XAI_MODELtogpt-4o-miniorgpt-4o.
Additional Requirements
Node Version: Ensure Node 20+ is installed. Check with:
node -v
Sharp Installation:
npm install --include=optional sharp
Last updated