​
TOGETHER_API_KEY
string
default: ""required

Requires your TogetherAI key. To set up your API key, please refer to the guide on setting up Together AI API key for detailed instructions.

To use models from TogetherAI, use the prefix together/ in the model flag to load the model from TogtherAI. For example,

python main.py --model together/<model-name>

Following is an example of using mistralai/Mixtral-8x7B-Instruct-v0.1 from TogetherAI.

python main.py --model together/mistralai/Mixtral-8x7B-Instruct-v0.1

​
Supported Models

All the models available in TogetherAI can be found here and are supported by NeoGPT.

OpenAIIntroduction