Minions FAQs

Question 1

Which local LLM servers does Minions support?

Accepted Answer

Minions currently supports Ollama and Tokasaurus for serving local language models. Choose the best one for your hardware: Ollama for CPU and Tokasaurus for NVIDIA GPUs.

Question 2

Which cloud LLM providers is Minions compatible with?

Accepted Answer

Minions is compatible with a wide range of cloud LLM providers, including OpenAI, TogetherAI, and DeepSeek.

Question 3

Does Minions really reduce cloud costs?

Accepted Answer

Yes! By processing long contexts locally with smaller models, Minions significantly reduces the computational demands on expensive cloud-based LLMs, leading to lower cloud costs.

Question 4

What is Minions?

Accepted Answer

Minions is a communication protocol that allows small, on-device language models to work with larger, cloud-based models. This approach reduces cloud costs by processing context locally.

Question 5

How do I get started with Minions?

Accepted Answer

First, clone the repository and install the Python package. Then, install either Ollama or Tokasaurus for local model serving. Finally, set your API keys for your chosen cloud LLM provider.

Minions

Key Features

Use Cases

Minions

Key Features

Use Cases