Before you begin
- A machine that can reach the model server, usually your own computer, running the desktop app or
reliant daemon start(connect your computer). A cloud machine can’t see a server on your laptop. - For the cloud step, any connected provider: a subscription, an API key or Reliant AI.
- The
reliantCLI v1.21 or later, signed in (Sign in and tokens).
1
Serve a model on your machine
Start Ollama with a context window big enough for agents, and pull a model. This guide uses a 0.5B model because it downloads in seconds; pick a larger, tool-capable model for real work.LM Studio, llama.cpp and vLLM work the same way: start their OpenAI-compatible server and load a model.
terminal
terminal
2
Let your machine find it
The daemon checks
localhost on ports 11434 (Ollama), 1234 (LM Studio), 8080 (llama.cpp) and 8000 (vLLM) when it connects and every minute after, and publishes the chat models it finds. Open Settings → AI providers → Local & custom to see them, with each model’s context size and whether it supports tools.From a terminal, reliant models list --local prints the same models with their ids and the machine serving each, and reliant models endpoint list shows each server a machine found, or why it couldn’t reach one.A server on another port or host isn’t detected. Add it there: Add endpoint for an address your machine reaches (or reliant models endpoint add http://gpu-box.lan:8000/v1 --machine <machine>), or Add custom endpoint for a server on the public internet (Reliant cloud) or on your LAN or VPN (Through one of my machines).Settings flags a model whose context is under 64K, and calls one under 16K too small for agent work. For Ollama, raise it with
OLLAMA_CONTEXT_LENGTH or the app’s Context length setting, then click Test connection.3
Name the local model in a workflow step
A detected model’s id is its name on the server plus Validation checks the shape, not whether a machine serves the model; that is decided when the step runs.
@local. Here the first step runs on Ollama and the second on the fast tier of whatever cloud provider you have:.reliant/workflows/local-draft-cloud-review.yaml
terminal
4
Run it and check which model answered
Run it on the machine that serves the model. Add Ollama’s own log shows the draft step reached it:The 0.5B model’s draft is rough, which is what the cloud review step is for.
--daemon <machine> if that isn’t your default machine:terminal
terminal
terminal
What this does not do
- It doesn’t keep your prompts off Reliant’s servers. Only inference runs on your hardware. The prompt and the reply pass through Reliant and are stored in your chat (Privacy & Security).
- It doesn’t work while that machine is away. The model is reached through the machine that found it. When that machine is offline or the server stops, the step fails until it is back.
- It doesn’t make a small model an agent. A step that edits files needs a model that supports tools and a 64K or larger context. The steps above give the agents no tools.
Troubleshooting
no machine has synced this project's workflows yet
no machine has synced this project's workflows yet
--project-path has just created the project, and its machine hasn’t sent the workflows yet. Wait a minute and run the command again.Next steps
Use your Claude or ChatGPT subscription
Connect the cloud side of the workflow with a plan you already pay for.
Use a different model for each step
Tags, explicit ids and thinking levels per node.
Write your first multi-agent workflow
A planner, an implementer and a reviewer in one file.
Model configuration
Custom models, tier order and
~/.reliant/config.yaml.