Marc's AI infra

One central harness, six LLM providers, thirty-six MCP servers and six machines in a single headscale mesh, two of them switched off at survey time. Every service carries the machine that runs it and the one it drives, including when that machine is not mine. Internal addresses and ports are deliberately omitted: this page is public.

surveyed 18 November 2026 on tower · NixOS 26.05
SURFACESTUIdesktopdashboardMatrixDiscordmobile PocketACP / IDEgateway prodHARNESSHermes Agent 2026.9.24default profile · runs on towerskills · memory · cron · delegate · webhooks · MCPprofiles default / discord-bridge / pocketClaude Code CLI for code delegationINFRAnixostaskqhermes-toolsapp-publishgithubgiteacodebergshareMONEYbankwisesimplefingocardlessenable-bankingstripeSELF-HOSTEDnextcloudarrmcpqbittorrentgarageankivaultwardenzitadelMEDIA / VOICEttsrokuPERSONAL / OSINTfirefoxfirefox-macusername-reconphonerepiprephingestalwartbeeperTHIRD-PARTY APIsamazonarena-eloopenroutershlinkdeepseekdefault · deepseek-flash · ctx 1M · visionthird-party APIAPI DeepSeekopenrouterfallback · deepseek-v4.1-flash · nemotron-3-ultrathird-party APIOpenRouterkimi-k3-globalauxiliary vision · kimi-k3third-party APIAPI Moonshotlaptop-llamallama-swap · qwen3.5-4b / 2b · ornith-9bon laptoplaptoplaptop-ablqwen3.5-4b-abl · ctx 131kon laptoplaptopclaudedirect subscription · opusthird-party APIAPI AnthropicLLM PROVIDERS · CLIENT ON TOWERMCP · 36 SERVERS34 processes on tower · 1 on laptop · 1 on the Mactowermain host8 cores · 16 threads · 62 GBno GPUharness · gateway · MCPPG 17 · Matrix · NextcloudJellyfin · *arr · Giteaanywherepublic VPSPangolin + Traefik edgeHeadscale (mesh) + exitZITADEL · VaultwardenStalwart · droplifylaptoponly CUDA boxRTX 3060 6 GBllama-swap (2 providers)tts-mcp (voice)heavy rebuilds + web testsdeckSteam Deckmesh nodeoffloaded rebuildsSteam clientphonenix-on-droid · offssh client (VPS jump)drives the Hinge appmacmacOS · off at surveyChrome CDP + FirefoxiOS buildsCLUSTER · HEADSCALE + YGG MESHcolour is the machine, not the owner
6machines
36MCP servers
34MCP processes on tower
4providers as third-party APIs
62 GBtower RAM
1single GPU (laptop)

Harness

  • Hermes Agent 2026.9.24, default profile on tower
  • 3 profiles: default, discord-bridge, pocket
  • Skills, memory, cron, delegate, webhooks
  • Claude Code CLI for code delegation

LLM providers

  • deepseek by default, 1M context, vision
  • 2 providers executed on the laptop
  • 4 providers as third-party APIs (deepseek, openrouter, moonshot, anthropic)
  • the client is always the harness, on tower

MCP

  • 36 servers configured, 6 families
  • 34 processes on tower, 1 on the laptop, 1 on the Mac
  • 8 infra, 6 money, 7 self-hosted
  • 2 media, 8 personal / OSINT, 5 third-party APIs

Cluster

  • 5 mesh hosts + 1 Mac off the mesh
  • tower runs the services, no GPU
  • laptop is the only CUDA node
  • anywhere carries public entry, auth and mail

1LLM providers: who actually runs the model

The harness runs on tower in all six cases. What changes is the machine executing the model: four providers are third-party APIs, two run on the laptop.

providerwhat it servesclientmodel executed onowner
deepseekdefault · deepseek-flash · ctx 1M · visiontowerAPI DeepSeekthird party
openrouterfallback · deepseek-v4.1-flash · nemotron-3-ultratowerOpenRouterthird party
kimi-k3-globalauxiliary vision · kimi-k3towerAPI Moonshotthird party
laptop-llamallama-swap · qwen3.5-4b / 2b · ornith-9btowerlaptopmine
laptop-ablqwen3.5-4b-abl · ctx 131ktowerlaptopmine
claudedirect subscription · opustowerAPI Anthropicthird party

2MCP servers: the process and its target

An MCP server is a local process that drives something. The "runs on" column says where the process lives, the "target" column says which service it talks to: mine, a device, or an API that is not mine.

mcp serverruns ontargettarget owner
nixostowerlocal nix + search.nixos.orgmine + third party
hermes-toolstowermcp-host on towertower
app-publishtowerApp Store Connect · Google Playthird party
githubtowergithub.comthird party
codebergtowercodeberg.orgthird party
giteatowerGitea on towertower
sharetowerdroplify on anywhere + Nextcloud on toweranywhere
taskqtowertaskq queue (retired)tower
banktowerlocal banking API on towertower
wisetowerAPI Wisethird party
simplefintowerSimpleFIN Bridgethird party
gocardlesstowerGoCardless Bank Account Datathird party
enable-bankingtowerEnable Bankingthird party
stripetowermcp.stripe.comthird party
nextcloudtowerNextcloud on towertower
arrmcptower*arr on towertower
qbittorrenttowerqBittorrent on towertower
garagetowerGarage (S3) on towertower
ankitowerAnki + sync on towertower
vaultwardentowerVaultwarden on anywhereanywhere
zitadeltowerproduction ZITADEL (anywhere)anywhere
rokutower3 TCL TVs on the LANmy devices
firefoxtowerlocal Firefox on towertower
firefox-mactowerFirefox on the Macmac
username-recontowersherlock / maigret across third-party sitesthird party
phonereptowerSpamCalls · Robokiller · WhoCallsMethird party
ipreptowerAbuseIPDB · GreyNoise · Spamhausthird party
hingetowerHinge app on the phonephone
stalwarttowerStalwart on anywhereanywhere
beepertowerBeeper (service stopped)third party
amazontoweramazon.comthird party
arena-elotowerarena datasets on Hugging Facethird party
openroutertoweropenrouter.aithird party
shlinktowerShlink on towertower
ttslaptopTTS engine on laptoplaptop
chrome-macmacChrome on the Macmac

3Self-hosted services, machine by machine

What I actually operate, grouped by machine. Mesh hosts carry the infrastructure; devices only carry their own client.

tower
main host
  • Hermes harness · gateway · backend · mobile · webui
  • mcp-host + 3 LAN MCP forwarders
  • PostgreSQL 17 · Redis
  • Nextcloud + PHP-FPM · Immich (server + ML)
  • Jellyfin · Navidrome · Audiobookshelf
  • Sonarr · Radarr · Prowlarr · Readarr · qBittorrent
  • Matrix Synapse + 6 mautrix bridges
  • Gitea · Garage (S3) · Attic (Nix cache) · Vault
  • ZITADEL (2nd, identical instance) · Wiki.js · Shlink
  • Windmill · Open Notebook · Termix
  • Winnie (front + back) · karaoke · dashboards
  • AdGuard Home · Traefik · newt · rustguac
  • Waydroid + Android capture · Ollama · JupyterHub
  • Tor · yggdrasil · Zabbix agent · Gotify · go2rtc
anywhere
public VPS
  • Pangolin + gerbil + Traefik + nginx (public edge)
  • Headscale (mesh control) · yggdrasil
  • production ZITADEL (auth.marcpartensky.com)
  • Vaultwarden (vault.marcpartensky.com)
  • Stalwart (mail) · droplify (this page)
  • Zabbix server + PHP front
  • PostgreSQL · uptime-kuma · eternal-terminal
laptop
only CUDA box
  • llama-swap: both Hermes providers
  • tts-mcp: voice rendering
  • RTX 3060 6 GB, the fleet's only GPU
  • heavy Nix rebuilds offloaded here
  • headless browser rendering and tests
mac
macOS · off at survey time
  • Chrome driven over CDP (tunnel from tower)
  • Firefox via MCP · paneru (WM)
  • builds iOS
  • off at survey time: Chrome and Firefox driven remotely
deck
mesh node
  • offloaded rebuilds
  • Steam client
phone
nix-on-droid
  • ssh client (jumps through anywhere)
  • Hinge app driven by the hinge MCP

4What is not mine

None of these lines runs on my machines. They are listed because the harness depends on them, and because an honest infra page separates what you host from what you rent.

serviceoperated byused for
API DeepSeekDeepSeekdefault model, 1M context
API MoonshotMoonshot AIauxiliary kimi-k3 vision
OpenRouterOpenRoutermulti-model fallback
API AnthropicAnthropicClaude opus via subscription
GitHub · CodebergMicrosoft · Codeberg e.V.repos, PRs, mirrors
Hugging FaceHugging Facearena Elo datasets
Wise · GoCardless · Enable Banking · SimpleFINbank aggregatorsbalances and transactions
StripeStripetest payments
App Store Connect · Google PlayApple · Googleapp publishing
AmazonAmazonorders
AbuseIPDB · GreyNoise · Spamhausindependent third partiesIP reputation
SpamCalls · Robokiller · WhoCallsMeindependent third partiesphone reputation