Anon Code: Local Claude Code?
Anon Kode looks to be Claude Code that you can use with local models:
Terminal-based AI coding tool that can use any model that supports the OpenAI-style API.
Fixes your spaghetti code
Explains wtf that function does
Runs tests, shell commands and stuff
Whatever else claude-code can do, depending on the model you use
Sounds amazing, especially since Claude Code (which is great) is currently quite expensive. It probably should be, but I canāt afford dollars-a-day costs for a coding assistant. Can a local version compare?
Hereās my experience setting up and using Anon Kode with Ollama and Qwen2.5-Coder 14B on my 36GB M3 Pro MacBook Pro.
TL;DR: I got it working with Ollama and Qwen2.5-Coder, but then failed to successfully work with it and donāt have time to debug. If youāve had success with Anon Kode please message me on Bluesky and tell me about it!
Setup
Install Ollama and ollama run qwen2.5-coder:14b
if you donāt have an exsting local LLM set up.
Hiccup: Iāve been having issues connecting to the Ollama API via localhost because my machine preferrs ipv6 for localhost (::1), and Ollama only binds to ipv4 (127.0.0.1). In my own code I just use 127.0.0.1 instead of localhost, but the default Ollama configuration for Kode uses localhost, so I āsolvedā the problem by commenting out the ipv6 entry for localhost in my /etc/hosts
file. This is not a good solution, but thatās a future Chris problem. If anyone knows how to fix this properly, please let me know.
Install and run Kode:
npm install -g anon-kode
cd your-project
kode
I walked through the config screens and picked Ollama as my API Provider:
I set the API KEY to āollamaā. This shouldnāt be necessary, but it doesnāt like it if you donāt set an API KEY value.
Pick your model, I chose to pick the same model for ālargeā and āsmallā.
I went with āDefaultā for tokens.
Looks good.
Success! āHelloā gets a response from Ollama.
Use
Now that Kode is talking to Ollama, will it work?
I was half way through writing this post, so I thought I would ask Kode to insert the remaining images above for me. It didnāt go well.
Looks like an issue with understanding the project? Maybe running /init
will help?
š« Thatās unfortunate.
It seems like there are a number of issues; file access, missing toolsā¦ unfortunately I donāt have time to dig further right now, so itās back to Claude.
Result (for now)
I really want this to work, and Iāll try again when I have time. If youāve had more success with Anon Kode please message me on Bluesky and tell me about it!