Jose Romero

Notes from the workbench

Posts.

The written side of what I build, break and figure out. Experiments, useful detours, and what I'd do differently.

A little more of the story,
straight to your inbox.

Get the next post Free on Substack.

Explore the archive

Showing 1 to 10 of 51 posts

Running Qwen 3.8 Flash-Next at xhigh on 3 harnesses

Qwen 3.8 Flash-Next felt fast in chat and slow in my overnight agent runs, so I ran six coding tasks on OpenCode, Pi and DeepSeek Harness at xhigh thinking on a 128 GB Strix Halo. 17 of 18 came back done. It is not the harness: generation falls from about 15 tokens a second under 25k context to about 8 past 75k on all three.

I built a decision tree instead of buying a Mac Studio

The M5 Ultra Mac Studio is a much better machine than the 128 GB box I run everything on, the 512 GB tier is tempting for the biggest local models, and it would be a dumb financial decision. So I built an interactive yes/no decision tree: pick the chip, memory, machines and the model you want, and it lands on buy at launch, wait, avoid, or a CUDA box instead. I walk my own answers through it. It says wait.

GLM-5.3-Flash: which quant works on a Strix Halo

Every Unsloth quant of GLM-5.3-Flash that fits a 128 GB Strix Halo desktop, 93 to 120 GB, through the same four one-shot tests at reasoning low, high and max. Five files fit, speed is flat at 8 to 10 tokens a second, only the smallest file finishes the exam, high finishes one test in twenty, and max loops on one word for three hours. Every output and number on the results page.

Keep figuring it out with me

The next experiment is already in the works.

Get the written side of each video on Substack. What I tried, what worked, and what I learned along the way.

Get new posts Free to read. Unsubscribe anytime.