Home / Developers and data / Browse the web with a local Qwen model, fewer wrong turns

Browse the web with a local Qwen model, fewer wrong turns

Who it is for
Developers who run Qwen or a similar local model as a browsing agent.
What you give it
A browsing task, the agent-browser tool and your local model.
What you get back
The task done in fewer tries. Scored on 8 selection tasks; the held-out test is not finished.

Read the research

It is a text file you add to an AI assistant, or paste into a chat.

Free. MIT licence: use it, change it, share it.

Trained with our full method: see the scores.

Measured result, selection split

Taken from the research repo's README. Held-out test pending.

Qwen3.8-27B, driven by the pi coding agent, 8 selection tasks with 6 runs each (48 rollouts per skill). The held-out test is pending: those runs were still in progress when this was written, so there is no unseen-task result yet.

SkillEditsCorrectScoreTokens per taskTurnsDecision
No skill (24 rollouts)21/240.788768.7k13.9
s1 (Opus-trained)47/480.917742.3k9.2start
q1443/480.836742.0k8.3rejected
q2q1 with one edit swapped48/480.945436.4k8.5accepted
q34 more47/480.921539.4k8.1rejected
q42 of the q3 edits44/480.854247.0k9.1see note

q4 note: three of its four failures were 15-minute timeouts on the 50-page catalogue crawl, after the practice site began answering 403 under four concurrent crawls. That is the benchmark throttling, not the skill.

The skill file is q2 plus the same hand-added Setup section as Agent Browse.

What it does

A variant of Agent Browse for Qwen3.8-27B and similar local models that tend to guess selectors and URLs. It teaches an assistant to drive a real browser with the agent-browser command line tool: clicking, filling forms, logging in, hover menus, uploads, JavaScript dialogs, paginated data.

It was trained the same way as Agent Browse: scored tasks, and only edits that measurably helped were kept. It starts from the skill trained for Claude Opus and adds what the Qwen runs showed: never invent a URL or selector you have not seen, use the CLI's own selector syntax, pass longer JavaScript on stdin, check a list against the page's own total before calling it complete, and do not close the browser early.

The test harness, every candidate version (accepted and rejected) and the run data are in the research repo: https://github.com/proskillpacks/skillopt-agent-browse (Part 2 of the write-up).

The evidence

OPTIMISED badge. Improved step by step against a set of test cases, with every score on file.Improved over 4 gated rounds: 48 of 48 on the selection tasks.

Trained and scored with Qwen3.8-27B on a local server, driven by the pi coding agent. On the 8 selection tasks (6 runs each) it got 48 of 48 correct at 36.4k tokens per task, against 21 of 24 at 68.7k with no skill and 47 of 48 at 42.3k with the Claude-trained Agent Browse. These are selection-split figures, the split the gate used to pick it. The held-out test is pending. Three of four tuning attempts were rejected by the gate.

More on how it was tested

The held-out test for this version is not finished. We did not score it with any other model.

Limits

  • Held-out test pending: the figures are on the selection split, which the gate used to choose this skill.
  • The cross-check on Claude Opus was not run.
  • One local model, one quantisation, one harness (pi). Other models are untested.
  • The selection runs were measured under four-way concurrency and site throttling.
  • The Setup section of SKILL.md was added by hand and did not go through the validation gate.

Questions

Questions or a problem?

Use the contact page.

Contact page

Which assistants does it work with?

Tested with Qwen3.8-27B on a local OpenAI-compatible server, driven by the pi coding agent, and the agent-browser CLI (https://github.com/vercel-labs/agent-browser). The format is the open SKILL.md format; other assistants and models are untested. You need an assistant that can run shell commands.

For technical users

Using it with an AI assistant

  1. Install the agent-browser CLI from https://github.com/vercel-labs/agent-browser and check that agent-browser --help runs.
  2. Copy the agent-browse-qwen folder from GitHub (https://github.com/proskillpacks/skills/tree/main/skills/developers/agent-browse-qwen) into .agents/skills/ in your project, or into your tool's own skills folder.
  3. Ask for a browser task in plain words, for example: "Open the page, find the price table and give me the rows." The skill loads by itself. There is no paste-in prompt for this one, because it needs a shell.
Get the files from GitHub (for developers)

Jobs that go with this