eleticle

Core No. 08Logged 16 Nov 2026Code & data →

Does a written skill help a local LLM read a whole plant flowsheet?

Two local models · two whole-plant drawings · three attempts with the skill, three without · scored against an answer key, checked by hand

We wrote a seven-step skill, a procedure an AI agent loads before it starts, for reading plant flowsheets. Two local models redrew two whole-plant drawings as flowcharts, three times with the skill and three without; we scored each chart, stream by stream, against an answer key.

What we found

  • 50 → 66of 90 streams found on the Phoenix drawing by Qwen 3.8 Flash Next, without and with the skill (median of three)
  • 62 → 77of 90 streams found on the Twin Creeks drawing, Flash Next's median. On each drawing, all three attempts with the skill beat all three without
  • 37 → 23wrong lines on Phoenix, the median of Flash Next's charts that draw; 25 → 14 on Twin Creeks
  • 2×Flash Next's median time an attempt with the skill: 23 minutes, against 10 to 12 without

The other model, Qwen 3.8 27B, gained on one drawing of the two in each of its two runs, not the same one, drew about as many wrong lines and, in the rerun, took about fifteen times as long with the skill as without it (02).

  1. Method
  2. 01The skill
  3. 02The result
  4. 03Stream by stream
  5. 04What this does not show

Method

Two drawings, two models, with and without the skill

  • ScoringAn answer key per drawingUnits, streams and loops, listed apart by two AI readers, Claude and Codex, their differences settled on the drawing. A stream counts when the chart joins the right two units: junctions and boxes that match nothing are passed through, unsure links are left out, and labels, grades and tonnages are not scored. Every chart checked by hand. A chart that does not draw counts as the fewest streams and is left out of the wrong lines.
  • ModelQwen 3.8 Flash Next4 × RTX 3090, 24 GB each, in a server. Two copies of the model, with weights averaging 3.5 bits.
  • ModelQwen 3.8 27B2 × RTX 5080, 16 GB each, in a workstation. 4-bit weights.
  • Agent softwarePi coding agent 1.5.2The skill, or none. Two extensions: at most two images per request, and a stop for a model that repeats one call.
The whole instructionThe attached image is a mineral processing flowsheet. Convert it to a Mermaid flowchart and save it as flowsheet.mmd in the current directory. Include every unit and every stream shown, with the labels as written on the drawing, and arrows in the direction of flow. The file must hold only Mermaid code.

With the skill, the same instruction, preceded by the command that loads it.

Streams, lines and minutes are measured; times compare the complete setups, not the models alone. The skill, the scripts, every chart with its score and hand check, and the answer keys are in the article's public repository, where the serving software is also named. The repository does not include the drawings.

01 · The skill

Seven steps, read piece by piece

A skill is a written procedure the agent loads before it starts, with small scripts it can run. One script names the next step and will not move on while a step is undone. The steps answer failures seen on these drawings in the first test: one look at the whole, a chain instead of loops, misread labels.

  1. 1

    Look once

    Areas, legend, where ore comes in and where it leaves.

  2. 2

    Cut into tiles

    Overlapping tiles with rulers, made by a script.

  3. 3

    Read each tile

    Labels as written. Zoom in wherever lines meet.

  4. 4

    List the units

    One line each. Repeats kept apart by position.

  5. 5

    Follow the ore

    Feed to product and tailings, then water, reagents, carbon and every recycle.

  6. 6

    Write the chart

    One box per unit, one line per stream, only what is drawn.

  7. 7

    Check

    A script flags units with no line in or out. Look again there.

The skill and its four scripts are in the public repository, free to use under the MIT licence. It was written and tuned on other drawings, and frozen before these two were run.

02 · The result

More streams in every attempt, fewer wrong lines

Flash Next read each drawing three times with the skill and three times without. Each dot is one attempt, scored against the drawing's answer key.

  • Without the skill
  • With the skill
  • Median
Qwen 3.8 Flash Next, three attempts each: streams found, of 90 in the answer keyPhoenix mine mill, without the skill: 45, 52, 50. Phoenix mine mill, with the skill: 61, 66, 68. Twin Creeks mine, without the skill: no chart, 65, 62. Twin Creeks mine, with the skill: 75, 77, 79.Phoenix mine millWithout the skill50With the skill660306090Twin Creeks mineWithout the skill621 attempt: no chartWith the skill770306090Streams found, of 90 in the answer keyQwen 3.8 Flash Next, three attempts each: streams found, of 90 in the answer keyPhoenix mine mill, without the skill: 45, 52, 50. Phoenix mine mill, with the skill: 61, 66, 68. Twin Creeks mine, without the skill: no chart, 65, 62. Twin Creeks mine, with the skill: 75, 77, 79.Phoenix mine millWithout the skillmedian 50With the skillmedian 660306090Twin Creeks mineWithout the skillmedian 62 · 1 no chartWith the skillmedian 770306090Streams found, of 90 in the answer key

On each drawing, every attempt with the skill found more streams than any attempt without it: 61 to 68 against 45 to 52 on Phoenix, 75 to 79 against 62 to 65 on Twin Creeks. One attempt without the skill, on Twin Creeks, wrote a chart that does not draw.

Medians: for streams found, a chart that does not draw counts as the fewest of its three; for wrong lines, the median is of the charts that draw (two on Twin Creeks without the skill); minutes count all three attempts.

The 27B rerun: one drawing better, fifteen times slower

  • PhoenixMore streams in every attempt: 37 to 41 of 90 with the skill, 26 without
  • Twin CreeksNo clear gain: 34 to 50 of 90 with the skill, 34 to 37 without
  • Wrong linesAbout level: 29 to 41 a chart with the skill, 28 to 38 without
  • 15×the time: 12 to 44 minutes an attempt with the skill, restarts included, 1 to 2 without

03 · Stream by stream

What the skill found that the model missed

Flash Next's charts again. Each square is one stream of the drawing's answer key: a line from one unit to the next. Switch the skill off and on, and tap a square for its name.

  • Found without the skill
  • Added by the skill
  • Lost with the skill
  • Missed
Phoenix mine mill: the 90 streams of the answer key, found or missedMiddle attempt of each condition. Found with and without the skill: 42. Only with the skill: 24. Only without it: 8. Missed by both: 16.CrushingMINED ORE → PRIMARY CRUSHERPRIMARY CRUSHER → CRUSHED ORE STOCKPILECRUSHED ORE STOCKPILE → SAG MILLGrindingWATER → SAG MILLLIME → SAG MILLSAG MILL → SAG MILL DISCHARGE SCREENSAG MILL DISCHARGE SCREEN → PEBBLE CRUSHERSAG MILL DISCHARGE SCREEN → Ball mill cyclonesPEBBLE CRUSHER → SAG MILLBALL MILLS → Ball mill cyclonesBALL MILLS → PRIMARY GRAVITYWATER → Ball mill cyclonesBall mill cyclones → BALL MILLSBall mill cyclones → ROUGHER FLOTATIONREAGENTS → BALL MILLSREAGENTS → ROUGHER FLOTATIONGravityPRIMARY GRAVITY → INTENSIVE CYANIDATIONPRIMARY GRAVITY → CONTACT FLOTATIONFLOTATION GRAVITY → CLEANER GRAVITY (FUTURE)FLOTATION GRAVITY → PRIMARY CLEANER COLUMNCLEANER GRAVITY (FUTURE) → INTENSIVE CYANIDATIONINTENSIVE CYANIDATION → Ball mill cyclonesINTENSIVE CYANIDATION → Regrind cycloneINTENSIVE CYANIDATION → PREGNANT SOLUTION TANKFlotationREAGENTS → CONTACT FLOTATIONCONTACT FLOTATION → Ball mill cyclonesCONTACT FLOTATION → FLOTATION GRAVITYREAGENTS → ROUGHER FLOTATIONROUGHER FLOTATION → FLOTATION GRAVITYROUGHER FLOTATION → Regrind cycloneROUGHER FLOTATION → DESLIME CYCLONESPRIMARY CLEANER COLUMN → Regrind cyclonePRIMARY CLEANER COLUMN → 2ND CLEANER CONDITIONING TANKLIME → Regrind cycloneREAGENTS → Regrind cycloneRegrind cyclone → REGRINDRegrind cyclone → 1st CLEANER FLOTATIONREGRIND → Regrind cyclone1st CLEANER FLOTATION → 2ND CLEANER CONDITIONING TANKREAGENTS → CLEANER/ SCAVENGER FLOTATIONCLEANER/ SCAVENGER FLOTATION → Regrind cycloneCLEANER/ SCAVENGER FLOTATION → Leach feed trash screenREAGENTS → Leach feed trash screenLIME → Leach feed trash screen2ND CLEANER CONDITIONING TANK → MAGNETIC SEPARATIONREAGENTS → 2ND CLEANER CONDITIONING TANKMAGNETIC SEPARATION → MAGNETIC CONCENTRATE GRAVITY CONCENTRATORMAGNETIC SEPARATION → 2ND CLEANERMAGNETIC CONCENTRATE GRAVITY CONCENTRATOR → INTENSIVE CYANIDATIONMAGNETIC CONCENTRATE GRAVITY CONCENTRATOR → FINES THICKENER2ND CLEANER → 2ND CLEANER SCAVENGER2ND CLEANER → COPPER CONCENTRATE THICKENER2ND CLEANER SCAVENGER → 1st CLEANER FLOTATION2ND CLEANER SCAVENGER → 2ND CLEANER CONDITIONING TANKConcentrateCOPPER CONCENTRATE THICKENER → Filter feed tankFilter feed tank → COPPER CONCENTRATE FILTERCOPPER CONCENTRATE FILTER → COPPER CONCENTRATE STOCKPILELeachDESLIME CYCLONES → Leach feed trash screenDESLIME CYCLONES → FINES THICKENERCYANIDE → Leach feed trash screenLeach feed trash screen → TRASHLeach feed trash screen → LEACHLEACH → CIPCIP → CIP tailings carbon safety screenCIP → ACID WASHCIP tailings carbon safety screen → CARBON BINCIP tailings carbon safety screen → TAILINGS PONDCarbonHEAP LEACH CARBON → ACID WASHACID WASH → STRIPSTRIP → REGENERATIONSTRIP → PREGNANT SOLUTION TANKREGENERATION → CIPREGENERATION → CARBON TO HEAP LEACHGoldBARREN SOLUTION TANK → STRIPPREGNANT SOLUTION TANK → Electrowinning cellsElectrowinning cells → BARREN SOLUTION TANKElectrowinning cells → PRECIOUS METAL EW SLUDGE TO REFINERYWaterFINES THICKENER → TAILINGS PONDFINES THICKENER → MILL WATERFLOCCULANT → FINES THICKENERCARO'S ACID → TAILINGS PONDTAILINGS POND → RECLAIM WATERCHLORIDE PLUME → RECLAIM WATERTREATED RECLAIM → FINES THICKENERMINE WATER → TREATED RECLAIMCARO'S ACID → TREATED RECLAIMLIME → TREATED RECLAIMMILL WATER → MILL WATER DIST'NFRESH WATER → MILL WATERFRESH WATER → REAGENTS GLAND WATERPhoenix mine mill: the 90 streams of the answer key, found or missedMiddle attempt of each condition. Found with and without the skill: 42. Only with the skill: 24. Only without it: 8. Missed by both: 16.CrushingMINED ORE → PRIMARY CRUSHERPRIMARY CRUSHER → CRUSHED ORE STOCKPILECRUSHED ORE STOCKPILE → SAG MILLGrindingWATER → SAG MILLLIME → SAG MILLSAG MILL → SAG MILL DISCHARGE SCREENSAG MILL DISCHARGE SCREEN → PEBBLE CRUSHERSAG MILL DISCHARGE SCREEN → Ball mill cyclonesPEBBLE CRUSHER → SAG MILLBALL MILLS → Ball mill cyclonesBALL MILLS → PRIMARY GRAVITYWATER → Ball mill cyclonesBall mill cyclones → BALL MILLSBall mill cyclones → ROUGHER FLOTATIONREAGENTS → BALL MILLSREAGENTS → ROUGHER FLOTATIONGravityPRIMARY GRAVITY → INTENSIVE CYANIDATIONPRIMARY GRAVITY → CONTACT FLOTATIONFLOTATION GRAVITY → CLEANER GRAVITY (FUTURE)FLOTATION GRAVITY → PRIMARY CLEANER COLUMNCLEANER GRAVITY (FUTURE) → INTENSIVE CYANIDATIONINTENSIVE CYANIDATION → Ball mill cyclonesINTENSIVE CYANIDATION → Regrind cycloneINTENSIVE CYANIDATION → PREGNANT SOLUTION TANKFlotationREAGENTS → CONTACT FLOTATIONCONTACT FLOTATION → Ball mill cyclonesCONTACT FLOTATION → FLOTATION GRAVITYREAGENTS → ROUGHER FLOTATIONROUGHER FLOTATION → FLOTATION GRAVITYROUGHER FLOTATION → Regrind cycloneROUGHER FLOTATION → DESLIME CYCLONESPRIMARY CLEANER COLUMN → Regrind cyclonePRIMARY CLEANER COLUMN → 2ND CLEANER CONDITIONING TANKLIME → Regrind cycloneREAGENTS → Regrind cycloneRegrind cyclone → REGRINDRegrind cyclone → 1st CLEANER FLOTATIONREGRIND → Regrind cyclone1st CLEANER FLOTATION → 2ND CLEANER CONDITIONING TANKREAGENTS → CLEANER/ SCAVENGER FLOTATIONCLEANER/ SCAVENGER FLOTATION → Regrind cycloneCLEANER/ SCAVENGER FLOTATION → Leach feed trash screenREAGENTS → Leach feed trash screenLIME → Leach feed trash screen2ND CLEANER CONDITIONING TANK → MAGNETIC SEPARATIONREAGENTS → 2ND CLEANER CONDITIONING TANKMAGNETIC SEPARATION → MAGNETIC CONCENTRATE GRAVITY CONCENTRATORMAGNETIC SEPARATION → 2ND CLEANERMAGNETIC CONCENTRATE GRAVITY CONCENTRATOR → INTENSIVE CYANIDATIONMAGNETIC CONCENTRATE GRAVITY CONCENTRATOR → FINES THICKENER2ND CLEANER → 2ND CLEANER SCAVENGER2ND CLEANER → COPPER CONCENTRATE THICKENER2ND CLEANER SCAVENGER → 1st CLEANER FLOTATION2ND CLEANER SCAVENGER → 2ND CLEANER CONDITIONING TANKConcentrateCOPPER CONCENTRATE THICKENER → Filter feed tankFilter feed tank → COPPER CONCENTRATE FILTERCOPPER CONCENTRATE FILTER → COPPER CONCENTRATE STOCKPILELeachDESLIME CYCLONES → Leach feed trash screenDESLIME CYCLONES → FINES THICKENERCYANIDE → Leach feed trash screenLeach feed trash screen → TRASHLeach feed trash screen → LEACHLEACH → CIPCIP → CIP tailings carbon safety screenCIP → ACID WASHCIP tailings carbon safety screen → CARBON BINCIP tailings carbon safety screen → TAILINGS PONDCarbonHEAP LEACH CARBON → ACID WASHACID WASH → STRIPSTRIP → REGENERATIONSTRIP → PREGNANT SOLUTION TANKREGENERATION → CIPREGENERATION → CARBON TO HEAP LEACHGoldBARREN SOLUTION TANK → STRIPPREGNANT SOLUTION TANK → Electrowinning cellsElectrowinning cells → BARREN SOLUTION TANKElectrowinning cells → PRECIOUS METAL EW SLUDGE TO REFINERYWaterFINES THICKENER → TAILINGS PONDFINES THICKENER → MILL WATERFLOCCULANT → FINES THICKENERCARO'S ACID → TAILINGS PONDTAILINGS POND → RECLAIM WATERCHLORIDE PLUME → RECLAIM WATERTREATED RECLAIM → FINES THICKENERMINE WATER → TREATED RECLAIMCARO'S ACID → TREATED RECLAIMLIME → TREATED RECLAIMMILL WATER → MILL WATER DIST'NFRESH WATER → MILL WATERFRESH WATER → REAGENTS GLAND WATER

Phoenix, middle attempt of each: 50 of 90 streams found without the skill, 66 with it.

The drawing: Phoenix mine mill and Twin Creeks mine, slides 39 and 37 of C. G. Anderson, Mineral Processing Flowsheets, Colorado School of Mines, cropped to the figure. "Middle" pairs the middle attempt of each set by streams found; 1, 2 and 3 pair the attempts that ran side by side.

04 · What this does not show

Two drawings, three attempts each

  • 2 drawingsBoth whole plants from one lecture. Other drawings may give other results
  • 3 attemptsper model and condition: enough to see this gap, not to rank small ones
  • Smaller in tuningOn five smaller drawings Flash Next found only a few more streams with the skill than without. Its fewer wrong lines held
  • One serverFlash Next's pairs of attempts ran side by side, so its minutes compare the two, not the server alone
  • 27B run twiceIts first run shared the server with stray runs of ours and gained on Twin Creeks instead. The figures here are the rerun's, five attempts redone alone; both runs are in the GitHub folder