- Knowledge retrieval and reporting
- Documents and drawings
- Language models
- Security and data privacy
- On-premises and edge hardware
How does SAG2 find cited answers in a mine’s records, offline?
SAG-Wiki 0.3.11 · six public records: 509 pages, 41 rule sections · offline, local models · every statement read twice
SAG2 searches documents without an embedding index: keyword search proposes passages, a small model judges which are evidence, and a second search starts from the best of them. We ran it offline in SAG-Wiki, an open-source search application, over six public mining records, and had a local model answer eight plant and safety questions from the passages, asked to cite one for each fact.
What we found
- The right pages, mostly6 of 7 searches with target pages returned those pages. The seventh missed the pages it needed in a second record.
- Citations mostly hold38 of the 41 statements that cite a passage were fully supported by it, counting the record title sent with it; the other three only partly, such as an “only” the rule does not say.
- Uncited lines add claims4 of the 15 statements without a citation made a claim no passage makes, such as who owns the mine now.
Method
Keyword candidates, a judge, a second search
One recorded search, for the 2003 roaster repair question, step by step.
With each second-round request SAG-Wiki sends 20 passages: the 10 judged best and the first 10 new candidates. Decision models built for SAG2 read them; Qwen3-Reranker-0.6B, the judge here, scores each passage against the question alone. SAG-Wiki keeps its ten best candidates; one can span several text ranges (the conveyor card’s four best made 16 passages). It groups the ranges by record and heading, merges touching or overlapping ones and returns each as a passage. A local model then wrote the answer with SAG-Wiki’s answer instructions, sent by a script with every returned passage; SAG-Wiki’s own chat would trim the sources to a budget and, for this model, turn its thinking off. For the six questions it answered, the target pages were already among the first round’s five best: the second round added none.
- RealSix public recordsSEC technical reports for Cadia and Nevada Gold Mines, two MSHA investigations at Goldstrike, an MSHA safety card and the US machinery rules for surface metal and nonmetal mines.
- OfflineLoopback onlySearch and judging in a loopback-only network namespace, checked before the run; answers through one file socket to a model server outside it.
- SearchedSAG2 in SAG-Wiki 0.3.11Default retrieval settings, judged by Qwen3-Reranker-0.6B, the only judge in No. 15 with both facts of its two-record question in the first five in all three wordings, on all 576 pages.
- AnsweredQwen 3.8 27BWith SAG-Wiki’s answer instructions: use only these passages, cite each fact.
- CheckedEvery statement, twiceTarget pages named before any search; every statement read against its passages by two Claude readers.
Limits: eight questions, one run each; public records the models may have seen; record titles written by us; AI readers, not a metallurgist. Names of people in the MSHA reports are withheld. Details, code and data: the article’s public repository.
01 · Offline
Search sealed from the network
Search and judging ran in a network namespace whose only connection is the machine talking to itself, checked before the run started. Each answer request ran in a namespace made the same way and reached the answering model through one file socket; that model’s server ran on the same workstation outside the namespaces, not sealed.
Checked at the start of the search run, 21 November 2026: network interfaces, loopback only; 1.1.1.1 and 8.8.8.8 unreachable. The answer runs recorded no such check; the wrapper that made their namespace gives loopback only. Searches took 0.9 to 1.4 seconds; answers 8 to 28 seconds, 214 to 993 tokens of output each.
02 · Eight questions
Ask, read the answer, open its sources
Eight questions from plant design to safety rules. The model got each with the passages SAG-Wiki returned, numbered and titled, and was told to use nothing else and to cite them. Every citation number opens its passage, with record and page.
“During the 2003 Goldstrike roaster gasket repair, what was left inside the roaster, and was the oxygen supply locked out?”
What Was Left Inside the Roaster
The roaster was not emptied before the gasket repair began. It was shut down with a large quantity of hot calcine remaining in both the upper and lower beds 3. The lower bed alone could have contained approximately 28 cubic yards of hot calcine 1. The report explicitly identifies this as a causal factor: "The hot calcine in the roaster was not emptied. No means was provided to block or control the flow of hot calcine from the discharge pipe before any maintenance work began" 3. When the crew opened the 16-inch B-leg #1 pipe to replace the gasket, they found it "full of cool calcine dust" 2, and the unexpected release of hot calcine through the open pipeline is what caused the burns 7.
Was the Oxygen Supply Locked Out?
No, it was not physically locked out. The investigation states that "the oxygen supply line was turned off but the manual oxygen valves were not physically locked-out" 1. The maintenance crew was still waiting for the roaster feed and oxygen valves to be locked out at 7:30 a.m. 2, and by 8:30 a.m. they had placed locks on the lock box for the roaster feed and began the gasket repair 2. However, the oxygen valves themselves never received physical lockout 1. Additionally, the roaster's control interlocks had been disabled during the shutdown, meaning no electrical power was supplied to the roaster controls or feedback sensors 1, and the controls did not physically lock out any mechanically operated devices 5.
Cited passages
1 MSHA investigation, roaster, 2003 · PDF p. 9
The system interlocks were disabled during the shutdown indicating there was no electrical power supplied to the roaster controls or any feedback sensors. The oxygen supply line was turned off but the manual oxygen valves were not physically locked-out. There were no level controls on the roaster stages, just feedback control from the pressure transmitters. The lower bed could have contained approximately 28 cubic yards of hot calcine. Training and Experience [name withheld] had 8 ½ years roaster experience, 3 years at this roaster position and 3 ½ weeks as a trainer.
The record, at this page ↗2 MSHA investigation, roaster, 2003 · PDF p. 5
Mine management decided to perform maintenance while the feed supply to the roaster was down. [name withheld] went to assist locking out the dust scrubber recycle pumps. This system was also scheduled for repairs while the roaster feed supply was down. At 7 a.m., a safety meeting was conducted in the maintenance shop and tasks were assigned. [name withheld] and [name withheld], maintenance men, were assigned to replace a leaking gasket on a knife gate valve on the B-leg #1 north Roaster. At 7:30 a.m., they cleaned a fan while waiting for the roaster feed and oxygen valves to be locked out. At 8:30 a.m., they put their locks on the lock box for the roaster feed and started repairs to the gasket on B-leg #1. They removed the defective gasket, leaving a 2 ½ to 3 inch gap in the pipeline. They found the 16 inch B-leg #1 pipe full of cool calcine dust.
The record, at this page ↗3 MSHA investigation, roaster, 2003 · PDF p. 10
Causal Factor: The hot calcine in the roaster was not emptied. No means was provided to block or control the flow of hot calcine from the discharge pipe before any maintenance work began. Corrective Action: A written plan should be developed and implemented to ensure the contents of the roaster are contained and do not pose a hazard to persons performing work on the roaster or its components. This plan should also include a requirement that all personnel wear protective clothing to ensure their safety. CONCLUSION The accident occurred because safe procedures had not been established prior to performing repairs on the B-leg of the #1 Roaster (North) knife gate valve. The roaster was shut down with a large quantity of hot calcine in the upper and lower beds.
The record, at this page ↗5 MSHA investigation, roaster, 2003 · PDF p. 8
The controls for the roaster had multiple interlocks to prevent the operation of the roaster when the roaster was turned off from the control room. These controls turned off the electrical and pneumatic features of the roaster but did not physically lock-out any mechanically controlled devices to prevent inadvertent operation.
The record, at this page ↗7 MSHA investigation, roaster, 2003 · PDF p. 4
A maintenance crew was replacing a gasket in a discharge pipeline that transferred hot calcine dust from a roaster to a quench tank. After the crew went to get some parts, [name withheld] entered the area where the gasket was being replaced and received burns when the hot calcine dust unexpectedly released through the open pipeline. The accident occurred because the procedures being used to perform this repair work at the discharge pipeline were inadequate. The roaster had not been emptied of the hot calcine dust before the maintenance work was performed.
The record, at this page ↗
Search 0.96 s, 7 passages from 1 record; answer 16.0 s. 10 statements: 8 supported by the passages they cite, 2 fair readings without a citation.
03 · Where it fell short
A rule far down the list, the wrong pages, a claim added
Each row is one list SAG-Wiki returned, a square per passage in the order the model saw them, grouped by record and heading. Rust marks a passage from the target pages, named before the search; for the two roaster questions one page was corrected after it, as it described another roaster.
Conveyor rules: ranked 4th, shown 21st
The judge ranked the guarding rule, § 56.14107 of the US rules for surface metal and nonmetal mines, fourth. SAG-Wiki returns its ten best grouped by record and heading, so the conveyor card’s 16 pieces came first and the rule reached the model 21st and 22nd of 29. It used the rule, but called its seven-foot exemption the “only” one and measured it from the walkway alone.
Two records: the second one’s pages missed
The question names no mine. The 2003 report identifies it; the 2026 technical report, current to 31 December 2025, describes its roaster circuit. All 50 first candidates came from the two MSHA reports. The second search judged 50 new ones, five from the technical report but none of its roaster pages, and the answer said its sources did not cover today.
Not held: said so, then added a claim
No record holds the mine’s current gasket procedure. The answer said so and listed what the 2003 report does say, but merged two of its recommendations into one procedure and named an owner no passage gives.
04 · At your site
Before a site relies on it
- Name the pages before the testWrite each test question with the pages that answer it before any search, so a missed page is a finding and not a matter of opinion. Check that key too: one page named here described another roaster.
- Show every passage with its record and pageEvery statement here could be checked against its source, because every passage carried its record and page.
- Read the answers, not only the listsThe slips were small words: an “only”, seven feet from the walkway alone, two recommendations merged, an owner today. In a safety rule, small words decide what a crew does.
- Test questions that cross recordsSAG2’s second search is meant to follow one record to the next. Here it reached the second record but not its target pages, and only the first record’s passages reached the model; try that kind of question on your own records.
- Keep it on your own machineA search took about a second on one graphics card and an answer under half a minute on two more. Measure the memory free under the site’s normal workload first.
Sources
- Newmont. Cadia Valley Operations, New South Wales, Australia: Technical Report Summary, February 2026. Exhibit 96.2 to Form 10-K, filed 19 February 2026. SEC EDGAR.
- Nevada Gold Mines. S-K 1300 Technical Report Summary on the NGM Complex, May 2026. Exhibit 96.1, filed with the SEC. SEC EDGAR.
- Mine Safety and Health Administration. Report of Investigation MAI-2003-23: Fatal “Other” Accident, November 19, 2003, Goldstrike Mine. PDF.
- Mine Safety and Health Administration. Report of Investigation MAI-2005-30: Fatal Fall of Person Accident, October 22, 2005, Goldstrike Mine. PDF.
- Mine Safety and Health Administration. Conveyor Safety Tips for Mechanics, Best Practice Series BP-49, August 2000. PDF.
- 30 CFR Part 56, Subpart M: Machinery and Equipment. Electronic Code of Federal Regulations, current to 19 November 2026. eCFR, 19 November 2026.
- SAG-Wiki, open-source document search, MIT licence; CLI 0.3.11 from npm. github.com/Zleap-AI/SAG-Wiki.
- Wu, Y., Liang, X. and Li, G. (2026). SAG2: embedding-free multi-hop retrieval with BM25 and decision models. arXiv:2610.22588 v2. arxiv.org/html/2610.22588v2.
- Models: Qwen3-Reranker-0.6B; Qwen 3.8 27B as 4-bit weights.