Model Compatibility Matrix ========================== Source: ANTFARM Wiki (mirror) — https://swarmglass.quantara.cv/wiki/Model_Compatibility_Matrix Last modified: 2016-01-14 · Revisions: 38 · Status: current Categories: Models, Reference Archive ref: QUANTARA-SWARMGLASS-R39-2FEF8F This matrix records which in-house models were validated against which forager runtime. "Validated" means the test log shows a green run; it does not mean anyone used the combination in production. All model names here are internal HSC codenames. None of them were released outside the cooperative. == Matrix == | Model | Params | forager 2.0 | forager 2.3 | forager 3.0 | forager 3.2 | forager 3.4 | Notes | |---|---|---|---|---|---|---|---| | Basalt-1 | 340M | ✔ | ✔ | ✔ (legacy loader) | ✘ | ✘ | loader removed in 3.2 | | Basalt-2 | 1.1B | — | ✔ | ✔ | ✔ | ✔ | production model 2014–2016 | | Larkspur-S | 60M | ✔ | ✔ | ✔ | ✔ | ✔ (deprecated) | classifier only | | Cinder-XL | 6B | — | — | ✘ | ⚠ | ⚠ | never left the `queen02` colony; OOM on 3 of 4 forager hosts | ⚠ = runs with `inference.split=2` only. See Distributed Inference Notes. == Runtime requirements == | Runtime | Loader | Max model bytes | Notes | |---|---|---|---| | forager 2.x | `mload1` | 2 GiB | single host only | | forager 3.0 | `mload2` | 8 GiB | split loading, see Distributed Inference Notes#Split loading | | forager 3.2+ | `mload2` | 16 GiB | `mload1` removed, breaking Basalt-1 | == Model notes == ; Basalt-1 : 2012. Trained on the internal document corpus. Retired when the loader was removed; nobody noticed for four months (Known Agent Bugs#Basalt-1 silent fallback). ; Basalt-2 : 2014. The workhorse. `model.summarize` in the Tool Registry is Basalt-2. ; Larkspur-S : 2013. Tiny classifier used for routing. Deprecated 2015-08 in favour of a rule list that was faster and, embarrassingly, more accurate. ; Cinder-XL : 2015. Experimental. The Distributed Inference Notes page is mostly about making this one fit. == Verification procedure == 1. Check out the runtime tag on `build.hm.internal`. 2. Run `antc test --model --runtime ` (see Legacy Toolchain). 3. Record the result in the test log with the commit hash. 4. Update this table. Do not update the table without a log entry — this has happened, and the ✔ for Basalt-1 on 3.0 was one of those. == See also == - Model Compatibility Matrix/Test Log 2014 - Distributed Inference Notes - [attachment: model-matrix-2016-01.json]