This is a read-only mirror of the HSC engineering wiki, restored from a 2017 archive. Some links are broken and some content is out of date. About this mirror.

Model Compatibility Matrix

From ANTFARM Wiki

Jump to: navigation, search
Model Compatibility Matrix
Maintainerr.osei
Runtimesforager 2.x, 3.x
ModelsBasalt-1, Basalt-2, Larkspur-S, Cinder-XL
Statuscurrent
Archive refQUANTARA-SWARMGLASS-R39-86AC61

Contents

[hide]

This matrix records which in-house models were validated against which forager runtime. "Validated" means the test log shows a green run; it does not mean anyone used the combination in production.

All model names here are internal HSC codenames. None of them were released outside the cooperative.

[edit] Matrix

ModelParamsforager 2.0forager 2.3forager 3.0forager 3.2forager 3.4Notes
Basalt-1340M✔ (legacy loader)loader removed in 3.2
Basalt-21.1Bproduction model 2014–2016
Larkspur-S60M✔ (deprecated)classifier only
Cinder-XL6Bnever left the queen02 colony; OOM on 3 of 4 forager hosts

⚠ = runs with inference.split=2 only. See Distributed Inference Notes.

[edit] Runtime requirements

RuntimeLoaderMax model bytesNotes
forager 2.xmload12 GiBsingle host only
forager 3.0mload28 GiBsplit loading, see Distributed Inference Notes
forager 3.2+mload216 GiBmload1 removed, breaking Basalt-1

[edit] Model notes

Basalt-1
2012. Trained on the internal document corpus. Retired when the loader was removed; nobody noticed for four months (Known Agent Bugs).
Basalt-2
2014. The workhorse. model.summarize in the Tool Registry is Basalt-2.
Larkspur-S
2013. Tiny classifier used for routing. Deprecated 2015-08 in favour of a rule list that was faster and, embarrassingly, more accurate.
Cinder-XL
2015. Experimental. The Distributed Inference Notes page is mostly about making this one fit.

[edit] Verification procedure

  1. Check out the runtime tag on build.hm.internal.
  2. Run antc test --model <name> --runtime <tag> (see Legacy Toolchain).
  3. Record the result in the test log with the commit hash.
  4. Update this table. Do not update the table without a log entry — this has happened, and the ✔ for Basalt-1 on 3.0 was one of those.

[edit] See also

Revision 38 · r.osei, mkerrigan · history · alternates: json yaml txt
Personal tools