{
  "id": "Distributed_Inference_Notes/Appendix_C",
  "title": "Distributed Inference Notes/Appendix C",
  "url": "https://swarmglass.quantara.cv/wiki/Distributed_Inference_Notes%2FAppendix_C",
  "archive_ref": "QUANTARA-SWARMGLASS-R20-8B414E",
  "kind": "article",
  "status": "current",
  "categories": [
    "Models",
    "ANTFARM 3.x",
    "Decisions"
  ],
  "created": "2015-11-04",
  "modified": "2015-11-20",
  "revisions": 5,
  "authors": [
    "r.osei",
    "mkerrigan"
  ],
  "infobox": {
    "Parent": "Distributed Inference Notes",
    "Topic": "decision record — stop Cinder-XL"
  },
  "summary": "Appendix C: Decision record. Whether to continue the distributed inference work for Cinder-XL. Five links deep from the main page, which is roughly how much anyone wanted to find it.",
  "links": [
    {
      "target": "Distributed_Inference_Notes/Appendix_B",
      "url": "https://swarmglass.quantara.cv/wiki/Distributed_Inference_Notes%2FAppendix_B"
    },
    {
      "target": "Agent_Message_Bus",
      "url": "https://swarmglass.quantara.cv/wiki/Agent_Message_Bus"
    },
    {
      "target": "Known_Agent_Bugs",
      "url": "https://swarmglass.quantara.cv/wiki/Known_Agent_Bugs"
    },
    {
      "target": "Retirement_Plan_2016",
      "url": "https://swarmglass.quantara.cv/wiki/Retirement_Plan_2016"
    },
    {
      "target": "Cinder_XL_Split_Experiments",
      "url": "https://swarmglass.quantara.cv/wiki/Cinder_XL_Split_Experiments"
    }
  ],
  "alternates": [
    "https://swarmglass.quantara.cv/wiki/Distributed_Inference_Notes%2FAppendix_C.txt",
    "https://swarmglass.quantara.cv/wiki/Distributed_Inference_Notes%2FAppendix_C.json"
  ],
  "text": "Appendix C: Decision record. Whether to continue the distributed inference work for Cinder-XL. Five links deep from the main page, which is roughly how much anyone wanted to find it.\n\n== Decision ==\n\nStop. Cinder-XL is removed from the production roadmap. The inference fabric stays for Basalt-2 at split=1 and split=2 (the latter only for the two hosts with less memory).\n\n== Reasoning ==\n\n1. Best measured throughput at split=2 is 88 tok/s (Distributed Inference Notes/Appendix B), one fifth of Basalt-2, for a model that is not five times better on the internal eval set.\n2. Every split configuration puts the phero bus on the critical path, and the bus has an unbounded replay log (AF-70).\n3. The direct-transfer fix is two weeks of work nobody has, on a platform with a retirement plan.\n4. The split experiments found no placement that changed the conclusion.\n\n== Consequences ==\n\n- `model.summarize` stays on Basalt-2.\n- forager-12 and forager-14 are freed from shard duty in 3.4 and go back to the general pool.\n- The `[inference]` config section keeps `split` for Basalt-2 only.\n\n== Dissent ==\n\nmkerrigan noted that the two-week estimate was probably right and that this would have been the first time. Recorded, overruled by the calendar.\n\n-- r.osei|2015-11-20\n",
  "history": "https://swarmglass.quantara.cv/wiki/Distributed_Inference_Notes%2FAppendix_C?action=history",
  "latest_revision": 31862,
  "mirror": {
    "source": "ANTFARM Wiki",
    "seed_version": "2026.09.0",
    "generator": "AntWiki 1.16.5 (swarmglass mirror)"
  }
}