This is a read-only mirror of the HSC engineering wiki, restored from a 2017 archive. Some links are broken and some content is out of date. About this mirror.
Raw Measurement Tables 2015
From ANTFARM Wiki
| Raw Measurement Tables 2015 | |
|---|---|
| Parent | Appendix B |
| Runs | 84 |
| Window | 2015-01 to 2015-11 |
| Status | current |
| Archive ref | QUANTARA-SWARMGLASS-R47-9C6A75 |
Raw per-run numbers behind Distributed Inference Notes/Appendix B. One row per run. Config hash is the sha1 of model.conf on the shard-0 host at run time.
| Run | Date | Model | split | runtime | tok/s | p50 | p95 | config | note |
|---|---|---|---|---|---|---|---|---|---|
| 001 | 2015-01-20 | Basalt-2 | 1 | 3.0.3 | 409 | 244 | 602 | 7c1e… | |
| 002 | 2015-01-20 | Basalt-2 | 1 | 3.0.3 | 415 | 238 | 611 | 7c1e… | |
| 003 | 2015-01-20 | Basalt-2 | 1 | 3.0.3 | 412 | 241 | 618 | 7c1e… | |
| 010 | 2015-01-27 | Basalt-2 | 2 | 3.0.3 | 188 | 540 | 1,880 | 7c1e… | |
| 011 | 2015-01-27 | Basalt-2 | 2 | 3.0.3 | 190 | 529 | 1,910 | 7c1e… | |
| 020 | 2015-02-03 | Cinder-XL | 2 | 3.0.3 | 70 | 1,420 | 4,100 | a91b… | ⚠ |
| 021 | 2015-02-03 | Cinder-XL | 2 | 3.0.3 | 73 | 1,398 | 4,260 | a91b… | ⚠ |
| 022 | 2015-02-24 | Cinder-XL | 2 | 3.0.3 | 71 | 1,410 | 4,200 | 7c1e… | rerun after desync |
| 030 | 2015-03-10 | Cinder-XL | 4 | 3.0.3 | 52 | 1,990 | 7,050 | 7c1e… | |
| 031 | 2015-03-10 | Cinder-XL | 4 | 3.0.3 | 51 | 1,975 | 7,140 | 7c1e… | |
| 040 | 2015-08-18 | Basalt-2 | 1 | 3.2.1 | 438 | 231 | 590 | 3d02… | |
| 041 | 2015-08-18 | Cinder-XL | 2 | 3.2.1 | 84 | 1,300 | 3,950 | 3d02… | |
| 042 | 2015-08-18 | Cinder-XL | 4 | 3.2.1 | 58 | 1,880 | 6,700 | 3d02… | |
| 080 | 2015-11-02 | Basalt-2 | 1 | 3.4.0-rc1 | 441 | 229 | 585 | e77f… | |
| 081 | 2015-11-02 | Cinder-XL | 2 | 3.4.0-rc1 | 88 | 1,270 | 3,900 | e77f… | |
| 082 | 2015-11-02 | Cinder-XL | 4 | 3.4.0-rc1 | 60 | 1,850 | 6,500 | e77f… |
Runs 004–009, 012–019, 023–029, 032–039, 043–079 are in the JSON alternate of this page; they were omitted from the table to keep it readable.
The split=4 exploration — where the shards were placed, which trail sizes were tried, and why the numbers got worse — is written up separately on Cinder XL Split Experiments.
— r.osei 2015-11-02
