| 1 | Benchmarks
|
| 2 | ==========
|
| 3 |
|
| 4 | The benchmarks in this directory can run:
|
| 5 |
|
| 6 | - on one machine, during in the Soil continuous build
|
| 7 | - on two machines, during the release
|
| 8 |
|
| 9 | The directory structure is different in each case.
|
| 10 |
|
| 11 | ## Dirs for One Machine
|
| 12 |
|
| 13 | ```
|
| 14 | _tmp/osh-runtime/
|
| 15 | files.html
|
| 16 | index.html
|
| 17 | raw/ # TODO: should be raw.no-host.*
|
| 18 | gc-6.txt
|
| 19 | gc-7.txt
|
| 20 | no-host.2022-12-29__00-33-00.files/
|
| 21 | files-0/
|
| 22 | STDOUT.txt
|
| 23 | files-1/
|
| 24 | STDOUT.txt
|
| 25 | ...
|
| 26 | no-host.2022-12-29__00-33-00.times.tsv
|
| 27 | stage1/
|
| 28 | gc_stats.tsv
|
| 29 | provenance.tsv
|
| 30 | times.tsv
|
| 31 | stage2/
|
| 32 | details.schema.tsv
|
| 33 | details.tsv
|
| 34 | elapsed.schema.tsv
|
| 35 | elapsed.tsv
|
| 36 |
|
| 37 | _tmp/provenance/
|
| 38 | no-host.2022-12-29__00-33-00.provenance.tsv
|
| 39 | no-host.2022-12-29__00-33-00.provenance.txt
|
| 40 | host-id/
|
| 41 | no-host-3063f657/
|
| 42 | cpuinfo.txt
|
| 43 | HASH.txt
|
| 44 | ...
|
| 45 | shell-id/
|
| 46 | bash-9af8f89f/
|
| 47 | HASH.txt
|
| 48 | index.html
|
| 49 | version.txt
|
| 50 | dash-9ff48631/
|
| 51 | dpkg-version.txt
|
| 52 | HASH.txt
|
| 53 | index.html
|
| 54 | osh-0d29d4d3
|
| 55 | git-branch.txt
|
| 56 | ...
|
| 57 | ```
|
| 58 |
|
| 59 |
|
| 60 | ## Dirs for Two Machines
|
| 61 |
|
| 62 | ```
|
| 63 | ../benchmark-data/
|
| 64 | osh-runtime/
|
| 65 | no-host.2022-12-29__00-33-00.provenance.tsv
|
| 66 | no-host.2022-12-29__00-33-00.provenance.txt
|
| 67 | no-host.2022-12-29__00-33-00.times.tsv
|
| 68 | no-host.2022-12-29__00-33-00.files/
|
| 69 | osh-parser/
|
| 70 | ...
|
| 71 |
|
| 72 | shell-id/
|
| 73 | host-id/
|
| 74 |
|
| 75 | ```
|
| 76 |
|
| 77 | TODO:
|
| 78 |
|
| 79 | ```
|
| 80 | ../benchmark-data/
|
| 81 | osh-runtime/
|
| 82 | raw.no-host.2022-12-29__00-33-00/
|
| 83 | provenance.tsv # raw
|
| 84 | times.tsv # raw
|
| 85 | gc_stats.tsv # collected
|
| 86 | files/ # raw
|
| 87 |
|
| 88 | raw.no-host.2022-12-30__00-00-00/
|
| 89 |
|
| 90 | osh-parser/
|
| 91 | ...
|
| 92 |
|
| 93 | shell-id/
|
| 94 | host-id/
|
| 95 | ```
|
| 96 |
|
| 97 | Philosophy to aim for:
|
| 98 |
|
| 99 | - We save the raw/ data in git.
|
| 100 | - The derived stage1/ stage2/ dirs are stored in the .wwz file on the web
|
| 101 | server.
|
| 102 | - See `devtools/release.sh compress-benchmarks`
|
| 103 |
|