1 | Benchmarks
|
2 | ==========
|
3 |
|
4 | The benchmarks in this directory can run:
|
5 |
|
6 | - on one machine, during in the Soil continuous build
|
7 | - on two machines, during the release
|
8 |
|
9 | The directory structure is different in each case.
|
10 |
|
11 | ## Dirs for One Machine
|
12 |
|
13 | ```
|
14 | _tmp/osh-runtime/
|
15 | files.html
|
16 | index.html
|
17 | raw/ # TODO: should be raw.no-host.*
|
18 | gc-6.txt
|
19 | gc-7.txt
|
20 | no-host.2022-12-29__00-33-00.files/
|
21 | files-0/
|
22 | STDOUT.txt
|
23 | files-1/
|
24 | STDOUT.txt
|
25 | ...
|
26 | no-host.2022-12-29__00-33-00.times.tsv
|
27 | stage1/
|
28 | gc_stats.tsv
|
29 | provenance.tsv
|
30 | times.tsv
|
31 | stage2/
|
32 | details.schema.tsv
|
33 | details.tsv
|
34 | elapsed.schema.tsv
|
35 | elapsed.tsv
|
36 |
|
37 | _tmp/provenance/
|
38 | no-host.2022-12-29__00-33-00.provenance.tsv
|
39 | no-host.2022-12-29__00-33-00.provenance.txt
|
40 | host-id/
|
41 | no-host-3063f657/
|
42 | cpuinfo.txt
|
43 | HASH.txt
|
44 | ...
|
45 | shell-id/
|
46 | bash-9af8f89f/
|
47 | HASH.txt
|
48 | index.html
|
49 | version.txt
|
50 | dash-9ff48631/
|
51 | dpkg-version.txt
|
52 | HASH.txt
|
53 | index.html
|
54 | osh-0d29d4d3
|
55 | git-branch.txt
|
56 | ...
|
57 | ```
|
58 |
|
59 |
|
60 | ## Dirs for Two Machines
|
61 |
|
62 | ```
|
63 | ../benchmark-data/
|
64 | osh-runtime/
|
65 | no-host.2022-12-29__00-33-00.provenance.tsv
|
66 | no-host.2022-12-29__00-33-00.provenance.txt
|
67 | no-host.2022-12-29__00-33-00.times.tsv
|
68 | no-host.2022-12-29__00-33-00.files/
|
69 | osh-parser/
|
70 | ...
|
71 |
|
72 | shell-id/
|
73 | host-id/
|
74 |
|
75 | ```
|
76 |
|
77 | TODO:
|
78 |
|
79 | ```
|
80 | ../benchmark-data/
|
81 | osh-runtime/
|
82 | raw.no-host.2022-12-29__00-33-00/
|
83 | provenance.tsv # raw
|
84 | times.tsv # raw
|
85 | gc_stats.tsv # collected
|
86 | files/ # raw
|
87 |
|
88 | raw.no-host.2022-12-30__00-00-00/
|
89 |
|
90 | osh-parser/
|
91 | ...
|
92 |
|
93 | shell-id/
|
94 | host-id/
|
95 | ```
|
96 |
|
97 | Philosophy to aim for:
|
98 |
|
99 | - We save the raw/ data in git.
|
100 | - The derived stage1/ stage2/ dirs are stored in the .wwz file on the web
|
101 | server.
|
102 | - See `devtools/release.sh compress-benchmarks`
|
103 |
|