bugs () { run-file bugs "$@" } run-file () { local spec_name=$1; shift; sh-spec spec/$spec_name.test.sh --compare-shells --oils-bin-dir $PWD/bin "$@" } bugs: spec test case results

Results for bugs.test.sh

statusbashdashmkshzshashosh
pass 181014151123
ok 175471
N-I 072160
BUG 503400
total242424242424
casebashdashmkshzshashoshdescription
0pass pass pass pass pass pass echo keyword
1pass pass pass pass pass pass if/else
2pass N-I pass pass N-I pass Turn an array into an integer.
detailsdetails
3pass ok ok pass ok pass assign readonly -- one line
detailsdetailsdetails
4BUG ok ok pass ok pass assign readonly -- multiple lines
detailsdetailsdetailsdetails
5pass ok ok pass ok pass assign readonly -- multiple lines -- set -o posix
detailsdetailsdetails
6pass ok pass ok ok pass unset readonly -- one line
detailsdetailsdetails
7pass ok pass ok ok pass unset readonly -- multiple lines
detailsdetailsdetails
8pass pass ok ok pass pass First word like foo$x() and foo$[1+2] (regression)
detailsdetails
9pass pass ok BUG pass pass Function names
detailsdetails
10ok N-I pass ok pass ok file with NUL byte
detailsdetailsdetailsdetails
11BUG N-I pass N-I N-I pass fastlex: PS1 format string that's incomplete / with NUL byte
detailsdetailsdetailsdetails
12pass pass pass pass pass pass 'echo' and printf fail on writing to full disk
13pass pass BUG BUG pass pass other builtins fail on writing to full disk
detailsdetails
14pass pass pass pass pass pass subshell while running a script (regression)
15pass N-I N-I pass N-I pass for loop (issue #1446)
detailsdetailsdetails
16pass N-I N-I pass N-I pass for loop 2 (issue #1446)
detailsdetailsdetails
17pass pass pass pass pass pass autoconf word split (#1449)
18pass pass pass pass pass pass autoconf arithmetic - relaxed eval_unsafe_arith (#1450)
19BUG ok BUG BUG ok pass command execution $(echo 42 | tee PWNED) not allowed
detailsdetailsdetailsdetailsdetails
20BUG ok pass pass ok pass process sub <(echo 42 | tee PWNED) not allowed
detailsdetailsdetails
21BUG N-I BUG BUG N-I pass unset doesn't allow command execution
detailsdetailsdetailsdetailsdetails
22pass pass pass pass pass pass printf integer size bug
23pass N-I pass pass N-I pass (( status bug
detailsdetails
91 passed, 25 OK, 16 not implemented, 12 BUG, 0 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

dash2 Turn an array into an integer.

stdout: 
stderr: 


dash: 1: Syntax error: "(" unexpected

ash2 Turn an array into an integer.


stdout: 


stderr: 


ash: syntax error: unexpected "("

dash3 assign readonly -- one line


stdout: 


stderr: 


dash: 1: x: is read only

mksh3 assign readonly -- one line


stdout: 


stderr: 


mksh: <stdin>[1]: read-only: x

ash3 assign readonly -- one line


stdout: 


stderr: 


ash: x: is read only

bash4 assign readonly -- multiple lines


stdout: 


hi

stderr: 


bash: line 2: x: readonly variable

dash4 assign readonly -- multiple lines


stdout: 


stderr: 


dash: 2: x: is read only

mksh4 assign readonly -- multiple lines


stdout: 


stderr: 


mksh: <stdin>[2]: read-only: x

ash4 assign readonly -- multiple lines


stdout: 


stderr: 


ash: x: is read only

dash5 assign readonly -- multiple lines -- set -o posix


stdout: 


stderr: 


dash: 1: set: Illegal option -o posix

mksh5 assign readonly -- multiple lines -- set -o posix


stdout: 


stderr: 


mksh: <stdin>[3]: read-only: x

ash5 assign readonly -- multiple lines -- set -o posix


stdout: 


stderr: 


ash: set: line 1: illegal option -o posix
ash: x: is read only

dash6 unset readonly -- one line


stdout: 


stderr: 


dash: 1: unset: x: is read only

zsh6 unset readonly -- one line


stdout: 


stderr: 


zsh: read-only variable: x

ash6 unset readonly -- one line


stdout: 


stderr: 


ash: unset: line 1: x: is read only

dash7 unset readonly -- multiple lines


stdout: 


stderr: 


dash: 2: unset: x: is read only

zsh7 unset readonly -- multiple lines


stdout: 


stderr: 


zsh: read-only variable: x

ash7 unset readonly -- multiple lines


stdout: 


stderr: 


ash: unset: line 2: x: is read only

mksh8 First word like foo$x() and foo$[1+2] (regression)


stdout: 


stderr: 


mksh: <stdin>[1]: syntax error: '"z"' unexpected

zsh8 First word like foo$x() and foo$[1+2] (regression)


stdout: 


stderr: 


zsh: unknown file attribute: z

mksh9 Function names


stdout: 


stderr: 


mksh: <stdin>[1]: foo$x: invalid function name

zsh9 Function names


stdout: 


stderr: 


bash10 file with NUL byte


stdout: 


stderr: 


tmp.sh: tmp.sh: cannot execute binary file

dash10 file with NUL byte


stdout: 


stderr: 


tmp.sh: 1: tmp.sh: -e: not found

zsh10 file with NUL byte


stdout: 


one echo two

stderr: 


osh10 file with NUL byte


stdout: 


one

stderr: 


bash11 fastlex: PS1 format string that's incomplete / with NUL byte


stdout: 


stderr: 


dash11 fastlex: PS1 format string that's incomplete / with NUL byte


stdout: 


stderr: 


dash: 4: Bad substitution

zsh11 fastlex: PS1 format string that's incomplete / with NUL byte


stdout: 


stderr: 


zsh: bad substitution

ash11 fastlex: PS1 format string that's incomplete / with NUL byte


stdout: 


stderr: 


ash: syntax error: bad substitution

mksh13 other builtins fail on writing to full disk


stdout: 


status=0
status=0

stderr: 


zsh13 other builtins fail on writing to full disk


stdout: 


status=0
status=0

stderr: 


dash15 for loop (issue #1446)


stdout: 


stderr: 


mksh15 for loop (issue #1446)


stdout: 


stderr: 


ash15 for loop (issue #1446)


stdout: 


stderr: 


dash16 for loop 2 (issue #1446)


stdout: 


stderr: 


mksh16 for loop 2 (issue #1446)


stdout: 


stderr: 


ash16 for loop 2 (issue #1446)


stdout: 


stderr: 


bash19 command execution $(echo 42 | tee PWNED) not allowed


stdout: 


1
42

stderr: 


dash19 command execution $(echo 42 | tee PWNED) not allowed


stdout: 


stderr: 


dash: 4: Illegal number: a[$(echo 42 | tee PWNED)]=1

mksh19 command execution $(echo 42 | tee PWNED) not allowed


stdout: 


1
42

stderr: 


zsh19 command execution $(echo 42 | tee PWNED) not allowed


stdout: 


1
42

stderr: 


ash19 command execution $(echo 42 | tee PWNED) not allowed


stdout: 


stderr: 


ash: arithmetic syntax error

bash20 process sub <(echo 42 | tee PWNED) not allowed


stdout: 


NOPE

stderr: 


bash: line 4: <(echo 42 | tee PWNED): syntax error: operand expected (error token is "<(echo 42 | tee PWNED)")

dash20 process sub <(echo 42 | tee PWNED) not allowed


stdout: 


stderr: 


dash: 4: Illegal number: a[<(echo 42 | tee PWNED)]=1

ash20 process sub <(echo 42 | tee PWNED) not allowed


stdout: 


stderr: 


ash: arithmetic syntax error

bash21 unset doesn't allow command execution


stdout: 


len=1
len=0
PWNED
0

stderr: 


dash21 unset doesn't allow command execution


stdout: 


stderr: 


dash: 1: typeset: not found
dash: 2: Syntax error: "(" unexpected

mksh21 unset doesn't allow command execution


stdout: 


len=1
len=0
PWNED
0

stderr: 


zsh21 unset doesn't allow command execution


stdout: 


len=1
len=1
PWNED
0

stderr: 


zsh: a: assignment to invalid subscript range

ash21 unset doesn't allow command execution


stdout: 


stderr: 


ash: typeset: not found
ash: syntax error: unexpected "("

dash23 (( status bug


stdout: 


stderr: 


ash23 (( status bug


stdout: 


stderr: