toysh-posix () { run-file toysh-posix "$@" } run-file () { local spec_name=$1; shift; sh-spec spec/$spec_name.test.sh --compare-shells --oils-bin-dir $PWD/bin "$@" } toysh-posix: spec test case results

Results for toysh-posix.test.sh

statusbashdashmkshzshyashosh
pass 181617101917
ok 234412
N-I 010000
BUG 221820
FAIL 000003
total222222222222
casebashdashmkshzshyashoshdescription
0pass ok pass pass ok pass Fatal error
detailsdetails
1BUG pass pass ok pass ok setting readonly var (bash is only one where it's non-fatal)
detailsdetailsdetails
2ok pass pass ok pass ok readonly with temp binding
detailsdetailsdetails
3BUG ok ok pass pass pass Failed redirect in assignment, vs. export
detailsdetailsdetails
4ok pass pass pass pass FAIL Evaluation order of redirect and ${undef?error}
detailsdetails
5pass pass pass pass pass pass Function def in pipeline
6pass pass pass BUG pass pass dynamic glob - http://landley.net/notes.html#08-05-2020
details
7pass pass pass pass pass pass no shebang
8pass N-I pass BUG pass pass IFS
detailsdetails
9pass ok ok pass pass pass shift is fatal at top level?
detailsdetails
10pass pass pass pass pass pass var and func - http://landley.net/notes.html#19-03-2020
11pass BUG pass BUG pass pass IFS - http://landley.net/notes.html#05-03-2020
detailsdetails
12pass pass pass pass pass pass for loop parsing - http://landley.net/notes.html#04-03-2020
13pass pass pass pass pass pass Parsing $(( ))
14pass pass pass BUG pass FAIL IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)
detailsdetails
15pass pass pass BUG pass FAIL IFS 2 (TODO: osh)
detailsdetails
16pass pass pass BUG pass pass IFS 3
details
17pass BUG BUG BUG BUG pass IFS 4
detailsdetailsdetailsdetails
18pass pass pass BUG BUG pass IFS 5
detailsdetails
19pass pass ok ok pass pass Can't parse extra }
detailsdetails
20pass pass ok ok pass pass Command Sub Syntax Error
detailsdetails
21pass pass pass pass pass pass Pipeline - http://landley.net/notes-2019.html#16-12-2019
97 passed, 16 OK, 1 not implemented, 15 BUG, 3 failed, 0 timeouts, 0 cases skipped
3 failed under osh

Details on runs that didn't PASS

dash0 Fatal error

stdout: 
stderr: 


dash: 1: a: bc

yash0 Fatal error


stdout: 


stderr: 


yash: a: bc

bash1 setting readonly var (bash is only one where it's non-fatal)


stdout: 


status=1

stderr: 


bash: line 2: abc: readonly variable

zsh1 setting readonly var (bash is only one where it's non-fatal)


stdout: 


stderr: 


zsh: read-only variable: abc

osh1 setting readonly var (bash is only one where it's non-fatal)


stdout: 


stderr: 


  abc=def
  ^~~~
[ stdin ]:2: fatal: Can't assign to readonly value 'abc'

bash2 readonly with temp binding


stdout: 


one
status=0
hello

stderr: 


bash: line 2: abc: readonly variable
bash: line 5: /does/not/exist: No such file or directory

zsh2 readonly with temp binding


stdout: 


stderr: 


zsh: read-only variable: abc

osh2 readonly with temp binding


stdout: 


one
status=0
hello

stderr: 


  echo potato < /does/not/exist || echo hello
              ^
[ stdin ]:5: Can't open '/does/not/exist': No such file or directory
[ stdin ]:5: I/O error applying redirect: No such file or directory

bash3 Failed redirect in assignment, vs. export


stdout: 


abc=def
abc=def

stderr: 


bash: line 1: /does/not/exist1: No such file or directory
bash: line 4: /does/not/exist2: No such file or directory

dash3 Failed redirect in assignment, vs. export


stdout: 


abc=

stderr: 


dash: 1: cannot create /does/not/exist1: Directory nonexistent
dash: 4: cannot create /does/not/exist2: Directory nonexistent

mksh3 Failed redirect in assignment, vs. export


stdout: 


abc=

stderr: 


mksh: <stdin>[1]: can't create /does/not/exist1: No such file or directory
mksh: <stdin>[4]: can't create /does/not/exist2: No such file or directory

bash4 Evaluation order of redirect and ${undef?error}


stdout: 


stderr: 


rm: cannot remove '_tmp': Is a directory
bash: line 1: x: bc
bash: line 1: a: bc

osh4 Evaluation order of redirect and ${undef?error}


[osh stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
  X=${x?bc} > walrus
      ^
[ -c flag ]:1: fatal: Var x is unset: 'bc'
  >walrus echo ${a?bc}
                 ^
[ -c flag ]:1: fatal: Var a is unset: 'bc'

zsh6 dynamic glob - http://landley.net/notes.html#08-05-2020


stdout: 


*

stderr: 


rm: cannot remove '_tmp': Is a directory
zsh: no matches found: **.?z

dash8 IFS


stdout: 


stderr: 


dash: 1: Bad substitution

zsh8 IFS


stdout: 


agd
{x,y,z}="${x,y,z}"

stderr: 


dash9 shift is fatal at top level?


stdout: 


stderr: 


dash: 1: shift: can't shift that many

mksh9 shift is fatal at top level?


stdout: 


stderr: 


mksh: shift: nothing to shift

dash11 IFS - http://landley.net/notes.html#05-03-2020


stdout: 


=one=
=abc=
=d f=
=ghi=
---
=one=
=two=

stderr: 


zsh11 IFS - http://landley.net/notes.html#05-03-2020


stdout: 


stderr: 


chicken: one= not found

zsh14 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


stdout: 


stderr: 


zsh: xabcxx= not found

osh14 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


[osh stdout] Expected '==\n=abc=\n==\n==\n=abc=\n=def=\n==\n', got '==\n=abc=\n==\n=abc=\n=def=\n'



stdout: 


==
=abc=
==
=abc=
=def=

stderr: 


zsh15 IFS 2 (TODO: osh)


stdout: 


stderr: 


zsh: command not found: this
zsh: x   abc   def   = not found

osh15 IFS 2 (TODO: osh)


[osh stdout] Expected '=x=\n=abc=\n=def=\n==\n', got '=x=\n=abc=\n=def=\n'



stdout: 


=x=
=abc=
=def=

stderr: 


  this one appears different between osh and bash
  ^~~~
[ stdin ]:1: 'this' not found (OILS-ERR-100)

zsh16 IFS 3


stdout: 


onextwoxxthree

stderr: 


dash17 IFS 4


stdout: 


= =
=x=
-=-
-=-

stderr: 


mksh17 IFS 4


stdout: 


= =
=x=
-=-
-=-

stderr: 


zsh17 IFS 4


stdout: 


= =

stderr: 


cc: x= not found

yash17 IFS 4


stdout: 


= =
--
--
=x=
-=-
-=-

stderr: 


zsh18 IFS 5


stdout: 


stderr: 


cc: = not found

yash18 IFS 5


stdout: 


--
--
--
--
--
==

stderr: 


mksh19 Can't parse extra }


stdout: 


stderr: 


123: syntax error: '}' unexpected

zsh19 Can't parse extra }


stdout: 


stderr: 


zsh:1: parse error near `}'

mksh20 Command Sub Syntax Error


stdout: 


stderr: 


mksh: <stdin>[1]: syntax error: ')' unexpected

zsh20 Command Sub Syntax Error


stdout: 


stderr: 


zsh: parse error near `true'
zsh: parse error in command substitution