run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } ysh-bugs: spec test case results

Results for ysh-bugs.test.sh

statusyshysh-cpp
pass 99
FAIL 22
total1111
caseyshysh-cppdescription
0pass pass fastlex: NUL byte not allowed inside char literal #' '
1pass pass fastlex: NUL byte inside shebang line
2pass pass Tea keywords don't interfere with YSH expressions
3pass pass Catch AttributeError
4pass pass Command sub paren parsing bug (#1387)
5pass pass More Command sub paren parsing
6pass pass don't execute empty command
7FAIL FAIL Do && || with YSH constructs make sense/
detailsdetails
8pass pass shvar then replace - bug #1986 context manager crash
9pass pass Parsing crash - bug #2003
10FAIL FAIL proc with IFS= read -r line - dynamic scope - issue #2012
detailsdetails
18 passed, 0 OK, 0 not implemented, 0 BUG, 2 failed, 0 timeouts, 0 cases skipped
2 failed under osh

Details on runs that didn't PASS

ysh7 Do && || with YSH constructs make sense/

[ysh stdout] Expected '', got '(List) [42]\n(Int) 42\n(Int) 42\n'

stdout:
(List)   [42]
(Int)   42
(Int)   42
stderr:
ysh-cpp7 Do && || with YSH constructs make sense/

[ysh-cpp stdout] Expected '', got '(List) [42]\n(Int) 42\n(Int) 42\n'

stdout:
(List)   [42]
(Int)   42
(Int)   42
stderr:
ysh10 proc with IFS= read -r line - dynamic scope - issue #2012

[ysh stdout] Expected 'zz\nyy\n', got 'zz\n'
[ysh status] Expected 0, got 1

stdout:
zz
stderr:
    write $line
          ^~~~~
[ stdin ]:8: fatal: Undefined variable 'line'
  echo yy | p-ifs
            ^~~~~
[ stdin ]:14: errexit PID 25587: command.Pipeline failed with status 1
ysh-cpp10 proc with IFS= read -r line - dynamic scope - issue #2012

[ysh-cpp stdout] Expected 'zz\nyy\n', got 'zz\n'
[ysh-cpp status] Expected 0, got 1

stdout:
zz
stderr:
    write $line
          ^~~~~
[ stdin ]:8: fatal: Undefined variable 'line'
  echo yy | p-ifs
            ^~~~~
[ stdin ]:14: errexit PID 25605: command.Pipeline failed with status 1