run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } ysh-cmd-lang: spec test case results

Results for ysh-cmd-lang.test.sh

status	ysh	ysh-cpp
pass	1	1
FAIL	1	1
total	2	2

case	ysh	ysh-cpp	description
0	pass	pass	Redirect with if, case, while, for
1	FAIL	FAIL	Redirect failure is either fatal or can be checked
	details	details

2 passed, 0 OK, 0 not implemented, 0 BUG, 1 failed, 0 timeouts, 0 cases skipped
1 failed under osh

Details on runs that didn't PASS

ysh

1 Redirect failure is either fatal or can be checked

[ysh status] Expected 0, got 1

stdout:

stderr:

  { echo 1; echo 2 } > /
                     ^
[ stdin ]:1: Can't open '/': Is a directory
[ stdin ]:1: I/O error applying redirect: Is a directory
[ stdin ]:1: errexit PID 26475: command.Redirect failed with status 1

ysh-cpp

1 Redirect failure is either fatal or can be checked

[ysh-cpp status] Expected 0, got 1

stdout:

stderr:

  { echo 1; echo 2 } > /
                     ^
[ stdin ]:1: Can't open '/': Is a directory
[ stdin ]:1: I/O error applying redirect: Is a directory
[ stdin ]:1: errexit PID 26493: command.Redirect failed with status 1