run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } ysh-builtin-meta: spec test case results

Results for ysh-builtin-meta.test.sh

statusoshosh-cpp
pass 88
FAIL 11
total99
caseoshosh-cppdescription
0pass pass runproc
1pass pass runproc typed args
2pass pass pp asdl
3pass pass pp asdl can handle an object cycle
4pass pass pp line supports BashArray, BashAssoc
5FAIL FAIL pp gc-stats
detailsdetails
6pass pass pp cell
7pass pass pp cell on indexed array with hole
8pass pass pp proc
16 passed, 0 OK, 0 not implemented, 0 BUG, 1 failed, 0 timeouts, 0 cases skipped
1 failed under osh

Details on runs that didn't PASS

osh5 pp gc-stats

[osh stdout] Expected '', got 'TODO\n'

stdout:
TODO
stderr:
osh-cpp5 pp gc-stats

[osh-cpp stdout] Expected '', got 'TODO\n'

stdout:
TODO
stderr: