run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } builtin-bash: spec test case results

Results for builtin-bash.test.sh

statusoshosh-cpp
pass 88
FAIL 44
total1212
caseoshosh-cppdescription
0pass pass help
1pass pass bad help topic
2pass pass mapfile
3pass pass readarray (synonym for mapfile)
4pass pass mapfile (array name): arr
5FAIL FAIL mapfile (delimiter): -d delim
detailsdetails
6FAIL FAIL mapfile (delimiter): -d '' (null-separated)
detailsdetails
7pass pass mapfile (truncate delim): -t
8pass pass mapfile -t doesn't remove \r
9FAIL FAIL mapfile (store position): -O start
detailsdetails
10FAIL FAIL mapfile (input range): -s start -n count
detailsdetails
11pass pass mapfile / readarray stdin TODO: Fix me.
16 passed, 0 OK, 0 not implemented, 0 BUG, 4 failed, 0 timeouts, 0 cases skipped
4 failed under osh

Details on runs that didn't PASS

osh5 mapfile (delimiter): -d delim

[osh stdout] Expected 'n=3\n[1:]\n[3:]\n[5:]\n', got 'n=0\n[]\n'

stdout: 
n=0
[]
stderr: 
    mapfile -d : arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -d
osh-cpp5 mapfile (delimiter): -d delim

[osh-cpp stdout] Expected 'n=3\n[1:]\n[3:]\n[5:]\n', got 'n=0\n[]\n'

stdout: 
n=0
[]
stderr: 
    mapfile -d : arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -d
osh6 mapfile (delimiter): -d '' (null-separated)

[osh stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got 'n=0\n[]\n'

stdout: 
n=0
[]
stderr: 
    mapfile -d '' arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -d
osh-cpp6 mapfile (delimiter): -d '' (null-separated)

[osh-cpp stdout] Expected 'n=3\n[1]\n[3]\n[5]\n', got 'n=0\n[]\n'

stdout: 
n=0
[]
stderr: 
    mapfile -d '' arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -d
osh9 mapfile (store position): -O start

[osh stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got 'n=3\n[x]\n[y]\n[z]\n'

stdout: 
n=3
[x]
[y]
[z]
stderr: 
    mapfile -O 2 -t arr
            ^~
[ stdin ]:4: 'mapfile' doesn't accept flag -O
osh-cpp9 mapfile (store position): -O start

[osh-cpp stdout] Expected 'n=5\n[x]\n[y]\n[a0]\n[a1]\n[a2]\n', got 'n=3\n[x]\n[y]\n[z]\n'

stdout: 
n=3
[x]
[y]
[z]
stderr: 
    mapfile -O 2 -t arr
            ^~
[ stdin ]:4: 'mapfile' doesn't accept flag -O
osh10 mapfile (input range): -s start -n count

[osh stdout] Expected 'n=3\n[a5]\n[a6]\n[a7]\n', got 'n=0\n[]\n'

stdout: 
n=0
[]
stderr: 
    mapfile -s 5 -n 3 -t arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -s
osh-cpp10 mapfile (input range): -s start -n count

[osh-cpp stdout] Expected 'n=3\n[a5]\n[a6]\n[a7]\n', got 'n=0\n[]\n'

stdout: 
n=0
[]
stderr: 
    mapfile -s 5 -n 3 -t arr
            ^~
[ stdin ]:3: 'mapfile' doesn't accept flag -s