run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } loop: spec test case results

Results for loop.test.sh

status	osh	osh-cpp
pass	26	26
ok	1	1
total	27	27

case	osh	osh-cpp	description
0	pass	pass	implicit for loop
1	pass	pass	empty for loop (has "in")
2	pass	pass	for loop with invalid identifier
3	pass	pass	the word 'in' can be the loop variable
4	pass	pass	Tilde expansion within for loop
5	pass	pass	Brace Expansion within Array
6	pass	pass	using loop var outside loop
7	pass	pass	continue
8	pass	pass	break
9	ok	ok	dynamic control flow (KNOWN INCOMPATIBILITY)
	details	details
10	pass	pass	while in while condition
11	pass	pass	while in pipe
12	pass	pass	while in pipe with subshell
13	pass	pass	until loop
14	pass	pass	continue at top level
15	pass	pass	continue in subshell
16	pass	pass	continue in subshell aborts with errexit
17	pass	pass	bad arg to break
18	pass	pass	too many args to continue
19	pass	pass	break in condition of loop
20	pass	pass	break in condition of nested loop
21	pass	pass	return within eval
22	pass	pass	break/continue within eval
23	pass	pass	break/continue within source
24	pass	pass	top-level break/continue/return (without strict_control_flow)
25	pass	pass	multi-level break with argument
26	pass	pass	multi-level continue

52 passed, 2 OK, 0 not implemented, 0 BUG, 0 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

osh

9 dynamic control flow (KNOWN INCOMPATIBILITY)

stdout:

1
2
3

stderr:

    $b
    ^~
[ stdin ]:4: 'break' not found (OILS-ERR-100)
    $b
    ^~
[ stdin ]:4: 'break' not found (OILS-ERR-100)
    $b
    ^~
[ stdin ]:4: 'break' not found (OILS-ERR-100)

osh-cpp

9 dynamic control flow (KNOWN INCOMPATIBILITY)

stdout:

1
2
3

stderr:

    $b
    ^~
[ stdin ]:4: 'break' not found (OILS-ERR-100)
    $b
    ^~
[ stdin ]:4: 'break' not found (OILS-ERR-100)
    $b
    ^~
[ stdin ]:4: 'break' not found (OILS-ERR-100)