run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } builtin-getopts: spec test case results

Results for builtin-getopts.test.sh

status	osh	osh-cpp
pass	21	21
BUG	3	3
total	24	24

case	osh	osh-cpp	description
0	pass	pass	getopts empty
1	pass	pass	getopts sees unknown arg
2	pass	pass	getopts three invocations
3	pass	pass	getopts resets OPTARG
4	pass	pass	Basic getopts invocation
5	pass	pass	getopts with invalid variable name
6	pass	pass	getopts with invalid flag
7	pass	pass	getopts with with -
8	pass	pass	getopts missing required argument
9	pass	pass	getopts doesn't look for flags after args
10	pass	pass	getopts with explicit args
11	pass	pass	OPTIND
12	BUG	BUG	OPTIND after multiple getopts with same spec
	details	details
13	BUG	BUG	OPTIND after multiple getopts with different spec
	details	details
14	BUG	BUG	OPTIND narrowed down
	details	details
15	pass	pass	Getopts parses the function's arguments
16	pass	pass	Local OPTIND
17	pass	pass	two flags: -ab
18	pass	pass	flag and arg: -c10
19	pass	pass	More Smooshing 1
20	pass	pass	More Smooshing 2
21	pass	pass	OPTIND should be >= 1 (regression)
22	pass	pass	getopts bug #1523
23	pass	pass	More regression for #1523

42 passed, 0 OK, 0 not implemented, 6 BUG, 0 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

osh	12 OPTIND after multiple getopts with same spec stdout: 1 - - 4 4 stderr:
osh-cpp	12 OPTIND after multiple getopts with same spec stdout: 1 - - 4 4 stderr:
osh	13 OPTIND after multiple getopts with different spec stdout: . 2 - - 5 5 stderr:
osh-cpp	13 OPTIND after multiple getopts with different spec stdout: . 2 - - 5 5 stderr:
osh	14 OPTIND narrowed down stdout: a=1 b= c= d=1 e=E stderr:
osh-cpp	14 OPTIND narrowed down stdout: a=1 b= c= d=1 e=E stderr: