run-file () { local spec_name=$1; shift; local spec_file=spec/$spec_name.test.sh; local suite; suite=$(test/sh_spec.py --print-spec-suite $spec_file); local spec_subdir; case $suite in osh) spec_subdir='osh-cpp' ;; ysh) spec_subdir='ysh-cpp' ;; *) die "Invalid suite $suite" ;; esac; local base_dir=_tmp/spec/$spec_subdir; mkdir -v -p $base_dir; sh-spec $spec_file --timeout 10 --oils-bin-dir $PWD/bin --oils-cpp-bin-dir $REPO_ROOT/_bin/cxx-asan --tsv-output $base_dir/${spec_name}.tsv "$@" } hay: spec test case results

Results for hay.test.sh

statusoshosh-cpp
pass 2121
FAIL 22
total2323
caseoshosh-cppdescription
0pass pass use bin
1pass pass use dialect
2pass pass hay builtin usage
3pass pass hay reset
4pass pass hay eval can't be nested
5pass pass hay names at top level
6pass pass Parsing Nested Attributes nodes (bug fix)
7pass pass hay eval Attr node, and JSON
8pass pass hay eval shell node, and JSON
9pass pass _hay() register
10pass pass haynode builtin can define nodes
11pass pass haynode: usage errors (name or block required)
12pass pass haynode: shell nodes require block args; attribute nodes don't
13pass pass hay eval with shopt -s oil:all
14pass pass Attr block with duplicate names
15pass pass Scope of Variables Inside Hay Blocks
16pass pass hay define and then an error
17pass pass parseHay()
18pass pass Code Blocks: parseHay() then shvar _DIALECT= { evalHay() }
19pass pass evalHay() usage
20pass pass Attribute / Data Blocks (package-manager)
21FAIL FAIL Typed Args to Hay Node
detailsdetails
22FAIL FAIL OSH and hay (dynamic parsing)
detailsdetails
42 passed, 0 OK, 0 not implemented, 0 BUG, 2 failed, 0 timeouts, 0 cases skipped
2 failed under osh

Details on runs that didn't PASS

osh21 Typed Args to Hay Node

[osh status] Expected 0, got 1

stdout: 
stderr: 


  when NAME (x > 0) {
             ^
[ stdin ]:6: fatal: Undefined variable 'x'

osh-cpp21 Typed Args to Hay Node


[osh-cpp status] Expected 0, got 1



stdout: 


stderr: 


  when NAME (x > 0) {
             ^
[ stdin ]:6: fatal: Undefined variable 'x'

osh22 OSH and hay (dynamic parsing)



[osh stdout]
Expected "backticks\neval\nTYPE TASK\nCODE         \n    echo `echo task backticks`\n    eval 'echo task eval'\n  ___\n"
Got      ''


[osh status] Expected 0, got 2



stdout: 


stderr: 


    b[1]=1
    ^~
/home/uke/oil/spec/testdata/config/osh-hay.osh:14: Use var/setvar to assign in YSH
  source $REPO_ROOT/spec/testdata/config/osh-hay.osh
  ^~~~~~
[ stdin ]:1: errexit PID 25165: command.Simple failed with status 2

osh-cpp22 OSH and hay (dynamic parsing)



[osh-cpp stdout]
Expected "backticks\neval\nTYPE TASK\nCODE         \n    echo `echo task backticks`\n    eval 'echo task eval'\n  ___\n"
Got      ''


[osh-cpp status] Expected 0, got 2



stdout: 


stderr: 


    b[1]=1
    ^~
/home/uke/oil/test/../spec/testdata/config/osh-hay.osh:14: Use var/setvar to assign in YSH
  source $REPO_ROOT/spec/testdata/config/osh-hay.osh
  ^~~~~~
[ stdin ]:1: errexit PID 25175: command.Simple failed with status 2