OILS / doc / ref / toc-ysh.md View on Github | oilshell.org

354 lines, 311 significant
1---
2title: YSH Table of Contents
3all_docs_url: ..
4css_files: ../../web/base.css ../../web/manual.css ../../web/ref-index.css
5preserve_anchor_case: yes
6---
7
8<div class="doc-ref-header">
9
10[Oils Reference](index.html) &mdash;
11[OSH](toc-osh.html) | **YSH Table of Contents** | [Data Notation](toc-data.html)
12
13</div>
14
15[YSH]($xref) is shell with a familiar syntax, JSON-like data structures, good
16error handling, and more.
17
18<!--
19<div class="custom-toc">
20
21[type-method](#type-method) &nbsp;
22[builtin-func](#builtin-func) &nbsp;
23[builtin-cmd](#builtin-cmd) &nbsp;
24[front-end](#front-end) &nbsp;
25[cmd-lang](#cmd-lang) &nbsp;
26[ysh-cmd](#ysh-cmd) &nbsp;
27[expr-lang](#expr-lang) &nbsp;
28[word-lang](#word-lang) &nbsp;
29[mini-lang](#mini-lang) &nbsp;
30[option](#option) &nbsp;
31[special-var](#special-var) &nbsp;
32[plugin](#plugin)
33
34</div>
35-->
36
37<h2 id="type-method">
38 Types and Methods <a class="group-link" href="chap-type-method.html">type-method</a>
39</h2>
40
41```chapter-links-type-method
42 [Atom Types] Null Bool
43 [Number Types] Int Float
44 [Str] X find() replace()
45 trim() trimStart() trimEnd()
46 startsWith() endsWith()
47 upper() lower()
48 search() leftMatch()
49 [List] List/append() pop() extend() indexOf()
50 X insert() X remove() reverse()
51 [Dict] keys() values() X get() X erase()
52 X inc() X accum()
53 [Range]
54 [Eggex]
55 [Match] group() start() end()
56 X groups() X groupDict()
57 [Place] setValue()
58 [Code Types] Expr Command
59 BuiltinFunc BoundFunc
60X [Func] name() location() toJson()
61X [Proc] name() location() toJson()
62X [Module] name() filename()
63 [IO] X eval() X captureStdout()
64 promptVal()
65 X time() X strftime()
66 X glob()
67X [Guts] heapId()
68```
69
70<h2 id="builtin-func">
71 Builtin Functions <a class="group-link" href="chap-builtin-func.html">builtin-func</a>
72</h2>
73
74```chapter-links-builtin-func
75 [Values] len() func/type()
76 [Conversions] bool() int() float() str() list() dict()
77 X runes() X encodeRunes()
78 X bytes() X encodeBytes()
79 [Str] X strcmp() X split() shSplit()
80 [List] join()
81 [Float] X isinf() X isnan()
82 [Collections] X copy() X deepCopy()
83 [Word] glob() maybe()
84 [Serialize] toJson() fromJson()
85 toJson8() fromJson8()
86X [J8 Decode] J8.Bool() J8.Int() ...
87 [Pattern] _group() _start() _end()
88 [Introspection] shvarGet() getVar() evalExpr()
89 [Hay Config] parseHay() evalHay()
90X [Hashing] sha1dc() sha256()
91```
92
93<!-- ideas
94X [Codecs] quoteUrl() quoteHtml() quoteSh() quoteC()
95 quoteMake() quoteNinja()
96X [Wok] _field()
97-->
98
99<h2 id="builtin-cmd">
100 Builtin Commands <a class="group-link" href="chap-builtin-cmd.html">builtin-cmd</a>
101</h2>
102
103<!-- linkify_stop_col is 42 -->
104
105```chapter-links-builtin-cmd_42
106 [Memory] cmd/append Add elements to end of array
107 pp asdl cell X gc-stats line proc
108 [Handle Errors] error error 'failed' (status=2)
109 try Run with errexit, set _error
110 failed Test if _error.code !== 0
111 boolstatus Enforce 0 or 1 exit status
112 [Shell State] ysh-cd ysh-shopt compatible, and takes a block
113 shvar Temporary modify global settings
114 ctx Share and update a temporary "context"
115 push-registers Save registers like $?, PIPESTATUS
116 [Modules] runproc Run a proc; use as main entry point
117 module guard against duplicate 'source'
118 is-main false when sourcing a file
119 use change first word lookup
120 [I/O] ysh-read flags --all, -0
121 ysh-echo no -e -n with simple_echo
122 write Like echo, with --, --sep, --end
123 fork forkwait Replace & and (), and takes a block
124 fopen Open multiple streams, takes a block
125 X dbg Only thing that can be used in funcs
126 [Hay Config] hay haynode For DSLs and config files
127 [Completion] compadjust compexport
128 [Data Formats] json read write
129 json8 read write
130X [Testing] assert takes an expression
131```
132
133<h2 id="stdlib">
134 Standard Library<a class="group-link" href="chap-stdlib.html">stdlib</a>
135</h2>
136
137<!-- linkify_stop_col is 42 -->
138
139```chapter-links-stdlib_42
140 [math] abs()
141 max() min()
142 X round()
143 sum()
144 [list] all() any()
145 repeat()
146 [args] parser Parse command line arguments
147 flag
148 arg
149 rest
150 parseArgs()
151 [yblocks] yb-capture
152 yb-capture-2
153X [Lines] slurp-by combine adjacent lines into cells
154X [Awk] each-line --j8 --max-jobs (Str, Template, Block) - xargs
155 each-row --max-jobs (Str, Template, Block) - xargs
156 each-word xargs-like splitting, similar to IFS too
157 split-by (str=\n, ifs=':', pattern=/s+/)
158 if-split-by
159 chop alias for split-by (pattern=/s+/)
160 must-match (/ <capture d+> </capture w+> /)
161 if-match
162X [Table Create] table --by-row --by-col (&place); construct/parse a table
163 table/cols cols name age - cols name:Str age:Int
164 types type Str Int
165 attr attr units - secs
166 row emit row
167 table cat concatenate TSV8
168 table align to ssv8
169 table tabify to tsv8
170 table header (cols = :|name age|, types = :|Str Int|, units = :|- secs|)
171 table slice e.g. slice (1, -1) slice (5, 7)
172 table to-tsv lose type info, and error on \t in cells
173X [Table Ops] where subset of rows; dplyr filter()
174 pick subset of columns ('select' taken by shell)
175 mutate transmute [average = count / sum] - drop the ones that are used?
176 rename (bytes='bytes', path='filename')
177 group-by add a column with a group ID [ext]
178 sort-by sort by columns; dplyr arrange() [ext]
179 summary count, sum, histogram, any, all, reduce(), etc. [ext]
180```
181
182<!--
183Naming ideas:
184
185X [External Lang] BEGIN END when (awk)
186 rule (make) each (xargs) fs (find)
187-->
188
189<h2 id="front-end">
190 Front End <a class="group-link" href="chap-front-end.html">front-end</a>
191</h2>
192
193```chapter-links-front-end
194 [Usage] oils-usage ysh-usage
195 [Lexing] ascii-whitespace [ \t\r\n]
196 doc-comment ### multiline-command ...
197 [Tools] cat-em
198```
199
200<h2 id="cmd-lang">
201 Command Language <a class="group-link" href="chap-cmd-lang.html">cmd-lang</a>
202</h2>
203
204<!-- linkify_stop_col is 33 -->
205
206```chapter-links-cmd-lang_33
207 [YSH Simple] typed-arg json write (x)
208 lazy-expr-arg assert [42 === x]
209 block-arg cd /tmp { echo $PWD }; cd /tmp (; ; blockexpr)
210 [YSH Cond] ysh-case case (x) { *.py { echo 'python' } }
211 ysh-if if (x > 0) { echo }
212 [YSH Iter] ysh-while while (x > 0) { echo }
213 ysh-for for i, item in (mylist) { echo }
214```
215
216<h2 id="ysh-cmd">
217 YSH Command Language Keywords <a class="group-link" href="chap-ysh-cmd.html">ysh-cmd</a>
218</h2>
219
220```chapter-links-ysh-cmd_33
221 [Assignment] const var Declare variables
222 setvar setvar a[i] = 42
223 setglobal setglobal d.key = 'foo'
224 [Expression] equal = = 1 + 2*3
225 call call mylist->append(42)
226 [Definitions] proc proc p (s, ...rest) {
227 typed proc p (; typed, ...rest; n=0; b) {
228 func func f(x; opt1, opt2) { return (x + 1) }
229 ysh-return return (myexpr)
230```
231
232<h2 id="expr-lang">
233 Expression Language and Assignments <a class="group-link" href="chap-expr-lang.html">expr-lang</a>
234</h2>
235
236<!-- linkify_stop_col is 33 -->
237
238```chapter-links-expr-lang_33
239 [Assignment] assign =
240 aug-assign += -= *= /= **= //= %=
241 &= |= ^= <<= >>=
242 [Literals] atom-literal true false null
243 int-literal 42 65_536 0xFF 0o755 0b10
244 float-lit 3.14 1.5e-10
245 X num-suffix 42 K Ki M Mi G Gi T Ti / ms us
246 ysh-string "x is $x" $"x is $x" r'[a-z]\n'
247 u'line\n' b'byte \yff'
248 triple-quoted """ $""" r''' u''' b'''
249 str-template ^"$a and $b" for Str::replace()
250 list-literal ['one', 'two', 3] :| unquoted words |
251 dict-literal {name: 'bob'} {a, b}
252 range 1 .. n+1
253 block-expr ^(echo $PWD)
254 expr-literal ^[1 + 2*3]
255 X expr-sub $[myobj]
256 X expr-splice @[myobj]
257 [Operators] op-precedence Like Python
258 concat s1 ++ s2, L1 ++ L2
259 ysh-equals === !== ~== is, is not
260 ysh-in in, not in
261 ysh-compare < <= > >= (numbers only)
262 ysh-logical not and or
263 ysh-arith + - * / // % **
264 ysh-bitwise ~ & | ^ << >>
265 ysh-ternary '+' if x >= 0 else '-'
266 ysh-index s[0] mylist[3] mydict['key']
267 ysh-attr mydict.key
268 ysh-slice a[1:-1] s[1:-1]
269 func-call f(x, y; ...named)
270 thin-arrow mylist->pop()
271 fat-arrow mystr => startsWith('prefix')
272 match-ops ~ !~ ~~ !~~
273 [Eggex] re-literal / d+ ; re-flags ; ERE /
274 re-primitive %zero 'sq'
275 class-literal [c a-z 'abc' @str_var \\ \xFF \u0100]
276 named-class dot digit space word d s w
277 re-repeat d? d* d+ d{3} d{2,4}
278 re-compound seq1 seq2 alt1|alt2 (expr1 expr2)
279 re-capture <capture d+ as name: int>
280 re-splice Subpattern @subpattern
281 re-flags reg_icase reg_newline
282 X re-multiline ///
283```
284
285<h2 id="word-lang">
286 Word Language <a class="group-link" href="chap-word-lang.html">word-lang</a>
287</h2>
288
289<!-- linkify_stop_col is 33 -->
290
291```chapter-links-word-lang_33
292 [Quotes] ysh-string "x is $x" $"x is $x" r'[a-z]\n'
293 u'line\n' b'byte \yff'
294 triple-quoted """ $""" r''' u''' b'''
295 X tagged-str "<span id=$x>"html
296 [Substitutions] expr-sub echo $[42 + a[i]]
297 expr-splice echo @[split(x)]
298 var-splice @myarray @ARGV
299 command-sub @(split command)
300 [Formatting] X ysh-printf ${x %.3f}
301 X ysh-format ${x|html}
302```
303
304<h2 id="mini-lang">
305 Other Mini Languages <a class="group-link" href="chap-mini-lang.html">mini-lang</a>
306</h2>
307
308<!-- linkify_stop_col is 33 -->
309
310```chapter-links-mini-lang_33
311 [Patterns] glob-pat *.py
312 [Other Sublang] braces {alice,bob}@example.com
313```
314
315<h2 id="option">
316 Global Shell Options <a class="group-link" href="chap-option.html">option</a>
317</h2>
318
319```chapter-links-option
320 [Groups] strict:all ysh:upgrade ysh:all
321 [YSH Details] opts-redefine opts-internal
322```
323
324<h2 id="special-var">
325 Special Variables <a class="group-link" href="chap-special-var.html">special-var</a>
326</h2>
327
328```chapter-links-special-var
329 [YSH Vars] ARGV X ENV X _ESCAPE
330 _this_dir
331 [YSH Status] _error
332 _pipeline_status _process_sub_status
333 [YSH Tracing] SHX_indent SHX_punct SHX_pid_str
334 [YSH read] _reply
335 [History] YSH_HISTFILE
336 [Oils VM] OILS_VERSION
337 OILS_GC_THRESHOLD OILS_GC_ON_EXIT
338 OILS_GC_STATS OILS_GC_STATS_FD
339 LIB_YSH
340 [Float] NAN INFINITY
341```
342
343<!-- ideas
344X [Wok] _filename _line _line_num
345X [Builtin Sub] _buffer
346-->
347
348<h2 id="plugin">
349 Plugins and Hooks <a class="group-link" href="chap-plugin.html">plugin</a>
350</h2>
351
352```chapter-links-plugin
353 [YSH] renderPrompt()
354```