2 # Comments should be ignored
4 -option key # end of line comment
5 +reset imbedded#hash # <- not a comment, thought this is
7 This\ is' a 'single" token"
9 And\\\ \''even '\'\""more \""complex
11 "Backslash chars \n are returned as is"
12 'regardless \n of quoting'
14 'Single quote escapes'
17 "Double quote escapes"
21 \\ '\' "\\" # NOTE that backslash in single quotes are literial!
23 'Space Character Escapes'
26 'Empty Tokens, using quotes'
29 "Unicode charcaters are handled"
40 "Last Token before EOF"