]> granicus.if.org Git - re2c/commit
projects / re2c / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: 7af5d43) | patch
Lexer: unified token length calculation.
authorUlya Trofimovich <skvadrik@gmail.com>
Fri, 14 Aug 2015 12:57:58 +0000 (13:57 +0100)
committerUlya Trofimovich <skvadrik@gmail.com>
Fri, 14 Aug 2015 12:57:58 +0000 (13:57 +0100)
commit48c067251c0554a961938ac018147042ae2fff3d
tree677c9a8e71cc61bf137c48cecd015a8b1692f484tree | snapshot
parent7af5d437e49878ea4e8de73a02d99ad4e5751933commit | diff
Lexer: unified token length calculation.

Token length equals the difference between two pointers: YYCURSOR
value on the moment of successful match and YYCURSOR value when
entering DFA. This difference should be nonnegative and fit buffer
size.
re2c/bootstrap/src/parse/scanner_lex.cc diff | blob | history
re2c/src/codegen/output.cc diff | blob | history
re2c/src/codegen/output.h diff | blob | history
re2c/src/parse/scanner.h diff | blob | history
re2c/src/parse/scanner_lex.re diff | blob | history
Unnamed repository; edit this file 'description' to name the repository.