From: Skip Montanaro Date: Wed, 28 Feb 2001 22:05:41 +0000 (+0000) Subject: added description of NL token X-Git-Tag: v2.1b1~114 X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=58177b9975171060ed29248fc4a984a036f579ff;p=python added description of NL token --- diff --git a/Doc/lib/libtokenize.tex b/Doc/lib/libtokenize.tex index 82d2e68014..3c5e8ef0fe 100644 --- a/Doc/lib/libtokenize.tex +++ b/Doc/lib/libtokenize.tex @@ -36,9 +36,12 @@ The scanner is exposed by a single function: All constants from the \refmodule{token} module are also exported from -\module{tokenize}, as is one additional token type value that might be +\module{tokenize}, as are two additional token type values that might be passed to the \var{tokeneater} function by \function{tokenize()}: \begin{datadesc}{COMMENT} Token value used to indicate a comment. \end{datadesc} +\begin{datadesc}{NL} + Token value used to indicate a newline. +\end{datadesc}