From: Aivar Annamaa Date: Wed, 13 Sep 2017 03:24:03 +0000 (+0300) Subject: bpo-31394: Clarify documentation about token type attribute (GH-3469) X-Git-Tag: v3.7.0a1~64 X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=5f8fbf917ebf2398aa75a1f271617e2e50ab7c88;p=python bpo-31394: Clarify documentation about token type attribute (GH-3469) Make it clear that Ellipsis tokens also have type attribute set to token.OP. --- diff --git a/Doc/library/tokenize.rst b/Doc/library/tokenize.rst index cd27a101a8..e6ddc05792 100644 --- a/Doc/library/tokenize.rst +++ b/Doc/library/tokenize.rst @@ -16,8 +16,8 @@ implemented in Python. The scanner in this module returns comments as tokens as well, making it useful for implementing "pretty-printers," including colorizers for on-screen displays. -To simplify token stream handling, all :ref:`operators` and :ref:`delimiters` -tokens are returned using the generic :data:`~token.OP` token type. The exact +To simplify token stream handling, all :ref:`operator ` and :ref:`delimiter ` +tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact type can be determined by checking the ``exact_type`` property on the :term:`named tuple` returned from :func:`tokenize.tokenize`.