Argh, I read it wrong. Reverted 64036 and added a clarifying remark.

diff --git a/Doc/library/tokenize.rst b/Doc/library/tokenize.rst
index efe9eb93db27cea45cb32ba00a8eb3fe267e0933..36f58386665bdee85c8b51561d79f68d5034e190 100644 (file)
--- a/Doc/library/tokenize.rst
+++ b/Doc/library/tokenize.rst
@@ -27,8 +27,8 @@ The primary entry point is a :term:`generator`:
    string; a 2-tuple ``(srow, scol)`` of ints specifying the row and column
    where the token begins in the source; a 2-tuple ``(erow, ecol)`` of ints
    specifying the row and column where the token ends in the source; and the
-   line on which the token was found.  The line passed is the *physical* line,
-   that is, continuation lines are not handled specially.
+   line on which the token was found.  The line passed (the last tuple item) is
+   the *logical* line; continuation lines are included.
 
    .. versionadded:: 2.2