docs: Document ASYNC/AWAIT tokens (issue #25580)

Initial patch by SilentGhost

diff --git a/Doc/library/token.rst b/Doc/library/token.rst
index 88fb38bc1dd1aedf2c6f0a6492be058457132f8b..c6bfa354d9a71f551ed1cd3429ddf7f00574b1d0 100644 (file)
--- a/Doc/library/token.rst
+++ b/Doc/library/token.rst
@@ -97,10 +97,16 @@ The token constants are:
           RARROW
           ELLIPSIS
           OP
+          AWAIT
+          ASYNC
           ERRORTOKEN
           N_TOKENS
           NT_OFFSET
 
+   .. versionchanged:: 3.5
+      Added :data:`AWAIT` and :data:`ASYNC` tokens. Starting with
+      Python 3.7, "async" and "await" will be tokenized as :data:`NAME`
+      tokens, and :data:`AWAIT` and :data:`ASYNC` will be removed.
 
 .. seealso::