]> granicus.if.org Git - python/log
python
7 years ago[3.6] bpo-30470: Deprecate invalid ctypes call protection on Windows. (GH-1810) ...
Mariatta [Sat, 27 May 2017 14:58:25 +0000 (07:58 -0700)]
[3.6] bpo-30470: Deprecate invalid ctypes call protection on Windows. (GH-1810) (GH-1833)

Calling Ctypes functions is deprecated in 3.6.2 and will be removed in 3.7.
(cherry picked from commit f931fd1c2ad969db72460d3ab41e3d1a4a62c371)

7 years ago[3.6] bpo-29960 _random.Random corrupted on exception in setstate(). … (#1287)
Mariatta [Sat, 27 May 2017 14:20:24 +0000 (07:20 -0700)]
[3.6] bpo-29960 _random.Random corrupted on exception in setstate(). … (#1287)

(cherry picked from commit 9616a82e7802241a4b74cf7ae38d43c37bf66e48)

7 years ago[3.6] bpo-30398: Add a docstring for re.error. (GH-1647) (#1830)
Serhiy Storchaka [Sat, 27 May 2017 13:37:40 +0000 (16:37 +0300)]
[3.6] bpo-30398: Add a docstring for re.error. (GH-1647) (#1830)

Also document that some attributes may be None.
(cherry picked from commit 12d6b5d)

7 years ago[3.6] Fix the signature of JSONDecodeError (no end parameter). (GH-1827) (#1828)
Serhiy Storchaka [Sat, 27 May 2017 13:37:11 +0000 (16:37 +0300)]
[3.6] Fix the signature of JSONDecodeError (no end parameter). (GH-1827) (#1828)

Unlikely to the simplejson module, json.JSONDecodeError doesn't accept the end argument.
(cherry picked from commit 5becf38)

7 years ago[3.6] bpo-30414: multiprocessing.Queue._feed do not break from main loop on exc ...
Antoine Pitrou [Thu, 25 May 2017 14:57:46 +0000 (16:57 +0200)]
[3.6] bpo-30414: multiprocessing.Queue._feed do not break from main loop on exc (GH-1683) (#1815)

* bpo-30414: multiprocesing.Queue._feed do not break from main loop on exc

Queue background running thread was not handling exceptions correctly.
Any exception occurred inside thread (putting unpickable object) cause
feeder to finish running. After that every message put into queue is
silently ignored.

* bpo-30414: multiprocesing.Queue._feed do not break from main loop on exc

Queue background running thread was not handling exceptions correctly.
Any exception occurred inside thread (putting unpickable object) cause
feeder to finish running. After that every message put into queue is
silently ignored.
(cherry picked from commit bc50f03db4f58c869b78e98468e374d7e61f1227)

7 years ago[3.6] bpo-29943: Do not replace the function PySlice_GetIndicesEx() with a macro...
Serhiy Storchaka [Thu, 25 May 2017 12:32:08 +0000 (15:32 +0300)]
[3.6] bpo-29943: Do not replace the function PySlice_GetIndicesEx() with a macro (GH-1049) (#1813)

if Py_LIMITED_API is not defined.
(cherry picked from commit 49a9059)

7 years ago[3.6] bpo-29104: Fixed parsing backslashes in f-strings. (GH-490) (#1812)
Serhiy Storchaka [Thu, 25 May 2017 11:18:55 +0000 (14:18 +0300)]
[3.6] bpo-29104: Fixed parsing backslashes in f-strings. (GH-490) (#1812)

(cherry picked from commit 0cd7a3f)

7 years ago[3.6] bpo-30160: Clarify intended usage of wfile (gh-1300) (GH-1793)
Zachary Ware [Wed, 24 May 2017 21:11:01 +0000 (16:11 -0500)]
[3.6] bpo-30160: Clarify intended usage of wfile (gh-1300) (GH-1793)

The library does not enforce compliance with the HTTP protocol,
so violations are not technically disallowed. Extend the stream's
description to avoid suggesting that intentional protocol violations are
not supported.
(cherry picked from commit a083c8e)

7 years agobpo-30394: Fix a socket leak in smtplib.SMTP.__init__() (#1700) (#1790)
Stéphane Wirtel [Wed, 24 May 2017 18:59:06 +0000 (20:59 +0200)]
bpo-30394: Fix a socket leak in smtplib.SMTP.__init__() (#1700) (#1790)

7 years ago[3.6] bpo-30376: Update outdated WindowObject references (GH-1630) (#1746)
Kushal Das [Tue, 23 May 2017 16:57:04 +0000 (09:57 -0700)]
[3.6] bpo-30376: Update outdated WindowObject references (GH-1630) (#1746)

(cherry picked from commit 93fc20b73eea3da0b6305aaee951e5dd22d5c408)

7 years ago[3.6] call remove_done_callback in finally section (GH-1688) (#1755)
Łukasz Langa [Tue, 23 May 2017 07:36:23 +0000 (00:36 -0700)]
[3.6] call remove_done_callback in finally section (GH-1688) (#1755)

(cherry picked from commit 21b3e04c13212b29e8c35ffc36eed8603fde08f4)

7 years agoFix spelling mistakes in tkinter.py (#1751)
Vijay Kumar [Tue, 23 May 2017 06:14:02 +0000 (11:44 +0530)]
Fix spelling mistakes in tkinter.py (#1751)

Ran the docstrings through spell checker, and fixed spelling issues.

7 years ago[3.6] bpo-21056: Document return type of next method of csv reader (GH-146) (#1749)
Mariatta [Tue, 23 May 2017 05:27:02 +0000 (22:27 -0700)]
[3.6] bpo-21056: Document return type of next method of csv reader (GH-146) (#1749)

(cherry picked from commit d618c8c6d31b9b288f8a070417683974eb98e3ba)

7 years ago[3.6] Add --with-assertions configure flag to enable C assertions(GH-1731) (#1739)
T. Wouters [Tue, 23 May 2017 05:25:17 +0000 (07:25 +0200)]
[3.6] Add --with-assertions configure flag to enable C assertions(GH-1731) (#1739)

Defaults to 'no', but as before assertions are implied by --with-pydebug..
(cherry picked from commit ddbfa2c35b298a56f0b813656745bca9cb7334f1)

7 years ago[3.6] bpo-23894: make lib2to3 recognize f-strings (GH-1733) (#1737)
Łukasz Langa [Tue, 23 May 2017 05:23:29 +0000 (22:23 -0700)]
[3.6] bpo-23894: make lib2to3 recognize f-strings (GH-1733) (#1737)

Note: this doesn't unpack f-strings into the underlying JoinedStr AST.

Ideally we'd fully implement JoinedStr here but given its additional
complexity, I think this is worth bandaiding as is. This unblocks tools like
https://github.com/google/yapf to format 3.6 syntax using f-strings.
(cherry picked from commit 1b9530c536664276ce866ae602ce04adce0810e1)

7 years ago[3.6] bpo-30395 _PyGILState_Reinit deadlock fix (GH-1734) (#1740)
Łukasz Langa [Tue, 23 May 2017 05:23:05 +0000 (22:23 -0700)]
[3.6] bpo-30395 _PyGILState_Reinit deadlock fix (GH-1734) (#1740)

head_lock could be held by another thread when fork happened. We should
reset it to avoid deadlock.
(cherry picked from commit f82c951d1c5416f3550d544e50ff5662d3836e73)

7 years ago[3.6] Make rb'' strings work in lib2to3 (GH-1724) (#1730)
Łukasz Langa [Mon, 22 May 2017 23:35:15 +0000 (16:35 -0700)]
[3.6] Make rb'' strings work in lib2to3 (GH-1724) (#1730)

This partially solves bpo-23894.
(cherry picked from commit 0c4aca54dcf0c54f299c78aa71fe8f48ff04f9d9)

7 years ago[3.6] bpo-30372: Clarify that '__builtins__' is a CPython Implementation detail ...
Mariatta [Mon, 22 May 2017 21:36:19 +0000 (14:36 -0700)]
[3.6] bpo-30372: Clarify that '__builtins__' is a CPython Implementation detail (GH-1725) (GH-1727)

(cherry picked from commit 43c8a9e39bb2d4f25ed7ae17a55f34e375d1868b)

7 years agobpo-30003: Fix handling escape characters in HZ codec (#1556) (#1719)
Xiang Zhang [Mon, 22 May 2017 17:03:00 +0000 (01:03 +0800)]
bpo-30003: Fix handling escape characters in HZ codec (#1556) (#1719)

7 years ago[3.6] Fix typos in multiple `.rst` files (GH-1668) (#1702)
delirious-lettuce [Sun, 21 May 2017 21:26:01 +0000 (15:26 -0600)]
[3.6] Fix typos in multiple `.rst` files (GH-1668) (#1702)

(cherry picked from commit 3378b2062c7fbb77a9b5e6d315d6b94160fac69a)

7 years ago[3.6] bpo-30415: Add new tests for the fnmatch module. (GH-1684) (#1694)
Serhiy Storchaka [Sun, 21 May 2017 07:35:39 +0000 (10:35 +0300)]
[3.6] bpo-30415: Add new tests for the fnmatch module. (GH-1684) (#1694)

(cherry picked from commit 8175547)

7 years agobpo-29976: urllib.parse clarify '' in scheme values. (GH-984) (GH-1692)
Senthil Kumaran [Sun, 21 May 2017 06:23:03 +0000 (23:23 -0700)]
bpo-29976: urllib.parse clarify '' in scheme values. (GH-984) (GH-1692)

(cherry picked from commit 906f5330b9c9a74cad1cf27fddaf77e99dff9edd)

7 years ago[3.6] bpo-27945: Fixed various segfaults with dict. (GH-1657) (#1677)
Serhiy Storchaka [Sat, 20 May 2017 10:06:26 +0000 (13:06 +0300)]
[3.6] bpo-27945: Fixed various segfaults with dict. (GH-1657) (#1677)

Based on patches by Duane Griffin and Tim Mitchell.
(cherry picked from commit 753bca3934a7618a4fa96e107ad1c5c18633a683)

7 years ago[3.6] bpo-25794: Fix `type.__setattr__()` for non-interned attribute names. (GH-1652...
Serhiy Storchaka [Sat, 20 May 2017 07:23:31 +0000 (10:23 +0300)]
[3.6] bpo-25794: Fix `type.__setattr__()` for non-interned attribute names. (GH-1652) (#1673)

Based on patch by Eryk Sun.
(cherry picked from commit d896985bb2de49046f9b6879e906d1e4db255e23)

7 years agobpo-27103: regrtest disables -W if -R is used (#1651) (#1656)
Victor Stinner [Thu, 18 May 2017 20:36:51 +0000 (13:36 -0700)]
bpo-27103: regrtest disables -W if -R is used (#1651) (#1656)

Workaround for a regrtest bug.
(cherry picked from commit fcdd9b6b7e73427ce5aa63cf095312f603c4edce)

7 years agobpo-30387: Fix warning in test_threading (#1634) (#1636)
Victor Stinner [Wed, 17 May 2017 21:49:38 +0000 (14:49 -0700)]
bpo-30387: Fix warning in test_threading (#1634) (#1636)

test_is_alive_after_fork() now joins directly the thread to avoid the
following warning added by bpo-30357:

Warning -- threading_cleanup() failed to cleanup 0 threads
after 2 sec (count: 0, dangling: 21)

Use also a different exit code to catch generic exit code 1.
(cherry picked from commit f8d05b3a24e745ab4a974b891ac1389e2f11ce4d)

7 years agotmtotuple(): use time_t for gmtoff (#1276) (#1635)
Victor Stinner [Wed, 17 May 2017 21:45:45 +0000 (14:45 -0700)]
tmtotuple(): use time_t for gmtoff (#1276) (#1635)

timegm() return type is time_t, not int. Use time_t to prevent the
following compiler warning on Windows:

timemodule.c: warning C4244: '=': conversion from 'time_t' to 'int',
              possible loss of data
(cherry picked from commit 0d659e5614cad512a1940125135b443b3eecb5d7)

7 years agoRemove unused variable in test_urllibnet. (#1598) (#1600)
Senthil Kumaran [Wed, 17 May 2017 17:51:01 +0000 (10:51 -0700)]
Remove unused variable in test_urllibnet. (#1598) (#1600)

(cherry picked from commit 1bd7d299bd2a91f8267f97a413568ab8fe7fdfbb)

7 years agobpo-30301: Fix AttributeError when using SimpleQueue.empty() (#1601) (#1628)
Xiang Zhang [Wed, 17 May 2017 14:03:35 +0000 (22:03 +0800)]
bpo-30301: Fix AttributeError when using SimpleQueue.empty() (#1601) (#1628)

Under *spawn* and *forkserver* start methods, SimpleQueue.empty() could
raise AttributeError due to not setting _poll in __setstate__.

7 years agoFix ModuleNotFoundError typo in import reference (#1610)
Dominik Miedziński [Wed, 17 May 2017 06:17:55 +0000 (08:17 +0200)]
Fix ModuleNotFoundError typo in import reference (#1610)

(cherry picked from commit c138d84b8d27d338872587aae69a73d8f9d16641)

7 years agobpo-30273: update distutils.sysconfig for venv's created from Python (#1515) (#1625)
Victor Stinner [Wed, 17 May 2017 00:58:02 +0000 (17:58 -0700)]
bpo-30273: update distutils.sysconfig for venv's created from Python (#1515) (#1625)

compiled out-of-tree (builddir != srcdir). (see also bpo-15366)
(cherry picked from commit dbdea629e2e0e4bd8845aa55041e0a0ca4172cf3)

7 years agobpo-30357: test_thread now uses threading_cleanup() (#1592) (#1622)
Victor Stinner [Wed, 17 May 2017 00:06:14 +0000 (17:06 -0700)]
bpo-30357: test_thread now uses threading_cleanup() (#1592) (#1622)

test_thread: setUp() now uses support.threading_setup() and
support.threading_cleanup() to wait until threads complete to avoid
random side effects on following tests.

Co-Authored-By: Grzegorz Grzywacz <grzegorz.grzywacz@nazwa.pl>
(cherry picked from commit 79ef7f8e88a4972c4aecf95cfc5cd934f1861e08)

7 years agobpo-30329: Catch Windows error 10022 on shutdown() (#1538) (#1620)
Victor Stinner [Tue, 16 May 2017 22:29:41 +0000 (15:29 -0700)]
bpo-30329: Catch Windows error 10022 on shutdown() (#1538) (#1620)

Catch the Windows socket WSAEINVAL error (code 10022) in imaplib and
poplib on shutdown(SHUT_RDWR): An invalid operation was attempted

This error occurs sometimes on SSL connections.
(cherry picked from commit 83a2c2879839da2e10037f5e4af1bd1dafbf1a52)

7 years agobpo-29898: Fix incorrect env variable name (GH-1576)
Berker Peksag [Tue, 16 May 2017 21:31:39 +0000 (00:31 +0300)]
bpo-29898: Fix incorrect env variable name (GH-1576)

It should read PYTHONLEGACYWINDOWSSTDIO as stated
in section "Add legacy mode" in PEP 528.

(cherry picked from commit 87fa8a780e9045a26c735f085c07bba4b2d0be60)

7 years agobpo-30380: Pin the version of Sphinx used to build the docs (GH-1612) (GH-1617)
Brett Cannon [Tue, 16 May 2017 21:28:21 +0000 (14:28 -0700)]
bpo-30380: Pin the version of Sphinx used to build the docs (GH-1612) (GH-1617)

7 years ago[3.6] bpo-30380: Fix Sphinx 1.6.1 warnings. (GH-1613) (#1614)
Serhiy Storchaka [Tue, 16 May 2017 21:09:23 +0000 (00:09 +0300)]
[3.6] bpo-30380: Fix Sphinx 1.6.1 warnings. (GH-1613) (#1614)

* Use explicit numbering for footnotes referred by explicit number.
* Restore missed footnote reference in stdtypes.rst.
* Fix literal strings formatting in howto/urllib2.rst.
* Update susp-ignored.csv for zipapp.rst.
* Fix suspicious mark up in Misc/NEWS..
(cherry picked from commit d97b7dc94b19063f0589d401bdc4aaadc7030762)

7 years ago[3.6] bpo-30375: Correct the stacklevel of regex compiling warnings. (GH-1595) (...
Serhiy Storchaka [Tue, 16 May 2017 15:16:15 +0000 (18:16 +0300)]
[3.6] bpo-30375: Correct the stacklevel of regex compiling warnings. (GH-1595) (#1604)

Warnings emitted when compile a regular expression now always point
to the line in the user code.  Previously they could point into inners
of the re module if emitted from inside of groups or conditionals..
(cherry picked from commit c7ac7280c321b3c1679fe5f657a6be0f86adf173)

7 years ago bpo-29651 - Cover edge case of square brackets in urllib docs (#1128) (#1596)
Senthil Kumaran [Tue, 16 May 2017 05:41:07 +0000 (22:41 -0700)]
 bpo-29651 - Cover edge case of square brackets in urllib docs (#1128) (#1596)

(cherry picked from commit f6e863d868a621594df2a8abe072b5d4766e7137)

7 years agobpo-30242: resolve some undefined behaviours in struct (#1418) (#1586)
Xiang Zhang [Mon, 15 May 2017 05:17:28 +0000 (13:17 +0800)]
bpo-30242: resolve some undefined behaviours in struct (#1418) (#1586)

7 years agobpo-30110: fix resource leak in test_asyncio.test_events (#1413) (#1584)
Xiang Zhang [Mon, 15 May 2017 05:17:01 +0000 (13:17 +0800)]
bpo-30110: fix resource leak in test_asyncio.test_events (#1413) (#1584)

7 years agobpo-30358: Document sort argument of profile.runctx() (GH-1566)
Berker Peksag [Sun, 14 May 2017 15:30:48 +0000 (18:30 +0300)]
bpo-30358: Document sort argument of profile.runctx() (GH-1566)

(cherry picked from commit 99776296230ddd8429ebad2d07854b8c27ea10ab)

7 years ago[3.6] Move Codecov's configuration file under .github (GH-1494) (GH-1574)
Brett Cannon [Sat, 13 May 2017 20:51:24 +0000 (13:51 -0700)]
[3.6] Move Codecov's configuration file under .github (GH-1494) (GH-1574)

(cherry picked from commit cbddf58c797f850a5b06f317a4bb7ab69c6e9715)

7 years ago[3.6] bpo-30178: Indent methods and attributes of MimeType class (GH-1306) (#1570)
Mariatta [Sat, 13 May 2017 16:42:39 +0000 (09:42 -0700)]
[3.6] bpo-30178: Indent methods and attributes of MimeType class (GH-1306) (#1570)

(cherry picked from commit c71168090df435c1eb8c03005b11df764cd7ebd6)

7 years ago[3.6] bpo-30345: Update test_gdb.py and python-gdb.py from master (#1549)
Victor Stinner [Fri, 12 May 2017 22:21:50 +0000 (00:21 +0200)]
[3.6] bpo-30345: Update test_gdb.py and python-gdb.py from master (#1549)

* python-gdb.py supports method-wrapper

bpo-29367: python-gdb.py now supports also method-wrapper (wrapperobject)
objects.

(cherry picked from commit 611083331d534481ca7956a376e38fb0e9ef3854)

* Update and enhance python-gdb.py

bpo-29259: Detect PyCFunction is the current frame, not only in the
older frame.

7 years agobpo-30048: asyncio: fix Task.cancel() was ignored. (GH-1546)
INADA Naoki [Thu, 11 May 2017 12:56:42 +0000 (21:56 +0900)]
bpo-30048: asyncio: fix Task.cancel() was ignored. (GH-1546)

when there are no more `await` or `yield (from)` before return in coroutine,
cancel was ignored.

example:

    async def coro():
        asyncio.Task.current_task().cancel()
        return 42
    ...
    res = await coro()  # should raise CancelledError

(cherry picked from commit 991adca012f5e106c2d4040ce619c696ba6f9c46)

7 years ago[3.6] bpo-28787: Fix out of tree --with-dtrace builds (GH-135) (#1543)
stratakis [Thu, 11 May 2017 11:13:18 +0000 (13:13 +0200)]
[3.6] bpo-28787: Fix out of tree --with-dtrace builds (GH-135) (#1543)

* bpo-28787: Fix out of tree --with-dtrace builds

* Unsilence directory creation

* Add Misc/NEWS and Misc/ACKS entries.
(cherry picked from commit f6eae5bf1c5d7b83e5d5bdbecfff928e478c1cfd)

7 years agobpo-30281: Fix the default value for stop in PySlice_Unpack() (#1480) (#1529)
Xiang Zhang [Wed, 10 May 2017 11:00:15 +0000 (19:00 +0800)]
bpo-30281: Fix the default value for stop in PySlice_Unpack() (#1480) (#1529)

7 years agobpo-30320: test_eintr now uses pthread_sigmask() (#1523) (#1524)
Victor Stinner [Wed, 10 May 2017 06:47:22 +0000 (08:47 +0200)]
bpo-30320: test_eintr now uses pthread_sigmask() (#1523) (#1524)

Rewrite sigwaitinfo() and sigtimedwait() unit tests for EINTR using
pthread_sigmask() to fix a race condition between the child and the
parent process.

Remove the pipe which was used as a weak workaround against the race
condition.

sigtimedwait() is now tested with a child process sending a signal
instead of testing the timeout feature which is more unstable
(especially regarding to clock resolution depending on the platform).
(cherry picked from commit 211a392cc15f9a7b1b8ce65d8f6c9f8237d1b77f)

7 years ago[3.6] bpo-30298: Weaken the condition of deprecation warnings for inline modifiers...
Serhiy Storchaka [Wed, 10 May 2017 03:44:02 +0000 (06:44 +0300)]
[3.6] bpo-30298: Weaken the condition of deprecation warnings for inline modifiers. (GH-1490) (#1525)

Now allowed several subsequential inline modifiers at the start of the
pattern (e.g. '(?i)(?s)...').  In verbose mode whitespaces and comments
now are allowed before and between inline modifiers (e.g.
'(?x) (?i) (?s)...')..
(cherry picked from commit 305ccbe27ea5ba82fd2d8c32ec739f980e524330)

7 years ago[3.6] bpo-29243: Fix Makefile with respect to --enable-optimizations (GH-1478) (...
torsava [Tue, 9 May 2017 14:05:10 +0000 (16:05 +0200)]
[3.6] bpo-29243: Fix Makefile with respect to --enable-optimizations (GH-1478) (#1518)

* bpo-29243: Fix Makefile with respect to --enable-optimizations (#1478)

* bpo-29243: Fix Makefile with respect to --enable-optimizations

When using the Profile Guided Optimization (./configure --enable-optimizations)
Python is built not only during `make` but rebuilt again during `make test`,
`make install` and others. This patch fixes the issue.

Note that this fix produces no change at all in the Makefile if configure is
run witout --enable-optimizations.

* !squash

(cherry picked from commit a1054c3b0037d4c2a5492e79fc193f36245366c7)

* [3.6] bpo-29243: Fix Makefile with respect to --enable-optimizations (GH-1478)

* bpo-29243: Fix Makefile with respect to --enable-optimizations

When using the Profile Guided Optimization (./configure --enable-optimizations)
Python is built not only during `make` but rebuilt again during `make test`,
`make install` and others. This patch fixes the issue.

Note that this fix produces no change at all in the Makefile if configure is
run witout --enable-optimizations.

* !squash.
(cherry picked from commit a1054c3b0037d4c2a5492e79fc193f36245366c7)

7 years agobpo-29990: Fix range checking in GB18030 decoder (#1495) (#1507)
Xiang Zhang [Tue, 9 May 2017 04:16:50 +0000 (12:16 +0800)]
bpo-29990: Fix range checking in GB18030 decoder (#1495) (#1507)

When decoding a 4-byte GB18030 sequence, the first and third byte cannot exceed 0xFE.

7 years agobpo-30289: remove Misc/python-config.sh when make distclean (#1498) (#1506)
Xiang Zhang [Tue, 9 May 2017 02:56:30 +0000 (10:56 +0800)]
bpo-30289: remove Misc/python-config.sh when make distclean (#1498) (#1506)

7 years ago[3.6] Revert bpo-26293 for zipfile breakage. See also bpo-29094. (GH-1484). (#1485)
Serhiy Storchaka [Sat, 6 May 2017 12:10:50 +0000 (15:10 +0300)]
[3.6] Revert bpo-26293 for zipfile breakage. See also bpo-29094. (GH-1484). (#1485)

(cherry picked from commit 3763ea865cee5bbabcce11cd577811135e0fc747)

7 years agobpo-30264: ExpatParser closes the source on error (#1451) (#1474)
Victor Stinner [Fri, 5 May 2017 08:04:57 +0000 (10:04 +0200)]
bpo-30264: ExpatParser closes the source on error (#1451) (#1474)

ExpatParser.parse() of xml.sax.xmlreader now always closes the
source: close the file object or the urllib object if source is a
string (not an open file-like object). The change fixes a
ResourceWarning on parsing error.

Add test_parse_close_source() unit test.
(cherry picked from commit ef9c0e732fc50aefbdd7c5a80e04e14b31684e66)

7 years ago[3.6] bpo-30243: Fixed the possibility of a crash in _json. (GH-1420) (#1469)
Serhiy Storchaka [Fri, 5 May 2017 07:40:30 +0000 (10:40 +0300)]
[3.6] bpo-30243: Fixed the possibility of a crash in _json. (GH-1420) (#1469)

It was possible to get a core dump by using uninitialized
_json objects. Now __new__ methods create initialized objects.
__init__ methods are removed..
(cherry picked from commit 76a3e51a403bc84ed536921866c86dd7d07aaa7e)

7 years ago[3.6] bpo-23404: make touch becomes make regen-all (#1405) (#1461)
Victor Stinner [Thu, 4 May 2017 22:46:56 +0000 (00:46 +0200)]
[3.6] bpo-23404: make touch becomes make regen-all (#1405) (#1461)

* bpo-23404: make touch becomes make regen-all (#1405)

Don't rebuild generated files based on file modification time
anymore, the action is now explicit. Replace "make touch"
with "make regen-all".

Changes:

* Remove "make touch", Tools/hg/hgtouch.py and .hgtouch
* Add a new "make regen-all" command to rebuild all generated files
* Add subcommands to only generate specific files:

  - regen-ast: Include/Python-ast.h and Python/Python-ast.c
  - regen-grammar: Include/graminit.h and Python/graminit.c
  - regen-importlib: Python/importlib_external.h and Python/importlib.h
  - regen-opcode: Include/opcode.h
  - regen-opcode-targets: Python/opcode_targets.h
  - regen-typeslots: Objects/typeslots.inc

* Rename PYTHON_FOR_GEN to PYTHON_FOR_REGEN
* pgen is now only built by by "make regen-grammar"
* Add $(srcdir)/ prefix to paths to source files to handle correctly
  compilation outside the source directory

Note: $(PYTHON_FOR_REGEN) is no more used nor needed by "make"
default target building Python.
(cherry picked from commit a5c62a8e9f0de6c4133825a5710984a3cd5e102b)

* bpo-30273: Update sysconfig (#1464)

The AST_H_DIR variable was removed from Makefile.pre.in by the commit
a5c62a8e9f0de6c4133825a5710984a3cd5e102b (bpo-23404).

AST_H_DIR was hardcoded to "Include", so replace the removed variable
by its content.

Remove also ASDLGEN variable from sysconfig example since this
variable was also removed.
(cherry picked from commit b109a1d3360fc4bb87b9887264e3634632d392ca)

7 years ago[3.6] bpo-30185: avoid KeyboardInterrupt tracebacks in forkserver (GH-1319) (#1454)
Antoine Pitrou [Thu, 4 May 2017 15:12:35 +0000 (17:12 +0200)]
[3.6] bpo-30185: avoid KeyboardInterrupt tracebacks in forkserver (GH-1319) (#1454)

* bpo-30185: avoid KeyboardInterrupt tracebacks in forkserver

* Tweak comment.
(cherry picked from commit 6dd4d734ed207ba16b017e38f8909de7ef187e29)

7 years agobpo-30225: Fix is_valid_fd() on macOS Tiger (#1443) (#1449)
Victor Stinner [Thu, 4 May 2017 11:21:10 +0000 (13:21 +0200)]
bpo-30225: Fix is_valid_fd() on macOS Tiger (#1443) (#1449)

is_valid_fd() now uses fstat() instead of dup() on macOS to return 0
on a pipe when the other side of the pipe is closed. fstat() fails
with EBADF in that case, whereas dup() succeed.
(cherry picked from commit 1c4670ea0cc3d208121af11b9b973e6bb268e570)

7 years ago[3.6] bpo-30184: Add tests for invalid use of PyArg_ParseTupleAndKeywords. (GH-1316...
Serhiy Storchaka [Thu, 4 May 2017 03:50:28 +0000 (06:50 +0300)]
[3.6] bpo-30184: Add tests for invalid use of PyArg_ParseTupleAndKeywords. (GH-1316). (#1441)

(cherry picked from commit 5f161fd86dd5bb936a1a2a13391b13b7e59ec201)

7 years ago[3.6] bpo-28315: Improve code examples in docs (GH-1372) (#1445)
Mariatta [Thu, 4 May 2017 01:41:20 +0000 (18:41 -0700)]
[3.6] bpo-28315: Improve code examples in docs (GH-1372) (#1445)

Replace
   File "<stdin>", line 1, in ?
with
   File "<stdin>", line 1, in <module>
(cherry picked from commit 8856940cf2e82cb17db2b684cd5732fe658605ca)

7 years agoBump version in AppVeyor config (GH-1436)
Zachary Ware [Wed, 3 May 2017 16:56:44 +0000 (11:56 -0500)]
Bump version in AppVeyor config (GH-1436)

7 years ago[3.6] bpo-28556: Routine updates to typing (GH-1366) (#1416)
Mariatta [Wed, 3 May 2017 16:38:01 +0000 (09:38 -0700)]
[3.6] bpo-28556: Routine updates to typing (GH-1366) (#1416)

- Add NoReturn type
- Use WrapperDescriptorType (original PR by Jim Fasarakis-Hilliard)
- Minor bug-fixes
(cherry picked from commit f06e0218ef6007667f5d61184b85a81a0466d3ae)

7 years ago[3.6] Fix typo in selectors.rst (GH-1383) (#1414)
Mariatta [Wed, 3 May 2017 04:35:43 +0000 (21:35 -0700)]
[3.6] Fix typo in selectors.rst (GH-1383) (#1414)

decriptor -> descriptor
(cherry picked from commit b0d82036549074357717d130a772d1e2ebc8ea01)

7 years agoregrtest: always show before/after of modified env (#1192) (#1406)
Victor Stinner [Wed, 3 May 2017 00:12:22 +0000 (02:12 +0200)]
regrtest: always show before/after of modified env (#1192) (#1406)

Buildbots don't run tests with -vv and so only log "xxx was modified
by test_xxx" which is not enough to debug such random issue. In many
cases, I'm unable to reproduce the warning and so unable to fix it.

Always logging the value before and value after should help to debug
such warning on buildbots.
(cherry picked from commit ec4b17239d899550be4ee6104b61751bb3c70382)

7 years agoBackport bpo-30205 to 3.6 (#1403)
Antoine Pitrou [Tue, 2 May 2017 22:14:29 +0000 (00:14 +0200)]
Backport bpo-30205 to 3.6 (#1403)

7 years ago[3.6] bpo-30232: Support Git worktree in configure.ac (#1398)
Victor Stinner [Tue, 2 May 2017 21:46:06 +0000 (23:46 +0200)]
[3.6] bpo-30232: Support Git worktree in configure.ac (#1398)

* bpo-30232: Support Git worktree in configure.ac (#1391)

Don't test if .git/HEAD file exists, but only if the .git file (or
directory) exists.
(cherry picked from commit 5facdbb29169c2799c42f887cef4cd9d087b0167)

* bpo-30232: Regenerate configure (#1396)

Run autoconf.
(cherry picked from commit 9ed34a89532763cf89f5e11fffb91ef7dee29fed)

7 years agobpo-30199: test_ssl closes all asyncore channels (#1381) (#1390)
Victor Stinner [Tue, 2 May 2017 14:49:10 +0000 (16:49 +0200)]
bpo-30199: test_ssl closes all asyncore channels (#1381) (#1390)

AsyncoreEchoServer of test_ssl now calls
asyncore.close_all(ignore_all=True) to ensure that
asyncore.socket_map is cleared once the test completes, even if
ConnectionHandler was not correctly unregistered.

Fix the following warning:

Warning -- asyncore.socket_map was modified by test_ssl
  Before: {}
  After:  {6: <test.test_ssl.AsyncoreEchoServer.EchoServer.ConnectionHandler>}
(cherry picked from commit 1dae7450c68bad498e57800387b24cb103c461fa)

7 years agobpo-30132: distutils BuildExtTestCase use temp_cwd (#1387)
Victor Stinner [Tue, 2 May 2017 13:50:42 +0000 (15:50 +0200)]
bpo-30132: distutils BuildExtTestCase use temp_cwd (#1387)

BuildExtTestCase of test_distutils now uses support.temp_cwd() in
setUp() to remove files created in the current working in all
BuildExtTestCase unit tests, not only test_build_ext().

Fix the following warning:

Warning -- files was modified by test_distutils
  Before: []
  After:  ['vc140.pdb']

7 years agobpo-30108: Restore sys.path in test_site (#1197) (#1378)
Victor Stinner [Tue, 2 May 2017 09:45:42 +0000 (11:45 +0200)]
bpo-30108: Restore sys.path in test_site (#1197) (#1378)

Add setUpModule() and tearDownModule() functions to test_site to
save/restore sys.path at the module level to prevent warning if the
user site directory is created, since site.addsitedir() modifies
sys.path.
(cherry picked from commit b85c136903c6d2368162f7c4a58f258c9c69ead0)

7 years agobpo-30104: Use -fno-strict-aliasing on clang (#1376)
Victor Stinner [Tue, 2 May 2017 08:47:37 +0000 (10:47 +0200)]
bpo-30104: Use -fno-strict-aliasing on clang (#1376)

Python/dtoa.c is not compiled correctly with clang 4.0 and
optimization level -O2 or higher, because of an aliasing issue on the
double/ULong[2] union. Only compile dtoa.c with -fno-strict-aliasing.

LLVM bug report:
https://bugs.llvm.org//show_bug.cgi?id=31928

7 years ago[3.6] Clean up some confusing text left by PROTOCOL_SSLv23 -> PROTOCOL_TLS transition...
Mariatta [Tue, 2 May 2017 05:55:53 +0000 (22:55 -0700)]
[3.6] Clean up some confusing text left by PROTOCOL_SSLv23 -> PROTOCOL_TLS transition (GH-1355) (#1371)

(cherry picked from commit d4069de5112f0408801ff2479476827bb3e0e8fc)

7 years ago[3.6] Improve the grammar in windows.rst (GH-1330) (GH-1360)
Mariatta [Sun, 30 Apr 2017 05:18:40 +0000 (22:18 -0700)]
[3.6] Improve the grammar in windows.rst (GH-1330) (GH-1360)

(cherry picked from commit 80a3da4d4aad0b51893e1e2f696b6252eca80e07)

7 years ago[3.6] bpo-30208: DOC: fix small typos in IDLE (#1356)
csabella [Sun, 30 Apr 2017 00:42:03 +0000 (20:42 -0400)]
[3.6] bpo-30208: DOC: fix small typos in IDLE (#1356)

(cherry picked from commit d9af73330f46d79cc0c56d369f65ebeec3cb5334)

7 years ago[3.6] bpo-30197: Enhance functions swap_attr() and swap_item() in test.support. ...
Serhiy Storchaka [Fri, 28 Apr 2017 17:05:05 +0000 (20:05 +0300)]
[3.6] bpo-30197: Enhance functions swap_attr() and swap_item() in test.support. (GH-1341) (#1345)

They now work when delete replaced attribute or item inside the with
statement.  The old value of the attribute or item (or None if it doesn't
exist) now will be assigned to the target of the "as" clause, if there is
one.

(cherry picked from commit d1a1def7bf221b04dcf3fc3a67aa19aa2f622f83)

7 years agobpo-30125: disable faulthandler in ctypes test_SEH (#1237) (#1343)
Victor Stinner [Fri, 28 Apr 2017 14:06:48 +0000 (16:06 +0200)]
bpo-30125: disable faulthandler in ctypes test_SEH (#1237) (#1343)

Disable faulthandler to run test_SEH() of test_ctypes to prevent the
following log with a traceback:

    Windows fatal exception: access violation

Add support.disable_faulthandler() context manager.
(cherry picked from commit a36e939aeb3b5a2c56561eb24f0e339eee9f3f9d)

7 years agobpo-30131: test_logging now joins queue threads (#1298) (#1317)
Victor Stinner [Fri, 28 Apr 2017 02:13:53 +0000 (04:13 +0200)]
bpo-30131: test_logging now joins queue threads (#1298) (#1317)

QueueListenerTest of test_logging now closes the multiprocessing
Queue and joins its thread to prevent leaking dangling threads to
following tests.

Add also @support.reap_threads to detect earlier if a test leaks
threads (and try to "cleanup" these threads).
(cherry picked from commit 8ca2f2faefa8dba323a2e4c4b86efb633d7a53cf)

7 years ago[3.6] bpo-30106: Fix test_asyncore.test_quick_connect() (#1336)
Victor Stinner [Fri, 28 Apr 2017 02:13:37 +0000 (04:13 +0200)]
[3.6] bpo-30106: Fix test_asyncore.test_quick_connect() (#1336)

* Fix/optimize test_asyncore.test_quick_connect() (#1188)

Don't use addCleanup() in test_quick_connect() because it keeps the
Thread object alive and so @reap_threads fails on its timeout of 1
second. "./python -m test -v test_asyncore -m test_quick_connect"
now takes 185 ms, instead of 11 seconds.

Other minor changes:

* Use "with sock:" to close the socket instead of
  try/finally: sock.close()
* Use self.skipTest() in test_quick_connect() to remove one
  indentation level and notice user that the test is specific to
  AF_INET and AF_INET6

* bpo-30106: Fix tearDown() of test_asyncore (#1194)

Call asyncore.close_all() with ignore_all=True in the tearDown()
method of the test_asyncore base test case. It should prevent keeping
alive sockets in asyncore.socket_map if close() fails with an
unexpected error.

Revert also an unwanted change of my previous commit: remove name
parameter of Thread in test_quick_connect().

* bpo-30106: Fix test_asyncore.test_quick_connect() (#1234)

test_quick_connect() runs a thread up to 50 seconds, whereas the
socket is connected in 0.2 second and then the thread is expected to
end in less than 3 second. On Linux, the thread ends quickly because
select() seems to always return quickly. On FreeBSD, sometimes
select() fails with timeout and so the thread runs much longer than
expected.

Fix the thread timeout to fix a race condition in the test.

7 years agobpo-30107: Make SuppressCrashReport quiet on macOS (#1279) (#1335)
Victor Stinner [Fri, 28 Apr 2017 01:27:51 +0000 (03:27 +0200)]
bpo-30107: Make SuppressCrashReport quiet on macOS (#1279) (#1335)

On macOS, SuppressCrashReport now redirects /usr/bin/defaults command
stderr into a pipe to not pollute stderr. It fixes a
test_io.test_daemon_threads_shutdown_stderr_deadlock() failure when
the CrashReporter domain doesn't exists. Message logged into stderr:

2017-04-24 16:57:21.432 defaults[41046:2462851]
The domain/default pair of (com.apple.CrashReporter, DialogType) does not exist
(cherry picked from commit d819ad9832292d854e9710493ecdf959b69802e3)

7 years agobpo-30175: Skip client cert tests of test_imaplib (#1320) (#1323)
Victor Stinner [Thu, 27 Apr 2017 16:25:03 +0000 (18:25 +0200)]
bpo-30175: Skip client cert tests of test_imaplib (#1320) (#1323)

* bpo-30175: Skip client cert tests of test_imaplib

The IMAP server cyrus.andrew.cmu.edu doesn't accept our randomly
generated client x509 certificate anymore.

* bpo-30188: Catch EOFError in NetworkedNNTPTests

test_nntplib fails randomly with EOFError in
NetworkedNNTPTests.setUpClass(). Catch EOFError to skip tests in that
case.

(cherry picked from commit 5bccca58b9b2b3a925b16750bedbd907695ea8d7)

7 years ago[3.6] bpo-30182: Use the correct name for ISO in Unicode HOWTO. (GH-1312) (GH-1313)
Mariatta [Thu, 27 Apr 2017 05:18:53 +0000 (22:18 -0700)]
[3.6] bpo-30182: Use the correct name for ISO in Unicode HOWTO. (GH-1312) (GH-1313)

(cherry picked from commit 6fde770e4e940c19cd62de0b6aeb77840690843e)

7 years ago[3.6] bpo-30142: Remove "callable" from the 2to3fixer documentation. (GH-1303)
Dong-hee Na [Wed, 26 Apr 2017 16:55:55 +0000 (01:55 +0900)]
[3.6] bpo-30142: Remove "callable" from the 2to3fixer documentation. (GH-1303)

7 years agobpo-29974: Improve typing.TYPE_CHECKING example (GH-982)
Berker Peksag [Wed, 26 Apr 2017 14:25:37 +0000 (17:25 +0300)]
bpo-29974: Improve typing.TYPE_CHECKING example (GH-982)

* Fix PEP 8 (SomeType instead of some_type)
* Add a function parameter annotation
* Explain, using wording from PEP 484 and PEP 526,
  why one annotation is in quotes and another is not.

Suggested by Ivan Levkevskyi.

(cherry picked from commit 87c07fe9d908d0a2143fcc8369255c6ff3241503)

7 years agobpo-28698: Fix c_wchar_p doc example (GH-1160)
Louie Lu [Wed, 26 Apr 2017 08:45:31 +0000 (16:45 +0800)]
bpo-28698: Fix c_wchar_p doc example (GH-1160)

(cherry picked from commit 0d637e236d7099f7b724026c8cb7bd83d8e12e6b)

7 years ago[3.6] bpo-28851: Improve namedtuple documentation (GH-1274) (GH-1286)
Mariatta [Wed, 26 Apr 2017 01:23:05 +0000 (18:23 -0700)]
[3.6] bpo-28851: Improve namedtuple documentation (GH-1274) (GH-1286)

Clarify that a sequence of strings is the preferred value for 'field_names'.
(cherry picked from commit 97bf722fcd1de1236824377e052369dc7686b644)

7 years ago[3.6] bpo-29751: Improve PyLong_FromString documentation (GH-915) (#1266)
Mariatta [Mon, 24 Apr 2017 04:05:01 +0000 (21:05 -0700)]
[3.6] bpo-29751: Improve PyLong_FromString documentation (GH-915) (#1266)

(cherry picked from commit 26896f2832324dde85cdd63d525571ca669f6f0b)

7 years ago[3.6] bpo-15718: Document the upper bound constrain on the __len__ return value....
Serhiy Storchaka [Sun, 23 Apr 2017 05:50:14 +0000 (08:50 +0300)]
[3.6] bpo-15718: Document the upper bound constrain on the __len__ return value. (GH-1256) (#1259)

(cherry picked from commit 85157cd)

7 years ago[3.6] Fix trailing colon and newline in test.rst (GH-1250) (#1254)
Louie Lu [Sat, 22 Apr 2017 11:48:53 +0000 (19:48 +0800)]
[3.6] Fix trailing colon and newline in test.rst (GH-1250) (#1254)

(cherry picked from commit 7fae81e1672d0b4110d31ea6a765b54f63a2e54b)

7 years agobpo-30098: Clarify that run_coroutine_threadsafe expects asyncio.Future (GH-1170...
Mariatta [Sat, 22 Apr 2017 02:58:28 +0000 (19:58 -0700)]
bpo-30098: Clarify that run_coroutine_threadsafe expects asyncio.Future   (GH-1170) (#1247)

(cherry picked from commit ae5b3260dd459845aad8a30491b76d471577785d)

7 years ago[3.6] Correct the README link in Unix install docs (GH-1245) (GH-1248)
Mariatta [Sat, 22 Apr 2017 02:28:29 +0000 (19:28 -0700)]
[3.6] Correct the README link in Unix install docs (GH-1245) (GH-1248)

(cherry picked from commit d1ae24e8880fe00d006eb2996af815c35fbcfb33)

7 years agobpo-30125: Fix faulthandler.disable() on Windows (#1243)
Victor Stinner [Fri, 21 Apr 2017 21:17:33 +0000 (23:17 +0200)]
bpo-30125: Fix faulthandler.disable() on Windows (#1243)

On Windows, faulthandler.disable() now removes the exception handler
installed by faulthandler.enable().

7 years agobpo-29191: Add liblzma.vcxproj to pcbuild.sln and other missing entries (GH-1222...
Steve Dower [Fri, 21 Apr 2017 18:28:46 +0000 (11:28 -0700)]
bpo-29191: Add liblzma.vcxproj to pcbuild.sln and other missing entries (GH-1222) (GH-1244)

liblzma is missing from pcbuild.sln. This causes the build of _lzma to fail when building the solution and not using build.bat.

7 years agobpo-30107: don't dump core on expected test_io crash (#1235) (#1241)
Victor Stinner [Fri, 21 Apr 2017 16:27:29 +0000 (18:27 +0200)]
bpo-30107: don't dump core on expected test_io crash (#1235) (#1241)

test_io has two unit tests which trigger a deadlock:

* test_daemon_threads_shutdown_stdout_deadlock()
* test_daemon_threads_shutdown_stderr_deadlock()

These tests call Py_FatalError() if the expected bug is triggered
which calls abort(). Use test.support.SuppressCrashReport to prevent
the creation on a core dump, to fix the warning:

Warning -- files was modified by test_io
  Before: []
  After:  ['python.core']
(cherry picked from commit 2a1aed04b0943636f605543522e16cca1dc23e70)

7 years ago[3.6] Add missing .gitignore entries for VS2015 IntelliSense DB (GH-1223) (#1225)
Mariatta [Fri, 21 Apr 2017 03:55:59 +0000 (20:55 -0700)]
[3.6] Add missing .gitignore entries for VS2015 IntelliSense DB (GH-1223) (#1225)

(cherry picked from commit 8e675286a92f33837cfffac5914b5175dac5d573)

7 years agobpo-29802: Fix the cleaning up issue in PyUnicode_FSDecoder(). (#1217)
Serhiy Storchaka [Thu, 20 Apr 2017 19:55:06 +0000 (22:55 +0300)]
bpo-29802: Fix the cleaning up issue in PyUnicode_FSDecoder(). (#1217)

7 years ago[3.6] bpo-30109: Fix reindent.py (GH-1207) (GH-1208)
Mariatta [Thu, 20 Apr 2017 14:12:37 +0000 (07:12 -0700)]
[3.6] bpo-30109: Fix reindent.py (GH-1207) (GH-1208)

Skip the file if it has bad encoding.
(cherry picked from commit 58f3c9dc8f5626abe09ac9738c34f6ba99ce2972)

7 years ago[3.6] bpo-12414: Update code_sizeof() to take in account co_extra memory. (#1168...
Dong-hee Na [Thu, 20 Apr 2017 08:26:25 +0000 (17:26 +0900)]
[3.6] bpo-12414: Update code_sizeof() to take in account co_extra memory. (#1168) (#1198)

7 years agoRemove redundant comma in argparse HOWTO (GH-1141)
Berker Peksag [Thu, 20 Apr 2017 04:42:32 +0000 (07:42 +0300)]
Remove redundant comma in argparse HOWTO (GH-1141)

Reported by Sean Canavan on docs@p.o.

(cherry picked from commit 8526fb74edf5ac9ca175b7cdcb0d82bb8780d2cf)

7 years agobpo-30078: Add an example of passing a path to unittest (GH-1178)
Berker Peksag [Thu, 20 Apr 2017 04:36:57 +0000 (07:36 +0300)]
bpo-30078: Add an example of passing a path to unittest (GH-1178)

(cherry picked from commit f7e62cf8adfb8ab6a6a870903defe8ff218a0383)

7 years agobpo-19225: Remove duplicated description for standard warning categories (GH-1068)
cocoatomo [Thu, 20 Apr 2017 03:54:06 +0000 (12:54 +0900)]
bpo-19225: Remove duplicated description for standard warning categories (GH-1068)

7 years ago[3.6] bpo-30065: Fixed arguments validation in _posixsubprocess.fork_exec(). (GH...
Serhiy Storchaka [Wed, 19 Apr 2017 20:59:02 +0000 (23:59 +0300)]
[3.6] bpo-30065: Fixed arguments validation in _posixsubprocess.fork_exec(). (GH-1110) (#1186)

(cherry picked from commit 66bffd1)