From: Serhiy Storchaka Date: Mon, 6 Jul 2015 17:02:50 +0000 (+0300) Subject: Corrected empty lines in Misc/NEWS. X-Git-Tag: v3.5.0b4~69 X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=958b3cc8c70aaca816d15cf0dd858c8b3ce390e6;p=python Corrected empty lines in Misc/NEWS. --- 958b3cc8c70aaca816d15cf0dd858c8b3ce390e6 diff --cc Misc/NEWS index b45b48dc54,87327b30bd..5d27e0afb1 --- a/Misc/NEWS +++ b/Misc/NEWS @@@ -78,2774 -91,5526 +78,2775 @@@ Librar - Issue #24336: The contextmanager decorator now works with functions with keyword arguments called "func" and "self". Patch by Martin Panter. +- Issue #24522: Fix possible integer overflow in json accelerator module. + - Issue #24489: ensure a previously set C errno doesn't disturb cmath.polar(). -- Issue #5633: Fixed timeit when the statement is a string and the setup is not. +- Issue #24408: Fixed AttributeError in measure() and metrics() methods of + tkinter.Font. -- Issue #24326: Fixed audioop.ratecv() with non-default weightB argument. - Original patch by David Moore. +- Issue #14373: C implementation of functools.lru_cache() now can be used with + methods. -- Issue #23840: tokenize.open() now closes the temporary binary file on error - to fix a resource warning. +- Issue #8232: webbrowser support incomplete on Windows. Patch by Brandon + Milam -- Issue #24257: Fixed segmentation fault in sqlite3.Row constructor with faked - cursor type. +- Issue #24347: Set KeyError if PyDict_GetItemWithError returns NULL. -- Issue #22107: tempfile.gettempdir() and tempfile.mkdtemp() now try again - when a directory with the chosen name already exists on Windows as well as - on Unix. tempfile.mkstemp() now fails early if parent directory is not - valid (not exists or is a file) on Windows. +- Issue #24348: Drop superfluous incref/decref. -- Issue #6598: Increased time precision and random number range in - email.utils.make_msgid() to strengthen the uniqueness of the message ID. +- Issue #24359: Check for changed OrderedDict size during iteration. -- Issue #24091: Fixed various crashes in corner cases in C implementation of - ElementTree. +- Issue #24368: Support keyword arguments in OrderedDict methods. -- Issue #21931: msilib.FCICreate() now raises TypeError in the case of a bad - argument instead of a ValueError with a bogus FCI error number. - Patch by Jeffrey Armstrong. +- Issue #24362: Simplify the C OrderedDict fast nodes resize logic. -- Issue #23796: peek and read1 methods of BufferedReader now raise ValueError - if they called on a closed object. Patch by John Hergenroeder. +- Issue #24377: Fix a ref leak in OrderedDict.__repr__. -- Issue #24521: Fix possible integer overflows in the pickle module. +- Issue #24369: Defend against key-changes during iteration. -- Issue #22931: Allow '[' and ']' in cookie values. +Tests +----- -- Issue #20274: Remove ignored and erroneous "kwargs" parameters from three - METH_VARARGS methods on _sqlite.Connection. +- Issue #24373: _testmultiphase and xxlimited now use tp_traverse and + tp_finalize to avoid reference leaks encountered when combining tp_dealloc + with PyType_FromSpec (see issue #16690 for details) -- Issue #24094: Fix possible crash in json.encode with poorly behaved dict - subclasses. +Documentation +------------- -- Asyncio issue 222 / PR 231 (Victor Stinner) -- fix @coroutine - functions without __name__. +- Issue #24458: Update documentation to cover multi-phase initialization for + extension modules (PEP 489). Patch by Petr Viktorin. -- Issue #9246: On POSIX, os.getcwd() now supports paths longer than 1025 bytes. - Patch written by William Orr. +- Issue #24351: Clarify what is meant by "identifier" in the context of + string.Template instances. -- The keywords attribute of functools.partial is now always a dictionary. +Build +----- -- Issues #24099, #24100, and #24101: Fix free-after-use bug in heapq's siftup - and siftdown functions. +- Issue #24432: Update Windows builds and OS X 10.5 installer to use OpenSSL + 1.0.2c. -- Backport collections.deque fixes from Python 3.5. Prevents reentrant badness - during deletion by deferring the decref until the container has been restored - to a consistent state. -- Issue #23008: Fixed resolving attributes with boolean value is False in pydoc. +What's New in Python 3.5.0 beta 2? +================================== -- Fix asyncio issue 235: LifoQueue and PriorityQueue's put didn't - increment unfinished tasks (this bug was introduced in 3.4.3 when - JoinableQueue was merged with Queue). +Release date: 2015-05-31 -- Issue #23908: os functions now reject paths with embedded null character - on Windows instead of silently truncate them. +Core and Builtins +----------------- -- Issue #23728: binascii.crc_hqx() could return an integer outside of the range - 0-0xffff for empty data. +- Issue #24284: The startswith and endswith methods of the str class no longer + return True when finding the empty string and the indexes are completely out + of range. -- Issue #23811: Add missing newline to the PyCompileError error message. - Patch by Alex Shkop. +- Issue #24115: Update uses of PyObject_IsTrue(), PyObject_Not(), + PyObject_IsInstance(), PyObject_RichCompareBool() and _PyDict_Contains() + to check for and handle errors correctly. -- Issue #17898: Fix exception in gettext.py when parsing certain plural forms. +- Issue #24328: Fix importing one character extension modules. -- Issue #22982: Improve BOM handling when seeking to multiple positions of - a writable text file. +- Issue #11205: In dictionary displays, evaluate the key before the value. -- Issue #23865: close() methods in multiple modules now are idempotent and more - robust at shutdown. If they need to release multiple resources, all are - released even if errors occur. +- Issue #24285: Fixed regression that prevented importing extension modules + from inside packages. Patch by Petr Viktorin. -- Issue #23881: urllib.request.ftpwrapper constructor now closes the socket if - the FTP connection failed to fix a ResourceWarning. +Library +------- -- Issue #23400: Raise same exception on both Python 2 and 3 if sem_open is not - available. Patch by Davin Potts. +- Issue #24270: Add math.isclose() and cmath.isclose() functions as per PEP 485. + Contributed by Chris Barker and Tal Einat. -- Issue #15133: _tkinter.tkapp.getboolean() now supports Tcl_Obj and always - returns bool. tkinter.BooleanVar now validates input values (accepted bool, - int, str, and Tcl_Obj). tkinter.BooleanVar.get() now always returns bool. +- Issue #5633: Fixed timeit when the statement is a string and the setup is not. -- Issue #23338: Fixed formatting ctypes error messages on Cygwin. - Patch by Makoto Kato. +- Issue #24326: Fixed audioop.ratecv() with non-default weightB argument. + Original patch by David Moore. -- Issue #16840: Tkinter now supports 64-bit integers added in Tcl 8.4 and - arbitrary precision integers added in Tcl 8.5. +- Issue #16991: Add a C implementation of OrderedDict. -- Issue #23834: Fix socket.sendto(), use the C Py_ssize_t type to store the - result of sendto() instead of the C int type. +- Issue #23934: Fix inspect.signature to fail correctly for builtin types + lacking signature information. Initial patch by James Powell. -- Issue #21526: Tkinter now supports new boolean type in Tcl 8.5. -- Issue #23838: linecache now clears the cache and returns an empty result on - MemoryError. +What's New in Python 3.5.0 beta 1? +================================== -- Issue #18473: Fixed 2to3 and 3to2 compatible pickle mappings. Fixed - ambigious reverse mappings. Added many new mappings. Import mapping is no - longer applied to modules already mapped with full name mapping. +Release date: 2015-05-24 -- Issue #23745: The new email header parser now handles duplicate MIME - parameter names without error, similar to how get_param behaves. +Core and Builtins +----------------- -- Issue #23792: Ignore KeyboardInterrupt when the pydoc pager is active. - This mimics the behavior of the standard unix pagers, and prevents - pipepager from shutting down while the pager itself is still running. +- Issue #24276: Fixed optimization of property descriptor getter. -- Issue #23742: ntpath.expandvars() no longer loses unbalanced single quotes. +- Issue #24268: PEP 489: Multi-phase extension module initialization. + Patch by Petr Viktorin. -- Issue #21802: The reader in BufferedRWPair now is closed even when closing - writer failed in BufferedRWPair.close(). +- Issue #23955: Add pyvenv.cfg option to suppress registry/environment + lookup for generating sys.path on Windows. -- Issue #23671: string.Template now allows to specify the "self" parameter as - keyword argument. string.Formatter now allows to specify the "self" and - the "format_string" parameters as keyword arguments. +- Issue #24257: Fixed system error in the comparison of faked + types.SimpleNamespace. -- Issue #21560: An attempt to write a data of wrong type no longer cause - GzipFile corruption. Original patch by Wolfgang Maier. +- Issue #22939: Fixed integer overflow in iterator object. Patch by + Clement Rouault. -- Issue #23647: Increase impalib's MAXLINE to accommodate modern mailbox sizes. +- Issue #23985: Fix a possible buffer overrun when deleting a slice from + the front of a bytearray and then appending some other bytes data. -- Issue #23539: If body is None, http.client.HTTPConnection.request now sets - Content-Length to 0 for PUT, POST, and PATCH headers to avoid 411 errors from - some web servers. +- Issue #24102: Fixed exception type checking in standard error handlers. -- Issue #22351: The nntplib.NNTP constructor no longer leaves the connection - and socket open until the garbage collector cleans them up. Patch by - Martin Panter. +- Issue #15027: The UTF-32 encoder is now 3x to 7x faster. -- Issue #23136: _strptime now uniformly handles all days in week 0, including - Dec 30 of previous year. Based on patch by Jim Carroll. +- Issue #23290: Optimize set_merge() for cases where the target is empty. + (Contributed by Serhiy Storchaka.) -- Issue #23700: Iterator of NamedTemporaryFile now keeps a reference to - NamedTemporaryFile instance. Patch by Bohuslav Kabrda. +- Issue #2292: PEP 448: Additional Unpacking Generalizations. -- Issue #22903: The fake test case created by unittest.loader when it fails - importing a test module is now picklable. +- Issue #24096: Make warnings.warn_explicit more robust against mutation of the + warnings.filters list. -- Issue #23568: Add rdivmod support to MagicMock() objects. - Patch by Håkan Lövdahl. +- Issue #23996: Avoid a crash when a delegated generator raises an + unnormalized StopIteration exception. Patch by Stefan Behnel. -- Issue #23138: Fixed parsing cookies with absent keys or values in cookiejar. - Patch by Demian Brecht. +- Issue #23910: Optimize property() getter calls. Patch by Joe Jevnik. -- Issue #23051: multiprocessing.Pool methods imap() and imap_unordered() now - handle exceptions raised by an iterator. Patch by Alon Diamant and Davin - Potts. +- Issue #23911: Move path-based importlib bootstrap code to a separate + frozen module. -- Issue #22928: Disabled HTTP header injections in http.client. - Original patch by Demian Brecht. +- Issue #24192: Fix namespace package imports. -- Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with - imp.reload(). Patch by Thomas Kluyver. +- Issue #24022: Fix tokenizer crash when processing undecodable source code. -- Issue #23476: In the ssl module, enable OpenSSL's X509_V_FLAG_TRUSTED_FIRST - flag on certificate stores when it is available. +- Issue #9951: Added a hex() method to bytes, bytearray, and memoryview. -- Issue #23576: Avoid stalling in SSL reads when EOF has been reached in the - SSL layer but the underlying connection hasn't been closed. +- Issue #22906: PEP 479: Change StopIteration handling inside generators. -- Issue #23504: Added an __all__ to the types module. +- Issue #24017: PEP 492: Coroutines with async and await syntax. -- Issue #20204: Added the __module__ attribute to _tkinter classes. +Library +------- -- Issue #23521: Corrected pure python implementation of timedelta division. +- Issue #14373: Added C implementation of functools.lru_cache(). Based on + patches by Matt Joiner and Alexey Kachayev. - * Eliminated OverflowError from timedelta * float for some floats; - * Corrected rounding in timedlta true division. +- Issue 24230: The tempfile module now accepts bytes for prefix, suffix and dir + parameters and returns bytes in such situations (matching the os module APIs). -- Issue #21619: Popen objects no longer leave a zombie after exit in the with - statement if the pipe was broken. Patch by Martin Panter. +- Issue #22189: collections.UserString now supports __getnewargs__(), + __rmod__(), casefold(), format_map(), isprintable(), and maketrans(). + Patch by Joe Jevnik. -- Issue #6639: Module-level turtle functions no longer raise TclError after - closing the window. +- Issue 24244: Prevents termination when an invalid format string is + encountered on Windows in strftime. -- Issues #814253, #9179: Warnings now are raised when group references and - conditional group references are used in lookbehind assertions in regular - expressions. +- Issue #23973: PEP 484: Add the typing module. -- Issue #23215: Multibyte codecs with custom error handlers that ignores errors - consumed too much memory and raised SystemError or MemoryError. - Original patch by Aleksi Torhamo. +- Issue #23086: The collections.abc.Sequence() abstract base class added + *start* and *stop* parameters to the index() mixin. + Patch by Devin Jeanpierre. -- Issue #5700: io.FileIO() called flush() after closing the file. - flush() was not called in close() if closefd=False. +- Issue #20035: Replaced the ``tkinter._fix`` module used for setting up the + Tcl/Tk environment on Windows with a private function in the ``_tkinter`` + module that makes no permanent changes to the environment. -- Issue #23374: Fixed pydoc failure with non-ASCII files when stdout encoding - differs from file system encoding (e.g. on Mac OS). +- Issue #24257: Fixed segmentation fault in sqlite3.Row constructor with faked + cursor type. -- Issue #23481: Remove RC4 from the SSL module's default cipher list. +- Issue #15836: assertRaises(), assertRaisesRegex(), assertWarns() and + assertWarnsRegex() assertments now check the type of the first argument + to prevent possible user error. Based on patch by Daniel Wagner-Hall. -- Issue #21548: Fix pydoc.synopsis() and pydoc.apropos() on modules with empty - docstrings. +- Issue #9858: Add missing method stubs to _io.RawIOBase. Patch by Laura + Rupprecht. -- Issue #22885: Fixed arbitrary code execution vulnerability in the dbm.dumb - module. Original patch by Claudiu Popa. +- Issue #22955: attrgetter, itemgetter and methodcaller objects in the operator + module now support pickling. Added readable and evaluable repr for these + objects. Based on patch by Josh Rosenberg. -- Issue #23146: Fix mishandling of absolute Windows paths with forward - slashes in pathlib. +- Issue #22107: tempfile.gettempdir() and tempfile.mkdtemp() now try again + when a directory with the chosen name already exists on Windows as well as + on Unix. tempfile.mkstemp() now fails early if parent directory is not + valid (not exists or is a file) on Windows. -- Issue #23421: Fixed compression in tarfile CLI. Patch by wdv4758h. +- Issue #23780: Improved error message in os.path.join() with single argument. -- Issue #23367: Fix possible overflows in the unicodedata module. +- Issue #6598: Increased time precision and random number range in + email.utils.make_msgid() to strengthen the uniqueness of the message ID. -- Issue #23361: Fix possible overflow in Windows subprocess creation code. +- Issue #24091: Fixed various crashes in corner cases in C implementation of + ElementTree. -- Issue #23801: Fix issue where cgi.FieldStorage did not always ignore the - entire preamble to a multipart body. +- Issue #21931: msilib.FCICreate() now raises TypeError in the case of a bad + argument instead of a ValueError with a bogus FCI error number. + Patch by Jeffrey Armstrong. -- Issue #23310: Fix MagicMock's initializer to work with __methods__, just - like configure_mock(). Patch by Kasia Jachim. +- Issue #13866: *quote_via* argument added to urllib.parse.urlencode. -- asyncio: New event loop APIs: set_task_factory() and get_task_factory(). +- Issue #20098: New mangle_from policy option for email, default True + for compat32, but False for all other policies. -- asyncio: async() function is deprecated in favour of ensure_future(). +- Issue #24211: The email library now supports RFC 6532: it can generate + headers using utf-8 instead of encoded words. -- Issue #23898: Fix inspect.classify_class_attrs() to support attributes - with overloaded __eq__ and __bool__. Patch by Mike Bayer. +- Issue #16314: Added support for the LZMA compression in distutils. -- Issue #24298: Fix inspect.signature() to correctly unwrap wrappers - around bound methods. +- Issue #21804: poplib now supports RFC 6856 (UTF8). -IDLE ----- +- Issue #18682: Optimized pprint functions for builtin scalar types. -- Issue #23184: remove unused names and imports in idlelib. - Initial patch by Al Sweigart. +- Issue #22027: smtplib now supports RFC 6531 (SMTPUTF8). -Tests ------ +- Issue #23488: Random generator objects now consume 2x less memory on 64-bit. -- Issue #21520: test_zipfile no longer fails if the word 'bad' appears - anywhere in the name of the current directory. +- Issue #1322: platform.dist() and platform.linux_distribution() functions are + now deprecated. Initial patch by Vajrasky Kok. -- Issue #23799: Added test.support.start_threads() for running and - cleaning up multiple threads. +- Issue #22486: Added the math.gcd() function. The fractions.gcd() function now is + deprecated. Based on patch by Mark Dickinson. -- Issue #22390: test.regrtest now emits a warning if temporary files or - directories are left after running a test. +- Issue #24064: Property() docstrings are now writeable. + (Patch by Berker Peksag.) -- Issue #23583: Added tests for standard IO streams in IDLE. +- Issue #22681: Added support for the koi8_t encoding. -Build ------ +- Issue #22682: Added support for the kz1048 encoding. -- Issue #23445: pydebug builds now use "gcc -Og" where possible, to make - the resulting executable faster. +- Issue #23796: peek and read1 methods of BufferedReader now raise ValueError + if they called on a closed object. Patch by John Hergenroeder. -- Issue #24432: Update Windows builds and OS X 10.5 installer to use OpenSSL - 1.0.2c. +- Issue #21795: smtpd now supports the 8BITMIME extension whenever + the new *decode_data* constructor argument is set to False. -C API ------ +- Issue #24155: optimize heapq.heapify() for better cache performance + when heapifying large lists. -- Issue #23998: PyImport_ReInitLock() now checks for lock allocation error +- Issue #21800: imaplib now supports RFC 5161 (enable), RFC 6855 + (utf8/internationalized email) and automatically encodes non-ASCII + usernames and passwords to UTF8. -Documentation -------------- +- Issue #20274: When calling a _sqlite.Connection, it now complains if passed + any keyword arguments. Previously it silently ignored them. -- Issue #24351: Clarify what is meant by "identifier" in the context of - string.Template instances. +- Issue #20274: Remove ignored and erroneous "kwargs" parameters from three + METH_VARARGS methods on _sqlite.Connection. -- Issue #22155: Add File Handlers subsection with createfilehandler to tkinter - doc. Remove obsolete example from FAQ. Patch by Martin Panter. +- Issue #24134: assertRaises(), assertRaisesRegex(), assertWarns() and + assertWarnsRegex() checks now emits a deprecation warning when callable is + None or keyword arguments except msg is passed in the context manager mode. -- Issue #24029: Document the name binding behavior for submodule imports. +- Issue #24018: Add a collections.abc.Generator abstract base class. + Contributed by Stefan Behnel. -- Issue #24077: Fix typo in man page for -I command option: -s, not -S. +- Issue #23880: Tkinter's getint() and getdouble() now support Tcl_Obj. + Tkinter's getdouble() now supports any numbers (in particular int). -Tools/Demos ------------ +- Issue #22619: Added negative limit support in the traceback module. + Based on patch by Dmitry Kazakov. -- Issue #23330: h2py now supports arbitrary filenames in #include. +- Issue #24094: Fix possible crash in json.encode with poorly behaved dict + subclasses. -- Issue #24031: make patchcheck now supports git checkouts, too. +- Issue #9246: On POSIX, os.getcwd() now supports paths longer than 1025 bytes. + Patch written by William Orr. +- Issue #17445: add difflib.diff_bytes() to support comparison of + byte strings (fixes a regression from Python 2). -What's New in Python 3.4.3? -=========================== +- Issue #23917: Fall back to sequential compilation when ProcessPoolExecutor + doesn't exist. Patch by Claudiu Popa. -Release date: 2015-02-23 +- Issue #23008: Fixed resolving attributes with boolean value is False in pydoc. -Core and Builtins ------------------ +- Fix asyncio issue 235: LifoQueue and PriorityQueue's put didn't + increment unfinished tasks (this bug was introduced when + JoinableQueue was merged with Queue). -- Issue #22735: Fix many edge cases (including crashes) involving custom mro() - implementations. +- Issue #23908: os functions now reject paths with embedded null character + on Windows instead of silently truncate them. -- Issue #22896: Avoid using PyObject_AsCharBuffer(), PyObject_AsReadBuffer() - and PyObject_AsWriteBuffer(). +- Issue #23728: binascii.crc_hqx() could return an integer outside of the range + 0-0xffff for empty data. -- Issue #21295: Revert some changes (issue #16795) to AST line numbers and - column offsets that constituted a regression. +- Issue #23887: urllib.error.HTTPError now has a proper repr() representation. + Patch by Berker Peksag. -- Issue #21408: The default __ne__() now returns NotImplemented if __eq__() - returned NotImplemented. Original patch by Martin Panter. +- asyncio: New event loop APIs: set_task_factory() and get_task_factory(). -- Issue #23321: Fixed a crash in str.decode() when error handler returned - replacment string longer than mailformed input data. +- asyncio: async() function is deprecated in favour of ensure_future(). -- Issue #23048: Fix jumping out of an infinite while loop in the pdb. +- Issue 24178: asyncio.Lock, Condition, Semaphore, and BoundedSemaphore + support new 'async with' syntax. Contributed by Yury Selivanov. -- Issue #20335: bytes constructor now raises TypeError when encoding or errors - is specified with non-string argument. Based on patch by Renaud Blanch. +- Issue 24179: Support 'async for' for asyncio.StreamReader. + Contributed by Yury Selivanov. -- Issue #22335: Fix crash when trying to enlarge a bytearray to 0x7fffffff - bytes on a 32-bit platform. +- Issue 24184: Add AsyncIterator and AsyncIterable ABCs to + collections.abc. Contributed by Yury Selivanov. -- Issue #22653: Fix an assertion failure in debug mode when doing a reentrant - dict insertion in debug mode. +- Issue 22547: Implement informative __repr__ for inspect.BoundArguments. + Contributed by Yury Selivanov. -- Issue #22643: Fix integer overflow in Unicode case operations (upper, lower, - title, swapcase, casefold). +- Issue 24190: Implement inspect.BoundArgument.apply_defaults() method. + Contributed by Yury Selivanov. -- Issue #22604: Fix assertion error in debug mode when dividing a complex - number by (nan+0j). +- Issue 20691: Add 'follow_wrapped' argument to + inspect.Signature.from_callable() and inspect.signature(). + Contributed by Yury Selivanov. -- Issue #22470: Fixed integer overflow issues in "backslashreplace", - "xmlcharrefreplace", and "surrogatepass" error handlers. +- Issue 24248: Deprecate inspect.Signature.from_function() and + inspect.Signature.from_builtin(). -- Issue #22520: Fix overflow checking when generating the repr of a unicode - object. +- Issue #23898: Fix inspect.classify_class_attrs() to support attributes + with overloaded __eq__ and __bool__. Patch by Mike Bayer. -- Issue #22519: Fix overflow checking in PyBytes_Repr. +- Issue #24298: Fix inspect.signature() to correctly unwrap wrappers + around bound methods. -- Issue #22518: Fix integer overflow issues in latin-1 encoding. +IDLE +---- -- Issue #23165: Perform overflow checks before allocating memory in the - _Py_char2wchar function. +- Issue #23184: remove unused names and imports in idlelib. + Initial patch by Al Sweigart. -Library -------- +Tests +----- -- Issue #23399: pyvenv creates relative symlinks where possible. +- Issue #21520: test_zipfile no longer fails if the word 'bad' appears + anywhere in the name of the current directory. -- Issue #23099: Closing io.BytesIO with exported buffer is rejected now to - prevent corrupting exported buffer. +- Issue #9517: Move script_helper into the support package. + Patch by Christie Wilson. -- Issue #23363: Fix possible overflow in itertools.permutations. +Documentation +------------- -- Issue #23364: Fix possible overflow in itertools.product. +- Issue #22155: Add File Handlers subsection with createfilehandler to tkinter + doc. Remove obsolete example from FAQ. Patch by Martin Panter. -- Issue #23366: Fixed possible integer overflow in itertools.combinations. +- Issue #24029: Document the name binding behavior for submodule imports. -- Issue #23369: Fixed possible integer overflow in - _json.encode_basestring_ascii. +- Issue #24077: Fix typo in man page for -I command option: -s, not -S -- Issue #23353: Fix the exception handling of generators in - PyEval_EvalFrameEx(). At entry, save or swap the exception state even if - PyEval_EvalFrameEx() is called with throwflag=0. At exit, the exception state - is now always restored or swapped, not only if why is WHY_YIELD or - WHY_RETURN. Patch co-written with Antoine Pitrou. +Tools/Demos +----------- -- Issue #18518: timeit now rejects statements which can't be compiled outside - a function or a loop (e.g. "return" or "break"). +- Issue #24000: Improved Argument Clinic's mapping of converters to legacy + "format units". Updated the documentation to match. -- Issue #23094: Fixed readline with frames in Python implementation of pickle. +- Issue #24001: Argument Clinic converters now use accept={type} + instead of types={'type'} to specify the types the converter accepts. -- Issue #23268: Fixed bugs in the comparison of ipaddress classes. +- Issue #23330: h2py now supports arbitrary filenames in #include. -- Issue #21408: Removed incorrect implementations of __ne__() which didn't - returned NotImplemented if __eq__() returned NotImplemented. The default - __ne__() now works correctly. +- Issue #24031: make patchcheck now supports git checkouts, too. -- Issue #19996: :class:`email.feedparser.FeedParser` now handles (malformed) - headers with no key rather than assuming the body has started. -- Issue #23248: Update ssl error codes from latest OpenSSL git master. +What's New in Python 3.5.0 alpha 4? +=================================== -- Issue #23098: 64-bit dev_t is now supported in the os module. +Release date: 2015-04-19 -- Issue #23250: In the http.cookies module, capitalize "HttpOnly" and "Secure" - as they are written in the standard. +Core and Builtins +----------------- -- Issue #23063: In the disutils' check command, fix parsing of reST with code or - code-block directives. +- Issue #22980: Under Linux, GNU/KFreeBSD and the Hurd, C extensions now include + the architecture triplet in the extension name, to make it easy to test builds + for different ABIs in the same working tree. Under OS X, the extension name + now includes PEP 3149-style information. -- Issue #23209, #23225: selectors.BaseSelector.close() now clears its internal - reference to the selector mapping to break a reference cycle. Initial patch - written by Martin Richard. +- Issue #22631: Added Linux-specific socket constant CAN_RAW_FD_FRAMES. + Patch courtesy of Joe Jevnik. -- Issue #21356: Make ssl.RAND_egd() optional to support LibreSSL. The - availability of the function is checked during the compilation. Patch written - by Bernard Spil. +- Issue #23731: Implement PEP 488: removal of .pyo files. -- Issue #20896, #22935: The :func:`ssl.get_server_certificate` function now - uses the :data:`~ssl.PROTOCOL_SSLv23` protocol by default, not - :data:`~ssl.PROTOCOL_SSLv3`, for maximum compatibility and support platforms - where :data:`~ssl.PROTOCOL_SSLv3` support is disabled. +- Issue #23726: Don't enable GC for user subclasses of non-GC types that + don't add any new fields. Patch by Eugene Toder. -- Issue #23111: In the ftplib, make ssl.PROTOCOL_SSLv23 the default protocol - version. +- Issue #23309: Avoid a deadlock at shutdown if a daemon thread is aborted + while it is holding a lock to a buffered I/O object, and the main thread + tries to use the same I/O object (typically stdout or stderr). A fatal + error is emitted instead. -- Issue #23132: Mitigate regression in speed and clarity in functools.total_ordering. +- Issue #22977: Fixed formatting Windows error messages on Wine. + Patch by Martin Panter. -- Issue #22585: On OpenBSD 5.6 and newer, os.urandom() now calls getentropy(), - instead of reading /dev/urandom, to get pseudo-random bytes. +- Issue #23466: %c, %o, %x, and %X in bytes formatting now raise TypeError on + non-integer input. -- Issue #23112: Fix SimpleHTTPServer to correctly carry the query string and - fragment when it redirects to add a trailing slash. +- Issue #24044: Fix possible null pointer dereference in list.sort in out of + memory conditions. -- Issue #23093: In the io, module allow more operations to work on detached - streams. +- Issue #21354: PyCFunction_New function is exposed by python DLL again. -- Issue #19104: pprint now produces evaluable output for wrapped strings. +Library +------- -- Issue #23071: Added missing names to codecs.__all__. Patch by Martin Panter. +- Issue #23840: tokenize.open() now closes the temporary binary file on error + to fix a resource warning. -- Issue #15513: Added a __sizeof__ implementation for pickle classes. +- Issue #16914: new debuglevel 2 in smtplib adds timestamps to debug output. -- Issue #19858: pickletools.optimize() now aware of the MEMOIZE opcode, can - produce more compact result and no longer produces invalid output if input - data contains MEMOIZE opcodes together with PUT or BINPUT opcodes. +- Issue #7159: urllib.request now supports sending auth credentials + automatically after the first 401. This enhancement is a superset of the + enhancement from issue #19494 and supersedes that change. -- Issue #22095: Fixed HTTPConnection.set_tunnel with default port. The port - value in the host header was set to "None". Patch by Demian Brecht. +- Issue #23703: Fix a regression in urljoin() introduced in 901e4e52b20a. + Patch by Demian Brecht. -- Issue #23016: A warning no longer produces an AttributeError when the program - is run with pythonw.exe. +- Issue #4254: Adds _curses.update_lines_cols() Patch by Arnon Yaari -- Issue #21775: shutil.copytree(): fix crash when copying to VFAT. An exception - handler assumed that that OSError objects always have a 'winerror' attribute. - That is not the case, so the exception handler itself raised AttributeError - when run on Linux (and, presumably, any other non-Windows OS). - Patch by Greg Ward. +- Issue 19933: Provide default argument for ndigits in round. Patch by + Vajrasky Kok. -- Issue #1218234: Fix inspect.getsource() to load updated source of - reloaded module. Initial patch by Berker Peksag. +- Issue #23193: Add a numeric_owner parameter to + tarfile.TarFile.extract and tarfile.TarFile.extractall. Patch by + Michael Vogt and Eric Smith. -- Issue #22959: In the constructor of http.client.HTTPSConnection, prefer the - context's check_hostname attribute over the *check_hostname* parameter. +- Issue #23342: Add a subprocess.run() function than returns a CalledProcess + instance for a more consistent API than the existing call* functions. -- Issue #16043: Add a default limit for the amount of data xmlrpclib.gzip_decode - will return. This resolves CVE-2013-1753. +- Issue #21217: inspect.getsourcelines() now tries to compute the start and end + lines from the code object, fixing an issue when a lambda function is used as + decorator argument. Patch by Thomas Ballinger and Allison Kaptur. -- Issue #22966: Fix __pycache__ pyc file name clobber when pyc_compile is - asked to compile a source file containing multiple dots in the source file - name. +- Issue #24521: Fix possible integer overflows in the pickle module. -- Issue #21971: Update turtledemo doc and add module to the index. +- Issue #22931: Allow '[' and ']' in cookie values. -- Issue #21032. Fixed socket leak if HTTPConnection.getresponse() fails. - Original patch by Martin Panter. +- The keywords attribute of functools.partial is now always a dictionary. -- Issue #22960: Add a context argument to xmlrpclib.ServerProxy constructor. +- Issue #23811: Add missing newline to the PyCompileError error message. + Patch by Alex Shkop. -- Issue #22915: SAX parser now supports files opened with file descriptor or - bytes path. +- Issue #21116: Avoid blowing memory when allocating a multiprocessing shared + array that's larger than 50% of the available RAM. Patch by Médéric Boquien. -- Issue #22609: Constructors and update methods of mapping classes in the - collections module now accept the self keyword argument. +- Issue #22982: Improve BOM handling when seeking to multiple positions of + a writable text file. -- Issue #22788: Add *context* parameter to logging.handlers.HTTPHandler. +- Issue #23464: Removed deprecated asyncio JoinableQueue. -- Issue #22921: Allow SSLContext to take the *hostname* parameter even if - OpenSSL doesn't support SNI. +- Issue #23529: Limit the size of decompressed data when reading from + GzipFile, BZ2File or LZMAFile. This defeats denial of service attacks + using compressed bombs (i.e. compressed payloads which decompress to a huge + size). Patch by Martin Panter and Nikolaus Rath. -- Issue #22894: TestCase.subTest() would cause the test suite to be stopped - when in failfast mode, even in the absence of failures. +- Issue #21859: Added Python implementation of io.FileIO. -- Issue #22638: SSLv3 is now disabled throughout the standard library. - It can still be enabled by instantiating a SSLContext manually. +- Issue #23865: close() methods in multiple modules now are idempotent and more + robust at shutdown. If they need to release multiple resources, all are + released even if errors occur. -- Issue #22370: Windows detection in pathlib is now more robust. +- Issue #23400: Raise same exception on both Python 2 and 3 if sem_open is not + available. Patch by Davin Potts. -- Issue #22841: Reject coroutines in asyncio add_signal_handler(). - Patch by Ludovic.Gasc. +- Issue #10838: The subprocess now module includes SubprocessError and + TimeoutError in its list of exported names for the users wild enough + to use ``from subprocess import *``. -- Issue #22849: Fix possible double free in the io.TextIOWrapper constructor. +- Issue #23411: Added DefragResult, ParseResult, SplitResult, DefragResultBytes, + ParseResultBytes, and SplitResultBytes to urllib.parse.__all__. + Patch by Martin Panter. -- Issue #12728: Different Unicode characters having the same uppercase but - different lowercase are now matched in case-insensitive regular expressions. +- Issue #23881: urllib.request.ftpwrapper constructor now closes the socket if + the FTP connection failed to fix a ResourceWarning. -- Issue #22821: Fixed fcntl() with integer argument on 64-bit big-endian - platforms. +- Issue #23853: :meth:`socket.socket.sendall` does no more reset the socket + timeout each time data is sent successfuly. The socket timeout is now the + maximum total duration to send all data. -- Issue #22406: Fixed the uu_codec codec incorrectly ported to 3.x. - Based on patch by Martin Panter. +- Issue #22721: An order of multiline pprint output of set or dict containing + orderable and non-orderable elements no longer depends on iteration order of + set or dict. -- Issue #17293: uuid.getnode() now determines MAC address on AIX using netstat. - Based on patch by Aivars Kalvāns. +- Issue #15133: _tkinter.tkapp.getboolean() now supports Tcl_Obj and always + returns bool. tkinter.BooleanVar now validates input values (accepted bool, + int, str, and Tcl_Obj). tkinter.BooleanVar.get() now always returns bool. -- Issue #22769: Fixed ttk.Treeview.tag_has() when called without arguments. +- Issue #10590: xml.sax.parseString() now supports string argument. -- Issue #22417: Verify certificates by default in httplib (PEP 476). +- Issue #23338: Fixed formatting ctypes error messages on Cygwin. + Patch by Makoto Kato. -- Issue #22775: Fixed unpickling of http.cookies.SimpleCookie with protocol 2 - and above. Patch by Tim Graham. +- Issue #15582: inspect.getdoc() now follows inheritance chains. -- Issue #22366: urllib.request.urlopen will accept a context object - (SSLContext) as an argument which will then used be for HTTPS connection. - Patch by Alex Gaynor. +- Issue #2175: SAX parsers now support a character stream of InputSource object. -- Issue #22776: Brought excluded code into the scope of a try block in - SysLogHandler.emit(). +- Issue #16840: Tkinter now supports 64-bit integers added in Tcl 8.4 and + arbitrary precision integers added in Tcl 8.5. -- Issue #22665: Add missing get_terminal_size and SameFileError to - shutil.__all__. +- Issue #23834: Fix socket.sendto(), use the C Py_ssize_t type to store the + result of sendto() instead of the C int type. -- Issue #17381: Fixed handling of case-insensitive ranges in regular - expressions. +- Issue #23618: :meth:`socket.socket.connect` now waits until the connection + completes instead of raising :exc:`InterruptedError` if the connection is + interrupted by signals, signal handlers don't raise an exception and the + socket is blocking or has a timeout. :meth:`socket.socket.connect` still + raise :exc:`InterruptedError` for non-blocking sockets. -- Issue #22410: Module level functions in the re module now cache compiled - locale-dependent regular expressions taking into account the locale. +- Issue #21526: Tkinter now supports new boolean type in Tcl 8.5. -- Issue #22759: Query methods on pathlib.Path() (exists(), is_dir(), etc.) - now return False when the underlying stat call raises NotADirectoryError. +- Issue #23836: Fix the faulthandler module to handle reentrant calls to + its signal handlers. -- Issue #8876: distutils now falls back to copying files when hard linking - doesn't work. This allows use with special filesystems such as VirtualBox - shared folders. +- Issue #23838: linecache now clears the cache and returns an empty result on + MemoryError. -- Issue #18853: Fixed ResourceWarning in shlex.__nain__. +- Issue #10395: Added os.path.commonpath(). Implemented in posixpath and ntpath. + Based on patch by Rafik Draoui. -- Issue #9351: Defaults set with set_defaults on an argparse subparser - are no longer ignored when also set on the parent parser. +- Issue #23611: Serializing more "lookupable" objects (such as unbound methods + or nested classes) now are supported with pickle protocols < 4. -- Issue #21991: Make email.headerregistry's header 'params' attributes - be read-only (MappingProxyType). Previously the dictionary was modifiable - but a new one was created on each access of the attribute. +- Issue #13583: sqlite3.Row now supports slice indexing. -- Issue #22641: In asyncio, the default SSL context for client connections - is now created using ssl.create_default_context(), for stronger security. +- Issue #18473: Fixed 2to3 and 3to2 compatible pickle mappings. Fixed + ambigious reverse mappings. Added many new mappings. Import mapping is no + longer applied to modules already mapped with full name mapping. -- Issue #22435: Fix a file descriptor leak when SocketServer bind fails. +- Issue #23485: select.select() is now retried automatically with the + recomputed timeout when interrupted by a signal, except if the signal handler + raises an exception. This change is part of the PEP 475. -- Issue #13096: Fixed segfault in CTypes POINTER handling of large - values. +- Issue #23752: When built from an existing file descriptor, io.FileIO() now + only calls fstat() once. Before fstat() was called twice, which was not + necessary. -- Issue #11694: Raise ConversionError in xdrlib as documented. Patch - by Filip Gruszczyński and Claudiu Popa. +- Issue #23704: collections.deque() objects now support __add__, __mul__, and + __imul__(). -- Issue #22462: Fix pyexpat's creation of a dummy frame to make it - appear in exception tracebacks. +- Issue #23171: csv.Writer.writerow() now supports arbitrary iterables. -- Issue #21173: Fix len() on a WeakKeyDictionary when .clear() was called - with an iterator alive. +- Issue #23745: The new email header parser now handles duplicate MIME + parameter names without error, similar to how get_param behaves. -- Issue #11866: Eliminated race condition in the computation of names - for new threads. +- Issue #22117: Fix os.utime(), it now rounds the timestamp towards minus + infinity (-inf) instead of rounding towards zero. -- Issue #21905: Avoid RuntimeError in pickle.whichmodule() when sys.modules - is mutated while iterating. Patch by Olivier Grisel. +- Issue #23310: Fix MagicMock's initializer to work with __methods__, just + like configure_mock(). Patch by Kasia Jachim. - -- Issue #22219: The zipfile module CLI now adds entries for directories - (including empty directories) in ZIP file. +Build +----- -- Issue #22449: In the ssl.SSLContext.load_default_certs, consult the - environmental variables SSL_CERT_DIR and SSL_CERT_FILE on Windows. +- Issue #23817: FreeBSD now uses "1.0" the the SOVERSION as other operating + systems, instead of just "1". -- Issue #20076: Added non derived UTF-8 aliases to locale aliases table. +- Issue #23501: Argument Clinic now generates code into separate files by default. -- Issue #20079: Added locales supported in glibc 2.18 to locale alias table. +Tests +----- -- Issue #22396: On 32-bit AIX platform, don't expose os.posix_fadvise() nor - os.posix_fallocate() because their prototypes in system headers are wrong. +- Issue #23799: Added test.support.start_threads() for running and + cleaning up multiple threads. -- Issue #22517: When a io.BufferedRWPair object is deallocated, clear its - weakrefs. +- Issue #22390: test.regrtest now emits a warning if temporary files or + directories are left after running a test. -- Issue #22448: Improve canceled timer handles cleanup to prevent - unbound memory usage. Patch by Joshua Moore-Oliva. +Tools/Demos +----------- -- Issue #23009: Make sure selectors.EpollSelecrtor.select() works when no - FD is registered. +- Issue #18128: pygettext now uses standard +NNNN format in the + POT-Creation-Date header. -IDLE ----- +- Issue #23935: Argument Clinic's understanding of format units + accepting bytes, bytearrays, and buffers is now consistent with + both the documentation and the implementation. -- Issue #20577: Configuration of the max line length for the FormatParagraph - extension has been moved from the General tab of the Idle preferences dialog - to the FormatParagraph tab of the Config Extensions dialog. - Patch by Tal Einat. +- Issue #23944: Argument Clinic now wraps long impl prototypes at column 78. -- Issue #16893: Update Idle doc chapter to match current Idle and add new - information. +- Issue #20586: Argument Clinic now ensures that functions without docstrings + have signatures. -- Issue #3068: Add Idle extension configuration dialog to Options menu. - Changes are written to HOME/.idlerc/config-extensions.cfg. - Original patch by Tal Einat. +- Issue #23492: Argument Clinic now generates argument parsing code with + PyArg_Parse instead of PyArg_ParseTuple if possible. -- Issue #16233: A module browser (File : Class Browser, Alt+C) requires a - editor window with a filename. When Class Browser is requested otherwise, - from a shell, output window, or 'Untitled' editor, Idle no longer displays - an error box. It now pops up an Open Module box (Alt+M). If a valid name - is entered and a module is opened, a corresponding browser is also opened. +- Issue #23500: Argument Clinic is now smarter about generating the "#ifndef" + (empty) definition of the methoddef macro: it's only generated once, even + if Argument Clinic processes the same symbol multiple times, and it's emitted + at the end of all processing rather than immediately after the first use. -- Issue #4832: Save As to type Python files automatically adds .py to the - name you enter (even if your system does not display it). Some systems - automatically add .txt when type is Text files. +C API +----- -- Issue #21986: Code objects are not normally pickled by the pickle module. - To match this, they are no longer pickled when running under Idle. +- Issue #23998: PyImport_ReInitLock() now checks for lock allocation error -- Issue #23180: Rename IDLE "Windows" menu item to "Window". - Patch by Al Sweigart. -Tests ------ +What's New in Python 3.5.0 alpha 3? +=================================== -- Issue #23392: Added tests for marshal C API that works with FILE*. +Release date: 2015-03-28 -- Issue #18982: Add tests for CLI of the calendar module. +Core and Builtins +----------------- -- Issue #19548: Added some additional checks to test_codecs to ensure that - statements in the updated documentation remain accurate. Patch by Martin - Panter. +- Issue #23573: Increased performance of string search operations (str.find, + str.index, str.count, the in operator, str.split, str.partition) with + arguments of different kinds (UCS1, UCS2, UCS4). -- Issue #22838: All test_re tests now work with unittest test discovery. +- Issue #23753: Python doesn't support anymore platforms without stat() or + fstat(), these functions are always required. -- Issue #22173: Update lib2to3 tests to use unittest test discovery. +- Issue #23681: The -b option now affects comparisons of bytes with int. -- Issue #16000: Convert test_curses to use unittest. +- Issue #23632: Memoryviews now allow tuple indexing (including for + multi-dimensional memoryviews). -- Issue #21456: Skip two tests in test_urllib2net.py if _ssl module not - present. Patch by Remi Pointel. +- Issue #23192: Fixed generator lambdas. Patch by Bruno Cauet. -- Issue #22770: Prevent some Tk segfaults on OS X when running gui tests. +- Issue #23629: Fix the default __sizeof__ implementation for variable-sized + objects. -- Issue #23211: Workaround test_logging failure on some OS X 10.6 systems. +Library +------- -- Issue #23345: Prevent test_ssl failures with large OpenSSL patch level - values (like 0.9.8zc). +- Issue #14260: The groupindex attribute of regular expression pattern object + now is non-modifiable mapping. -- Issue #22289: Prevent test_urllib2net failures due to ftp connection timeout. +- Issue #23792: Ignore KeyboardInterrupt when the pydoc pager is active. + This mimics the behavior of the standard unix pagers, and prevents + pipepager from shutting down while the pager itself is still running. -Build ------ +- Issue #23775: pprint() of OrderedDict now outputs the same representation + as repr(). -- Issue #15506: Use standard PKG_PROG_PKG_CONFIG autoconf macro in the configure - script. +- Issue #23765: Removed IsBadStringPtr calls in ctypes -- Issue #22935: Allow the ssl module to be compiled if openssl doesn't support - SSL 3. +- Issue #22364: Improved some re error messages using regex for hints. -- Issue #16537: Check whether self.extensions is empty in setup.py. Patch by - Jonathan Hosmer. +- Issue #23742: ntpath.expandvars() no longer loses unbalanced single quotes. -- Issue #18096: Fix library order returned by python-config. +- Issue #21717: The zipfile.ZipFile.open function now supports 'x' (exclusive + creation) mode. -- Issue #17219: Add library build dir for Python extension cross-builds. +- Issue #21802: The reader in BufferedRWPair now is closed even when closing + writer failed in BufferedRWPair.close(). -- Issue #17128: Use private version of OpenSSL for 3.4.3 OS X 10.5+ installer. +- Issue #23622: Unknown escapes in regular expressions that consist of ``'\'`` + and ASCII letter now raise a deprecation warning and will be forbidden in + Python 3.6. -C API ------ +- Issue #23671: string.Template now allows to specify the "self" parameter as + keyword argument. string.Formatter now allows to specify the "self" and + the "format_string" parameters as keyword arguments. -- Issue #22079: PyType_Ready() now checks that statically allocated type has - no dynamically allocated bases. +- Issue #23502: The pprint module now supports mapping proxies. -Documentation -------------- +- Issue #17530: pprint now wraps long bytes objects and bytearrays. -- Issue #19548: Update the codecs module documentation to better cover the - distinction between text encodings and other codecs, together with other - clarifications. Patch by Martin Panter. +- Issue #22687: Fixed some corner cases in breaking words in tetxtwrap. + Got rid of quadratic complexity in breaking long words. -- Issue #22914: Update the Python 2/3 porting HOWTO to describe a more automated - approach. +- Issue #4727: The copy module now uses pickle protocol 4 (PEP 3154) and + supports copying of instances of classes whose __new__ method takes + keyword-only arguments. -- Issue #21514: The documentation of the json module now refers to new JSON RFC - 7159 instead of obsoleted RFC 4627. +- Issue #23491: Added a zipapp module to support creating executable zip + file archives of Python code. Registered ".pyz" and ".pyzw" extensions + on Windows for these archives (PEP 441). -Tools/Demos ------------ +- Issue #23657: Avoid explicit checks for str in zipapp, adding support + for pathlib.Path objects as arguments. -- Issue #22314: pydoc now works when the LINES environment variable is set. +- Issue #23688: Added support of arbitrary bytes-like objects and avoided + unnecessary copying of memoryview in gzip.GzipFile.write(). + Original patch by Wolfgang Maier. -Windows -------- +- Issue #23252: Added support for writing ZIP files to unseekable streams. -- Issue #17896: The Windows build scripts now expect external library sources - to be in ``PCbuild\..\externals`` rather than ``PCbuild\..\..``. +- Issue #23647: Increase impalib's MAXLINE to accommodate modern mailbox sizes. -- Issue #17717: The Windows build scripts now use a copy of NASM pulled from - svn.python.org to build OpenSSL. +- Issue #23539: If body is None, http.client.HTTPConnection.request now sets + Content-Length to 0 for PUT, POST, and PATCH headers to avoid 411 errors from + some web servers. -- Issue #22644: The bundled version of OpenSSL has been updated to 1.0.1j. +- Issue #22351: The nntplib.NNTP constructor no longer leaves the connection + and socket open until the garbage collector cleans them up. Patch by + Martin Panter. +- Issue #23704: collections.deque() objects now support methods for index(), + insert(), and copy(). This allows deques to be registered as a + MutableSequence and it improves their substitutablity for lists. -What's New in Python 3.4.2? -=========================== +- Issue #23715: :func:`signal.sigwaitinfo` and :func:`signal.sigtimedwait` are + now retried when interrupted by a signal not in the *sigset* parameter, if + the signal handler does not raise an exception. signal.sigtimedwait() + recomputes the timeout with a monotonic clock when it is retried. -Release date: 2014-10-06 +- Issue #23001: Few functions in modules mmap, ossaudiodev, socket, ssl, and + codecs, that accepted only read-only bytes-like object now accept writable + bytes-like object too. -Library -------- +- Issue #23646: If time.sleep() is interrupted by a signal, the sleep is now + retried with the recomputed delay, except if the signal handler raises an + exception (PEP 475). -- Issue #10510: distutils register and upload methods now use HTML standards - compliant CRLF line endings. +- Issue #23136: _strptime now uniformly handles all days in week 0, including + Dec 30 of previous year. Based on patch by Jim Carroll. -- Issue #9850: Fixed macpath.join() for empty first component. Patch by - Oleg Oshmyan. +- Issue #23700: Iterator of NamedTemporaryFile now keeps a reference to + NamedTemporaryFile instance. Patch by Bohuslav Kabrda. -- Issue #22427: TemporaryDirectory no longer attempts to clean up twice when - used in the with statement in generator. +- Issue #22903: The fake test case created by unittest.loader when it fails + importing a test module is now picklable. -- Issue #20912: Now directories added to ZIP file have correct Unix and MS-DOS - directory attributes. +- Issue #22181: On Linux, os.urandom() now uses the new getrandom() syscall if + available, syscall introduced in the Linux kernel 3.17. It is more reliable + and more secure, because it avoids the need of a file descriptor and waits + until the kernel has enough entropy. + +- Issue #2211: Updated the implementation of the http.cookies.Morsel class. + Setting attributes key, value and coded_value directly now is deprecated. + update() and setdefault() now transform and check keys. Comparing for + equality now takes into account attributes key, value and coded_value. + copy() now returns a Morsel, not a dict. repr() now contains all attributes. + Optimized checking keys and quoting values. Added new tests. + Original patch by Demian Brecht. -- Issue #21866: ZipFile.close() no longer writes ZIP64 central directory - records if allowZip64 is false. +- Issue #18983: Allow selection of output units in timeit. + Patch by Julian Gindi. -- Issue #22415: Fixed debugging output of the GROUPREF_EXISTS opcode in the re - module. Removed trailing spaces in debugging output. +- Issue #23631: Fix traceback.format_list when a traceback has been mutated. -- Issue #22423: Unhandled exception in thread no longer causes unhandled - AttributeError when sys.stderr is None. +- Issue #23568: Add rdivmod support to MagicMock() objects. + Patch by Håkan Lövdahl. -- Issue #21332: Ensure that ``bufsize=1`` in subprocess.Popen() selects - line buffering, rather than block buffering. Patch by Akira Li. +- Issue #2052: Add charset parameter to HtmlDiff.make_file(). +- Issue #23668: Support os.truncate and os.ftruncate on Windows. -What's New in Python 3.4.2rc1? -============================== +- Issue #23138: Fixed parsing cookies with absent keys or values in cookiejar. + Patch by Demian Brecht. -Release date: 2014-09-22 +- Issue #23051: multiprocessing.Pool methods imap() and imap_unordered() now + handle exceptions raised by an iterator. Patch by Alon Diamant and Davin + Potts. -Core and Builtins ------------------ +- Issue #23581: Add matmul support to MagicMock. Patch by Håkan Lövdahl. -- Issue #22258: Fix the the internal function set_inheritable() on Illumos. - This platform exposes the function ``ioctl(FIOCLEX)``, but calling it fails - with errno is ENOTTY: "Inappropriate ioctl for device". set_inheritable() - now falls back to the slower ``fcntl()`` (``F_GETFD`` and then ``F_SETFD``). +- Issue #23566: enable(), register(), dump_traceback() and + dump_traceback_later() functions of faulthandler now accept file + descriptors. Patch by Wei Wu. -- Issue #21669: With the aid of heuristics in SyntaxError.__init__, the - parser now attempts to generate more meaningful (or at least more search - engine friendly) error messages when "exec" and "print" are used as - statements. +- Issue #22928: Disabled HTTP header injections in http.client. + Original patch by Demian Brecht. -- Issue #21642: If the conditional if-else expression, allow an integer written - with no space between itself and the ``else`` keyword (e.g. ``True if 42else - False``) to be valid syntax. +- Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with + imp.reload(). Patch by Thomas Kluyver. -- Issue #21523: Fix over-pessimistic computation of the stack effect of - some opcodes in the compiler. This also fixes a quadratic compilation - time issue noticeable when compiling code with a large number of "and" - and "or" operators. +- Issue #23605: os.walk() now calls os.scandir() instead of os.listdir(). + The usage of os.scandir() reduces the number of calls to os.stat(). + Initial patch written by Ben Hoyt. -Library -------- +Build +----- -- Issue #21091: Fix API bug: email.message.EmailMessage.is_attachment is now - a method. Since EmailMessage is provisional, we can change the API in a - maintenance release, but we use a trick to remain backward compatible with - 3.4.0/1. +- Issue #23585: make patchcheck will ensure the interpreter is built. -- Issue #21079: Fix email.message.EmailMessage.is_attachment to return the - correct result when the header has parameters as well as a value. +Tests +----- -- Issue #22247: Add NNTPError to nntplib.__all__. +- Issue #23583: Added tests for standard IO streams in IDLE. -- Issue #4180: The warnings registries are now reset when the filters - are modified. +- Issue #22289: Prevent test_urllib2net failures due to ftp connection timeout. -- Issue #22419: Limit the length of incoming HTTP request in wsgiref server to - 65536 bytes and send a 414 error code for higher lengths. Patch contributed - by Devin Cook. +Tools/Demos +----------- -- Lax cookie parsing in http.cookies could be a security issue when combined - with non-standard cookie handling in some Web browsers. Reported by - Sergey Bobrov. +- Issue #22826: The result of open() in Tools/freeze/bkfile.py is now better + compatible with regular files (in particular it now supports the context + management protocol). -- Issue #22384: An exception in Tkinter callback no longer crashes the program - when it is run with pythonw.exe. -- Issue #22168: Prevent turtle AttributeError with non-default Canvas on OS X. +What's New in Python 3.5 alpha 2? +================================= -- Issue #21147: sqlite3 now raises an exception if the request contains a null - character instead of truncate it. Based on patch by Victor Stinner. +Release date: 2015-03-09 -- Issue #21951: Fixed a crash in Tkinter on AIX when called Tcl command with - empty string or tuple argument. +Core and Builtins +----------------- -- Issue #21951: Tkinter now most likely raises MemoryError instead of crash - if the memory allocation fails. +- Issue #23571: PyObject_Call() and PyCFunction_Call() now raise a SystemError + if a function returns a result and raises an exception. The SystemError is + chained to the previous exception. -- Issue #22338: Fix a crash in the json module on memory allocation failure. +Library +------- -- Issue #22226: First letter no longer is stripped from the "status" key in - the result of Treeview.heading(). +- Issue #22524: New os.scandir() function, part of the PEP 471: "os.scandir() + function -- a better and faster directory iterator". Patch written by Ben + Hoyt. -- Issue #19524: Fixed resource leak in the HTTP connection when an invalid - response is received. Patch by Martin Panter. +- Issue #23103: Reduced the memory consumption of IPv4Address and IPv6Address. -- Issue #22051: turtledemo no longer reloads examples to re-run them. - Initialization of variables and gui setup should be done in main(), - which is called each time a demo is run, but not on import. +- Issue #21793: BaseHTTPRequestHandler again logs response code as numeric, + not as stringified enum. Patch by Demian Brecht. -- Issue #21933: Turtledemo users can change the code font size with a menu - selection or control(command) '-' or '+' or control-mousewheel. - Original patch by Lita Cho. +- Issue #23476: In the ssl module, enable OpenSSL's X509_V_FLAG_TRUSTED_FIRST + flag on certificate stores when it is available. -- Issue #21597: The separator between the turtledemo text pane and the drawing - canvas can now be grabbed and dragged with a mouse. The code text pane can - be widened to easily view or copy the full width of the text. The canvas - can be widened on small screens. Original patches by Jan Kanis and Lita Cho. +- Issue #23576: Avoid stalling in SSL reads when EOF has been reached in the + SSL layer but the underlying connection hasn't been closed. -- Issue #18132: Turtledemo buttons no longer disappear when the window is - shrunk. Original patches by Jan Kanis and Lita Cho. +- Issue #23504: Added an __all__ to the types module. -- Issue #22216: smtplib now resets its state more completely after a quit. The - most obvious consequence of the previous behavior was a STARTTLS failure - during a connect/starttls/quit/connect/starttls sequence. +- Issue #23563: Optimized utility functions in urllib.parse. -- Issue #22185: Fix an occasional RuntimeError in threading.Condition.wait() - caused by mutation of the waiters queue without holding the lock. Patch - by Doug Zongker. +- Issue #7830: Flatten nested functools.partial. -- Issue #22182: Use e.args to unpack exceptions correctly in - distutils.file_util.move_file. Patch by Claudiu Popa. +- Issue #20204: Added the __module__ attribute to _tkinter classes. -- The webbrowser module now uses subprocess's start_new_session=True rather - than a potentially risky preexec_fn=os.setsid call. +- Issue #19980: Improved help() for non-recognized strings. help('') now + shows the help on str. help('help') now shows the help on help(). + Original patch by Mark Lawrence. -- Issue #22236: Fixed Tkinter images copying operations in NoDefaultRoot mode. +- Issue #23521: Corrected pure python implementation of timedelta division. -- Issue #22191: Fix warnings.__all__. + * Eliminated OverflowError from timedelta * float for some floats; + * Corrected rounding in timedlta true division. -- Issue #15696: Add a __sizeof__ implementation for mmap objects on Windows. +- Issue #21619: Popen objects no longer leave a zombie after exit in the with + statement if the pipe was broken. Patch by Martin Panter. -- Issue #22068: Avoided reference loops with Variables and Fonts in Tkinter. +- Issue #22936: Make it possible to show local variables in tracebacks for + both the traceback module and unittest. -- Issue #22165: SimpleHTTPRequestHandler now supports undecodable file names. +- Issue #15955: Add an option to limit the output size in bz2.decompress(). + Patch by Nikolaus Rath. -- Issue #8797: Raise HTTPError on failed Basic Authentication immediately. - Initial patch by Sam Bull. +- Issue #6639: Module-level turtle functions no longer raise TclError after + closing the window. -- Issue #20729: Restored the use of lazy iterkeys()/itervalues()/iteritems() - in the mailbox module. +- Issues #814253, #9179: Group references and conditional group references now + work in lookbehind assertions in regular expressions. -- Issue #21448: Changed FeedParser feed() to avoid O(N**2) behavior when - parsing long line. Original patch by Raymond Hettinger. +- Issue #23215: Multibyte codecs with custom error handlers that ignores errors + consumed too much memory and raised SystemError or MemoryError. + Original patch by Aleksi Torhamo. -- Issue #22184: The functools LRU Cache decorator factory now gives an earlier - and clearer error message when the user forgets the required parameters. +- Issue #5700: io.FileIO() called flush() after closing the file. + flush() was not called in close() if closefd=False. -- Issue #17923: glob() patterns ending with a slash no longer match non-dirs on - AIX. Based on patch by Delhallt. +- Issue #23374: Fixed pydoc failure with non-ASCII files when stdout encoding + differs from file system encoding (e.g. on Mac OS). -- Issue #21121: Don't force 3rd party C extensions to be built with - -Werror=declaration-after-statement. +- Issue #23481: Remove RC4 from the SSL module's default cipher list. -- Issue #21975: Fixed crash when using uninitialized sqlite3.Row (in particular - when unpickling pickled sqlite3.Row). sqlite3.Row is now initialized in the - __new__() method. +- Issue #21548: Fix pydoc.synopsis() and pydoc.apropos() on modules with empty + docstrings. -- Issue #21580: Now Tkinter correctly handles bytes arguments passed to Tk. - In particular this allows to initialize images from binary data. +- Issue #22885: Fixed arbitrary code execution vulnerability in the dbm.dumb + module. Original patch by Claudiu Popa. -- Issue #17172: Make turtledemo start as active on OS X even when run with - subprocess. Patch by Lita Cho. +- Issue #23239: ssl.match_hostname() now supports matching of IP addresses. -- Issue #21704: Fix build error for _multiprocessing when semaphores - are not available. Patch by Arfrever Frehtes Taifersar Arahesis. +- Issue #23146: Fix mishandling of absolute Windows paths with forward + slashes in pathlib. -- Fix repr(_socket.socket) on Windows 64-bit: don't fail with OverflowError - on closed socket. repr(socket.socket) already works fine. +- Issue #23096: Pickle representation of floats with protocol 0 now is the same + for both Python and C implementations. -- Issue #16133: The asynchat.async_chat.handle_read() method now ignores - BlockingIOError exceptions. +- Issue #19105: pprint now more efficiently uses free space at the right. -- Issue #22044: Fixed premature DECREF in call_tzinfo_method. - Patch by Tom Flanagan. +- Issue #14910: Add allow_abbrev parameter to argparse.ArgumentParser. Patch by + Jonathan Paugh, Steven Bethard, paul j3 and Daniel Eriksson. -- Issue #19884: readline: Disable the meta modifier key if stdout is not - a terminal to not write the ANSI sequence "\033[1034h" into stdout. This - sequence is used on some terminal (ex: TERM=xterm-256color") to enable - support of 8 bit characters. +- Issue #21717: tarfile.open() now supports 'x' (exclusive creation) mode. -- Issue #21888: plistlib's load() and loads() now work if the fmt parameter is - specified. +- Issue #23344: marshal.dumps() is now 20-25% faster on average. -- Issue #21044: tarfile.open() now handles fileobj with an integer 'name' - attribute. Based on patch by Antoine Pietri. +- Issue #20416: marshal.dumps() with protocols 3 and 4 is now 40-50% faster on + average. -- Issue #21867: Prevent turtle crash due to invalid undo buffer size. +- Issue #23421: Fixed compression in tarfile CLI. Patch by wdv4758h. -- Issue #19076: Don't pass the redundant 'file' argument to self.error(). +- Issue #23367: Fix possible overflows in the unicodedata module. -- Issue #21942: Fixed source file viewing in pydoc's server mode on Windows. +- Issue #23361: Fix possible overflow in Windows subprocess creation code. -- Issue #11259: asynchat.async_chat().set_terminator() now raises a ValueError - if the number of received bytes is negative. +- logging.handlers.QueueListener now takes a respect_handler_level keyword + argument which, if set to True, will pass messages to handlers taking handler + levels into account. -- Issue #12523: asynchat.async_chat.push() now raises a TypeError if it doesn't - get a bytes string +- Issue #19705: turtledemo now has a visual sorting algorithm demo. Original + patch from Jason Yeo. -- Issue #21707: Add missing kwonlyargcount argument to - ModuleFinder.replace_paths_in_code(). +- Issue #23801: Fix issue where cgi.FieldStorage did not always ignore the + entire preamble to a multipart body. -- Issue #20639: calling Path.with_suffix('') allows removing the suffix - again. Patch by July Tikhonov. +Build +----- -- Issue #21714: Disallow the construction of invalid paths using - Path.with_name(). Original patch by Antony Lee. +- Issue #23445: pydebug builds now use "gcc -Og" where possible, to make + the resulting executable faster. -- Issue #21897: Fix a crash with the f_locals attribute with closure - variables when frame.clear() has been called. +- Issue #23686: Update OS X 10.5 installer build to use OpenSSL 1.0.2a. -- Issue #21151: Fixed a segfault in the winreg module when ``None`` is passed - as a ``REG_BINARY`` value to SetValueEx. Patch by John Ehresman. +C API +----- -- Issue #21090: io.FileIO.readall() does not ignore I/O errors anymore. Before, - it ignored I/O errors if at least the first C call read() succeed. +- Issue #20204: Deprecation warning is now raised for builtin type without the + __module__ attribute. -- Issue #21781: ssl.RAND_add() now supports strings longer than 2 GB. +Windows +------- -- Issue #11453: asyncore: emit a ResourceWarning when an unclosed file_wrapper - object is destroyed. The destructor now closes the file if needed. The - close() method can now be called twice: the second call does nothing. +- Issue #23465: Implement PEP 486 - Make the Python Launcher aware of virtual + environments. Patch by Paul Moore. -- Issue #21858: Better handling of Python exceptions in the sqlite3 module. +- Issue #23437: Make user scripts directory versioned on Windows. Patch by Paul + Moore. -- Issue #21476: Make sure the email.parser.BytesParser TextIOWrapper is - discarded after parsing, so the input file isn't unexpectedly closed. -- Issue #21729: Used the "with" statement in the dbm.dumb module to ensure - files closing. Patch by Claudiu Popa. +What's New in Python 3.5 alpha 1? +================================= -- Issue #21491: socketserver: Fix a race condition in child processes reaping. +Release date: 2015-02-08 -- Issue #21832: Require named tuple inputs to be exact strings. +Core and Builtins +----------------- -- Issue #19145: The times argument for itertools.repeat now handles - negative values the same way for keyword arguments as it does for - positional arguments. +- Issue #23285: PEP 475 - EINTR handling. -- Issue #21812: turtle.shapetransform did not tranform the turtle on the - first call. (Issue identified and fixed by Lita Cho.) +- Issue #22735: Fix many edge cases (including crashes) involving custom mro() + implementations. -- Issue #21635: The difflib SequenceMatcher.get_matching_blocks() method - cache didn't match the actual result. The former was a list of tuples - and the latter was a list of named tuples. +- Issue #22896: Avoid using PyObject_AsCharBuffer(), PyObject_AsReadBuffer() + and PyObject_AsWriteBuffer(). -- Issue #21722: The distutils "upload" command now exits with a non-zero - return code when uploading fails. Patch by Martin Dengler. +- Issue #21295: Revert some changes (issue #16795) to AST line numbers and + column offsets that constituted a regression. -- Issue #21723: asyncio.Queue: support any type of number (ex: float) for the - maximum size. Patch written by Vajrasky Kok. +- Issue #22986: Allow changing an object's __class__ between a dynamic type and + static type in some cases. -- Issue #21326: Add a new is_closed() method to asyncio.BaseEventLoop. - run_forever() and run_until_complete() methods of asyncio.BaseEventLoop now - raise an exception if the event loop was closed. +- Issue #15859: PyUnicode_EncodeFSDefault(), PyUnicode_EncodeMBCS() and + PyUnicode_EncodeCodePage() now raise an exception if the object is not an + Unicode object. For PyUnicode_EncodeFSDefault(), it was already the case on + platforms other than Windows. Patch written by Campbell Barton. -- Issue #21774: Fixed NameError for an incorrect variable reference in the - XML Minidom code for creating processing instructions. - (Found and fixed by Claudiu Popa.) +- Issue #21408: The default __ne__() now returns NotImplemented if __eq__() + returned NotImplemented. Original patch by Martin Panter. -- Issue #21766: Prevent a security hole in CGIHTTPServer by URL unquoting paths - before checking for a CGI script at that path. +- Issue #23321: Fixed a crash in str.decode() when error handler returned + replacment string longer than mailformed input data. -- Issue #21310: Fixed possible resource leak in failed open(). +- Issue #22286: The "backslashreplace" error handlers now works with + decoding and translating. -- Issue #21677: Fixed chaining nonnormalized exceptions in io close() methods. +- Issue #23253: Delay-load ShellExecute[AW] in os.startfile for reduced + startup overhead on Windows. -- Issue #11709: Fix the pydoc.help function to not fail when sys.stdin is not a - valid file. +- Issue #22038: pyatomic.h now uses stdatomic.h or GCC built-in functions for + atomic memory access if available. Patch written by Vitor de Lima and Gustavo + Temple. -- Issue #13223: Fix pydoc.writedoc so that the HTML documentation for methods - that use 'self' in the example code is generated correctly. +- Issue #20284: %-interpolation (aka printf) formatting added for bytes and + bytearray. -- Issue #21463: In urllib.request, fix pruning of the FTP cache. +- Issue #23048: Fix jumping out of an infinite while loop in the pdb. -- Issue #21618: The subprocess module could fail to close open fds that were - inherited by the calling process and already higher than POSIX resource - limits would otherwise allow. On systems with a functioning /proc/self/fd - or /dev/fd interface the max is now ignored and all fds are closed. +- Issue #20335: bytes constructor now raises TypeError when encoding or errors + is specified with non-string argument. Based on patch by Renaud Blanch. -- Issue #21552: Fixed possible integer overflow of too long string lengths in - the tkinter module on 64-bit platforms. +- Issue #22834: If the current working directory ends up being set to a + non-existent directory then import will no longer raise FileNotFoundError. -- Issue #14315: The zipfile module now ignores extra fields in the central - directory that are too short to be parsed instead of letting a struct.unpack - error bubble up as this "bad data" appears in many real world zip files in - the wild and is ignored by other zip tools. +- Issue #22869: Move the interpreter startup & shutdown code to a new + dedicated pylifecycle.c module -- Issue #21402: tkinter.ttk now works when default root window is not set. +- Issue #22847: Improve method cache efficiency. -- Issue #10203: sqlite3.Row now truly supports sequence protocol. In particulr - it supports reverse() and negative indices. Original patch by Claudiu Popa. +- Issue #22335: Fix crash when trying to enlarge a bytearray to 0x7fffffff + bytes on a 32-bit platform. -- Issue #18807: If copying (no symlinks) specified for a venv, then the python - interpreter aliases (python, python3) are now created by copying rather than - symlinking. +- Issue #22653: Fix an assertion failure in debug mode when doing a reentrant + dict insertion in debug mode. -- Issue #14710: pkgutil.get_loader() no longer raises an exception when None is - found in sys.modules. +- Issue #22643: Fix integer overflow in Unicode case operations (upper, lower, + title, swapcase, casefold). -- Issue #14710: pkgutil.find_loader() no longer raises an exception when a - module doesn't exist. +- Issue #17636: Circular imports involving relative imports are now + supported. -- Issue #21481: Argparse equality and inequality tests now return - NotImplemented when comparing to an unknown type. +- Issue #22604: Fix assertion error in debug mode when dividing a complex + number by (nan+0j). -- Issue #8743: Fix interoperability between set objects and the - collections.Set() abstract base class. +- Issue #21052: Do not raise ImportWarning when sys.path_hooks or sys.meta_path + are set to None. -- Issue #13355: random.triangular() no longer fails with a ZeroDivisionError - when low equals high. +- Issue #16518: Use 'bytes-like object required' in error messages that + previously used the far more cryptic "'x' does not support the buffer + protocol. -- Issue #21538: The plistlib module now supports loading of binary plist files - when reference or offset size is not a power of two. +- Issue #22470: Fixed integer overflow issues in "backslashreplace", + "xmlcharrefreplace", and "surrogatepass" error handlers. -- Issue #21801: Validate that __signature__ is None or an instance of Signature. +- Issue #22540: speed up `PyObject_IsInstance` and `PyObject_IsSubclass` in the + common case that the second argument has metaclass `type`. -- Issue #21923: Prevent AttributeError in distutils.sysconfig.customize_compiler - due to possible uninitialized _config_vars. +- Issue #18711: Add a new `PyErr_FormatV` function, similar to `PyErr_Format` + but accepting a `va_list` argument. -- Issue #21323: Fix http.server to again handle scripts in CGI subdirectories, - broken by the fix for security issue #19435. Patch by Zach Byrne. +- Issue #22520: Fix overflow checking when generating the repr of a unicode + object. -Extension Modules ------------------ +- Issue #22519: Fix overflow checking in PyBytes_Repr. -- Issue #22176: Update the ctypes module's libffi to v3.1. This release - adds support for the Linux AArch64 and POWERPC ELF ABIv2 little endian - architectures. +- Issue #22518: Fix integer overflow issues in latin-1 encoding. -Build ------ +- Issue #16324: _charset parameter of MIMEText now also accepts + email.charset.Charset instances. Initial patch by Claude Paroz. -- Issue #15661: python.org OS X installers are now distributed as signed - installer packages compatible with the Gatekeeper security feature. +- Issue #1764286: Fix inspect.getsource() to support decorated functions. + Patch by Claudiu Popa. -- Issue #21958: Define HAVE_ROUND when building with Visual Studio 2013 and - above. Patch by Zachary Turner. +- Issue #18554: os.__all__ includes posix functions. -- Issue #15759: "make suspicious", "make linkcheck" and "make doctest" in Doc/ - now display special message when and only when there are failures. +- Issue #21391: Use os.path.abspath in the shutil module. -- Issue #17095: Fix Modules/Setup *shared* support. +- Issue #11471: avoid generating a JUMP_FORWARD instruction at the end of + an if-block if there is no else-clause. Original patch by Eugene Toder. -- Issue #21811: Anticipated fixes to support OS X versions > 10.9. +- Issue #22215: Now ValueError is raised instead of TypeError when str or bytes + argument contains not permitted null character or byte. -- Issue #21166: Prevent possible segfaults and other random failures of - python --generate-posix-vars in pybuilddir.txt build target. +- Issue #22258: Fix the internal function set_inheritable() on Illumos. + This platform exposes the function ``ioctl(FIOCLEX)``, but calling it fails + with errno is ENOTTY: "Inappropriate ioctl for device". set_inheritable() + now falls back to the slower ``fcntl()`` (``F_GETFD`` and then ``F_SETFD``). -IDLE ----- +- Issue #21389: Displaying the __qualname__ of the underlying function in the + repr of a bound method. -- Issue #17390: Adjust Editor window title; remove 'Python', - move version to end. +- Issue #22206: Using pthread, PyThread_create_key() now sets errno to ENOMEM + and returns -1 (error) on integer overflow. -- Issue #14105: Idle debugger breakpoints no longer disappear - when inseting or deleting lines. +- Issue #20184: Argument Clinic based signature introspection added for + 30 of the builtin functions. -- Issue #17172: Turtledemo can now be run from Idle. - Currently, the entry is on the Help menu, but it may move to Run. - Patch by Ramchandra Apt and Lita Cho. +- Issue #22116: C functions and methods (of the 'builtin_function_or_method' + type) can now be weakref'ed. Patch by Wei Wu. -- Issue #21765: Add support for non-ascii identifiers to HyperParser. +- Issue #22077: Improve index error messages for bytearrays, bytes, lists, + and tuples by adding 'or slices'. Added ', not 0. Patch by Demian Brecht. +- Issue #15381: Optimized io.BytesIO to make less allocations and copyings. -What's New in Python 3.4.1? -=========================== +- Issue #22818: Splitting on a pattern that could match an empty string now + raises a warning. Patterns that can only match empty strings are now + rejected. -Release date: 2014-05-18 +- Issue #23099: Closing io.BytesIO with exported buffer is rejected now to + prevent corrupting exported buffer. -Core and Builtins ------------------ +- Issue #23326: Removed __ne__ implementations. Since fixing default __ne__ + implementation in issue #21408 they are redundant. -- Issue #21418: Fix a crash in the builtin function super() when called without - argument and without current frame (ex: embedded Python). +- Issue #23363: Fix possible overflow in itertools.permutations. -- Issue #21425: Fix flushing of standard streams in the interactive - interpreter. +- Issue #23364: Fix possible overflow in itertools.product. -- Issue #21435: In rare cases, when running finalizers on objects in cyclic - trash a bad pointer dereference could occur due to a subtle flaw in - internal iteration logic. +- Issue #23366: Fixed possible integer overflow in itertools.combinations. -Library -------- +- Issue #23369: Fixed possible integer overflow in + _json.encode_basestring_ascii. -- Issue #10744: Fix PEP 3118 format strings on ctypes objects with a nontrivial - shape. +- Issue #23353: Fix the exception handling of generators in + PyEval_EvalFrameEx(). At entry, save or swap the exception state even if + PyEval_EvalFrameEx() is called with throwflag=0. At exit, the exception state + is now always restored or swapped, not only if why is WHY_YIELD or + WHY_RETURN. Patch co-written with Antoine Pitrou. -- Issue #20998: Fixed re.fullmatch() of repeated single character pattern - with ignore case. Original patch by Matthew Barnett. +- Issue #14099: Restored support of writing ZIP files to tellable but + non-seekable streams. -- Issue #21075: fileinput.FileInput now reads bytes from standard stream if - binary mode is specified. Patch by Sam Kimbrel. +- Issue #14099: Writing to ZipFile and reading multiple ZipExtFiles is + threadsafe now. -- Issue #21396: Fix TextIOWrapper(..., write_through=True) to not force a - flush() on the underlying binary stream. Patch by akira. +- Issue #19361: JSON decoder now raises JSONDecodeError instead of ValueError. -- Issue #21470: Do a better job seeding the random number generator by - using enough bytes to span the full state space of the Mersenne Twister. +- Issue #18518: timeit now rejects statements which can't be compiled outside + a function or a loop (e.g. "return" or "break"). -- Issue #21398: Fix an unicode error in the pydoc pager when the documentation - contains characters not encodable to the stdout encoding. +- Issue #23094: Fixed readline with frames in Python implementation of pickle. -Tests ------ +- Issue #23268: Fixed bugs in the comparison of ipaddress classes. -- Issue #17756: Fix test_code test when run from the installed location. +- Issue #21408: Removed incorrect implementations of __ne__() which didn't + returned NotImplemented if __eq__() returned NotImplemented. The default + __ne__() now works correctly. -- Issue #17752: Fix distutils tests when run from the installed location. +- Issue #19996: :class:`email.feedparser.FeedParser` now handles (malformed) + headers with no key rather than assuming the body has started. -IDLE ----- +- Issue #20188: Support Application-Layer Protocol Negotiation (ALPN) in the ssl + module. -- Issue #18104: Add idlelib/idle_test/htest.py with a few sample tests to begin - consolidating and improving human-validated tests of Idle. Change other files - as needed to work with htest. Running the module as __main__ runs all tests. +- Issue #23133: Pickling of ipaddress objects now produces more compact and + portable representation. +- Issue #23248: Update ssl error codes from latest OpenSSL git master. -What's New in Python 3.4.1rc1? -============================== +- Issue #23266: Much faster implementation of ipaddress.collapse_addresses() + when there are many non-consecutive addresses. -Release date: 2014-05-05 +- Issue #23098: 64-bit dev_t is now supported in the os module. -Core and Builtins ------------------ +- Issue #21817: When an exception is raised in a task submitted to a + ProcessPoolExecutor, the remote traceback is now displayed in the + parent process. Patch by Claudiu Popa. -- Issue #21274: Define PATH_MAX for GNU/Hurd in Python/pythonrun.c. +- Issue #15955: Add an option to limit output size when decompressing LZMA + data. Patch by Nikolaus Rath and Martin Panter. -- Issue #21209: Fix sending tuples to custom generator objects with the yield - from syntax. +- Issue #23250: In the http.cookies module, capitalize "HttpOnly" and "Secure" + as they are written in the standard. -- Issue #21134: Fix segfault when str is called on an uninitialized - UnicodeEncodeError, UnicodeDecodeError, or UnicodeTranslateError object. +- Issue #23063: In the disutils' check command, fix parsing of reST with code or + code-block directives. -- Issue #19537: Fix PyUnicode_DATA() alignment under m68k. Patch by - Andreas Schwab. +- Issue #23209, #23225: selectors.BaseSelector.get_key() now raises a + RuntimeError if the selector is closed. And selectors.BaseSelector.close() + now clears its internal reference to the selector mapping to break a + reference cycle. Initial patch written by Martin Richard. -- Issue #20929: Add a type cast to avoid shifting a negative number. +- Issue #17911: Provide a way to seed the linecache for a PEP-302 module + without actually loading the code. -- Issue #20731: Properly position in source code files even if they - are opened in text mode. Patch by Serhiy Storchaka. +- Issue #17911: Provide a new object API for traceback, including the ability + to not lookup lines at all until the traceback is actually rendered, without + any trace of the original objects being kept alive. -- Issue #20637: Key-sharing now also works for instance dictionaries of - subclasses. Patch by Peter Ingebretson. +- Issue #19777: Provide a home() classmethod on Path objects. Contributed + by Victor Salgado and Mayank Tripathi. -- Issue #12546: Allow \x00 to be used as a fill character when using str, int, - float, and complex __format__ methods. +- Issue #23206: Make ``json.dumps(..., ensure_ascii=False)`` as fast as the + default case of ``ensure_ascii=True``. Patch by Naoki Inada. -- Issue #13598: Modify string.Formatter to support auto-numbering of - replacement fields. It now matches the behavior of str.format() in - this regard. Patches by Phil Elson and Ramchandra Apte. +- Issue #23185: Add math.inf and math.nan constants. -Library -------- +- Issue #23186: Add ssl.SSLObject.shared_ciphers() and + ssl.SSLSocket.shared_ciphers() to fetch the client's list ciphers sent at + handshake. -- Issue #21088: Bugfix for curses.window.addch() regression in 3.4.0. - In porting to Argument Clinic, the first two arguments were reversed. +- Issue #23143: Remove compatibility with OpenSSLs older than 0.9.8. -- Issue #21469: Reduced the risk of false positives in robotparser by - checking to make sure that robots.txt has been read or does not exist - prior to returning True in can_fetch(). +- Issue #23132: Improve performance and introspection support of comparison + methods created by functool.total_ordering. -- Issue #21321: itertools.islice() now releases the reference to the source - iterator when the slice is exhausted. Patch by Anton Afanasyev. +- Issue #19776: Add a expanduser() method on Path objects. -- Issue #9815: assertRaises now tries to clear references to local variables - in the exception's traceback. +- Issue #23112: Fix SimpleHTTPServer to correctly carry the query string and + fragment when it redirects to add a trailing slash. -- Issue #13204: Calling sys.flags.__new__ would crash the interpreter, - now it raises a TypeError. +- Issue #21793: Added http.HTTPStatus enums (i.e. HTTPStatus.OK, + HTTPStatus.NOT_FOUND). Patch by Demian Brecht. -- Issue #19385: Make operations on a closed dbm.dumb database always raise the - same exception. +- Issue #23093: In the io, module allow more operations to work on detached + streams. -- Issue #21207: Detect when the os.urandom cached fd has been closed or - replaced, and open it anew. +- Issue #23111: In the ftplib, make ssl.PROTOCOL_SSLv23 the default protocol + version. -- Issue #21291: subprocess's Popen.wait() is now thread safe so that - multiple threads may be calling wait() or poll() on a Popen instance - at the same time without losing the Popen.returncode value. +- Issue #22585: On OpenBSD 5.6 and newer, os.urandom() now calls getentropy(), + instead of reading /dev/urandom, to get pseudo-random bytes. -- Issue #21127: Path objects can now be instantiated from str subclass - instances (such as ``numpy.str_``). +- Issue #19104: pprint now produces evaluable output for wrapped strings. -- Issue #15002: urllib.response object to use _TemporaryFileWrapper (and - _TemporaryFileCloser) facility. Provides a better way to handle file - descriptor close. Patch contributed by Christian Theune. +- Issue #23071: Added missing names to codecs.__all__. Patch by Martin Panter. -- Issue #12220: mindom now raises a custom ValueError indicating it doesn't - support spaces in URIs instead of letting a 'split' ValueError bubble up. +- Issue #22783: Pickling now uses the NEWOBJ opcode instead of the NEWOBJ_EX + opcode if possible. -- Issue #21239: patch.stopall() didn't work deterministically when the same - name was patched more than once. +- Issue #15513: Added a __sizeof__ implementation for pickle classes. -- Issue #21222: Passing name keyword argument to mock.create_autospec now - works. +- Issue #19858: pickletools.optimize() now aware of the MEMOIZE opcode, can + produce more compact result and no longer produces invalid output if input + data contains MEMOIZE opcodes together with PUT or BINPUT opcodes. -- Issue #21197: Add lib64 -> lib symlink in venvs on 64-bit non-OS X POSIX. +- Issue #22095: Fixed HTTPConnection.set_tunnel with default port. The port + value in the host header was set to "None". Patch by Demian Brecht. -- Issue #17498: Some SMTP servers disconnect after certain errors, violating - strict RFC conformance. Instead of losing the error code when we issue the - subsequent RSET, smtplib now returns the error code and defers raising the - SMTPServerDisconnected error until the next command is issued. +- Issue #23016: A warning no longer produces an AttributeError when the program + is run with pythonw.exe. -- Issue #17826: setting an iterable side_effect on a mock function created by - create_autospec now works. Patch by Kushal Das. +- Issue #21775: shutil.copytree(): fix crash when copying to VFAT. An exception + handler assumed that that OSError objects always have a 'winerror' attribute. + That is not the case, so the exception handler itself raised AttributeError + when run on Linux (and, presumably, any other non-Windows OS). + Patch by Greg Ward. -- Issue #7776: Fix ``Host:`` header and reconnection when using - http.client.HTTPConnection.set_tunnel(). Patch by Nikolaus Rath. +- Issue #1218234: Fix inspect.getsource() to load updated source of + reloaded module. Initial patch by Berker Peksag. -- Issue #20968: unittest.mock.MagicMock now supports division. - Patch by Johannes Baiter. +- Issue #21740: Support wrapped callables in doctest. Patch by Claudiu Popa. -- Fix arbitrary memory access in JSONDecoder.raw_decode with a negative second - parameter. Bug reported by Guido Vranken. +- Issue #23009: Make sure selectors.EpollSelecrtor.select() works when no + FD is registered. -- Issue #21169: getpass now handles non-ascii characters that the - input stream encoding cannot encode by re-encoding using the - replace error handler. +- Issue #22959: In the constructor of http.client.HTTPSConnection, prefer the + context's check_hostname attribute over the *check_hostname* parameter. -- Issue #21171: Fixed undocumented filter API of the rot13 codec. - Patch by Berker Peksag. +- Issue #22696: Add function :func:`sys.is_finalizing` to know about + interpreter shutdown. -- Issue #21172: isinstance check relaxed from dict to collections.Mapping. +- Issue #16043: Add a default limit for the amount of data xmlrpclib.gzip_decode + will return. This resolves CVE-2013-1753. -- Issue #21155: asyncio.EventLoop.create_unix_server() now raises a ValueError - if path and sock are specified at the same time. +- Issue #14099: ZipFile.open() no longer reopen the underlying file. Objects + returned by ZipFile.open() can now operate independently of the ZipFile even + if the ZipFile was created by passing in a file-like object as the first + argument to the constructor. -- Issue #21149: Improved thread-safety in logging cleanup during interpreter - shutdown. Thanks to Devin Jeanpierre for the patch. +- Issue #22966: Fix __pycache__ pyc file name clobber when pyc_compile is + asked to compile a source file containing multiple dots in the source file + name. -- Issue #20145: `assertRaisesRegex` and `assertWarnsRegex` now raise a - TypeError if the second argument is not a string or compiled regex. +- Issue #21971: Update turtledemo doc and add module to the index. -- Issue #21058: Fix a leak of file descriptor in - :func:`tempfile.NamedTemporaryFile`, close the file descriptor if - :func:`io.open` fails +- Issue #21032. Fixed socket leak if HTTPConnection.getresponse() fails. + Original patch by Martin Panter. -- Issue #21200: Return None from pkgutil.get_loader() when __spec__ is missing. +- Issue #22407: Deprecated the use of re.LOCALE flag with str patterns or + re.ASCII. It was newer worked. -- Issue #21013: Enhance ssl.create_default_context() when used for server side - sockets to provide better security by default. +- Issue #22902: The "ip" command is now used on Linux to determine MAC address + in uuid.getnode(). Pach by Bruno Cauet. -- Issue #20633: Replace relative import by absolute import. +- Issue #22960: Add a context argument to xmlrpclib.ServerProxy constructor. -- Issue #20980: Stop wrapping exception when using ThreadPool. +- Issue #22389: Add contextlib.redirect_stderr(). -- Issue #21082: In os.makedirs, do not set the process-wide umask. Note this - changes behavior of makedirs when exist_ok=True. +- Issue #21356: Make ssl.RAND_egd() optional to support LibreSSL. The + availability of the function is checked during the compilation. Patch written + by Bernard Spil. -- Issue #20990: Fix issues found by pyflakes for multiprocessing. +- Issue #22915: SAX parser now supports files opened with file descriptor or + bytes path. -- Issue #21015: SSL contexts will now automatically select an elliptic - curve for ECDH key exchange on OpenSSL 1.0.2 and later, and otherwise - default to "prime256v1". +- Issue #22609: Constructors and update methods of mapping classes in the + collections module now accept the self keyword argument. -- Issue #20995: Enhance default ciphers used by the ssl module to enable - better security an prioritize perfect forward secrecy. +- Issue #22940: Add readline.append_history_file. -- Issue #20884: Don't assume that __file__ is defined on importlib.__init__. +- Issue #19676: Added the "namereplace" error handler. -- Issue #21499: Ignore __builtins__ in several test_importlib.test_api tests. +- Issue #22788: Add *context* parameter to logging.handlers.HTTPHandler. -- Issue #20879: Delay the initialization of encoding and decoding tables for - base32, ascii85 and base85 codecs in the base64 module, and delay the - initialization of the unquote_to_bytes() table of the urllib.parse module, to - not waste memory if these modules are not used. - -- Issue #19157: Include the broadcast address in the usuable hosts for IPv6 - in ipaddress. +- Issue #22921: Allow SSLContext to take the *hostname* parameter even if + OpenSSL doesn't support SNI. -- Issue #11599: When an external command (e.g. compiler) fails, distutils now - prints out the whole command line (instead of just the command name) if the - environment variable DISTUTILS_DEBUG is set. +- Issue #22894: TestCase.subTest() would cause the test suite to be stopped + when in failfast mode, even in the absence of failures. -- Issue #4931: distutils should not produce unhelpful "error: None" messages - anymore. distutils.util.grok_environment_error is kept but doc-deprecated. +- Issue #22796: HTTP cookie parsing is now stricter, in order to protect + against potential injection attacks. -- Issue #20875: Prevent possible gzip "'read' is not defined" NameError. - Patch by Claudiu Popa. +- Issue #22370: Windows detection in pathlib is now more robust. -- Issue #11558: ``email.message.Message.attach`` now returns a more - useful error message if ``attach`` is called on a message for which - ``is_multipart`` is False. +- Issue #22841: Reject coroutines in asyncio add_signal_handler(). + Patch by Ludovic.Gasc. -- Issue #20283: RE pattern methods now accept the string keyword parameters - as documented. The pattern and source keyword parameters are left as - deprecated aliases. +- Issue #19494: Added urllib.request.HTTPBasicPriorAuthHandler. Patch by + Matej Cepl. -- Issue #20778: Fix modulefinder to work with bytecode-only modules. +- Issue #22578: Added attributes to the re.error class. -- Issue #20791: copy.copy() now doesn't make a copy when the input is - a bytes object. Initial patch by Peter Otten. +- Issue #22849: Fix possible double free in the io.TextIOWrapper constructor. -- Issue #19748: On AIX, time.mktime() now raises an OverflowError for year - outsize range [1902; 2037]. +- Issue #12728: Different Unicode characters having the same uppercase but + different lowercase are now matched in case-insensitive regular expressions. -- Issue #20816: Fix inspect.getcallargs() to raise correct TypeError for - missing keyword-only arguments. Patch by Jeremiah Lowin. +- Issue #22821: Fixed fcntl() with integer argument on 64-bit big-endian + platforms. -- Issue #20817: Fix inspect.getcallargs() to fail correctly if more - than 3 arguments are missing. Patch by Jeremiah Lowin. +- Issue #21650: Add an `--sort-keys` option to json.tool CLI. -- Issue #6676: Ensure a meaningful exception is raised when attempting - to parse more than one XML document per pyexpat xmlparser instance. - (Original patches by Hirokazu Yamamoto and Amaury Forgeot d'Arc, with - suggested wording by David Gutteridge) +- Issue #22824: Updated reprlib output format for sets to use set literals. + Patch contributed by Berker Peksag. -- Issue #21117: Fix inspect.signature to better support functools.partial. - Due to the specifics of functools.partial implementation, - positional-or-keyword arguments passed as keyword arguments become - keyword-only. +- Issue #22824: Updated reprlib output format for arrays to display empty + arrays without an unnecessary empty list. Suggested by Serhiy Storchaka. -- Issue #21209: Fix asyncio.tasks.CoroWrapper to workaround a bug - in yield-from implementation in CPythons prior to 3.4.1. +- Issue #22406: Fixed the uu_codec codec incorrectly ported to 3.x. + Based on patch by Martin Panter. -- asyncio: Add gi_{frame,running,code} properties to CoroWrapper - (upstream issue #163). +- Issue #17293: uuid.getnode() now determines MAC address on AIX using netstat. + Based on patch by Aivars Kalvāns. -- Issue #21311: Avoid exception in _osx_support with non-standard compiler - configurations. Patch by John Szakmeister. +- Issue #22769: Fixed ttk.Treeview.tag_has() when called without arguments. -- Issue #11571: Ensure that the turtle window becomes the topmost window - when launched on OS X. +- Issue #22417: Verify certificates by default in httplib (PEP 476). -Extension Modules ------------------ +- Issue #22775: Fixed unpickling of http.cookies.SimpleCookie with protocol 2 + and above. Patch by Tim Graham. -- Issue #21276: posixmodule: Don't define USE_XATTRS on KFreeBSD and the Hurd. +- Issue #22776: Brought excluded code into the scope of a try block in + SysLogHandler.emit(). -- Issue #21226: Set up modules properly in PyImport_ExecCodeModuleObject - (and friends). +- Issue #22665: Add missing get_terminal_size and SameFileError to + shutil.__all__. -IDLE ----- +- Issue #6623: Remove deprecated Netrc class in the ftplib module. Patch by + Matt Chaput. -- Issue #21139: Change default paragraph width to 72, the PEP 8 recommendation. +- Issue #17381: Fixed handling of case-insensitive ranges in regular + expressions. -- Issue #21284: Paragraph reformat test passes after user changes reformat width. +- Issue #22410: Module level functions in the re module now cache compiled + locale-dependent regular expressions taking into account the locale. -- Issue #17654: Ensure IDLE menus are customized properly on OS X for - non-framework builds and for all variants of Tk. +- Issue #22759: Query methods on pathlib.Path() (exists(), is_dir(), etc.) + now return False when the underlying stat call raises NotADirectoryError. -Build ------ +- Issue #8876: distutils now falls back to copying files when hard linking + doesn't work. This allows use with special filesystems such as VirtualBox + shared folders. -- The Windows build now includes OpenSSL 1.0.1g +- Issue #22217: Implemented reprs of classes in the zipfile module. -- Issue #21285: Refactor and fix curses configure check to always search - in a ncursesw directory. +- Issue #22457: Honour load_tests in the start_dir of discovery. -- Issue #15234: For BerkelyDB and Sqlite, only add the found library and - include directories if they aren't already being searched. This avoids - an explicit runtime library dependency. +- Issue #18216: gettext now raises an error when a .mo file has an + unsupported major version number. Patch by Aaron Hill. -- Issue #20644: OS X installer build support for documentation build changes - in 3.4.1: assume externally supplied sphinx-build is available in /usr/bin. +- Issue #13918: Provide a locale.delocalize() function which can remove + locale-specific number formatting from a string representing a number, + without then converting it to a specific type. Patch by Cédric Krier. -C API ------ +- Issue #22676: Make the pickling of global objects which don't have a + __module__ attribute less slow. -- Issue #20942: PyImport_ImportFrozenModuleObject() no longer sets __file__ to - match what importlib does; this affects _frozen_importlib as well as any - module loaded using imp.init_frozen(). +- Issue #18853: Fixed ResourceWarning in shlex.__nain__. -Documentation -------------- +- Issue #9351: Defaults set with set_defaults on an argparse subparser + are no longer ignored when also set on the parent parser. -- Issue #17386: Expanded functionality of the ``Doc/make.bat`` script to make - it much more comparable to ``Doc/Makefile``. +- Issue #7559: unittest test loading ImportErrors are reported as import errors + with their import exception rather than as attribute errors after the import + has already failed. -- Issue #21043: Remove the recommendation for specific CA organizations and to - mention the ability to load the OS certificates. +- Issue #19746: Make it possible to examine the errors from unittest + discovery without executing the test suite. The new `errors` attribute + on TestLoader exposes these non-fatal errors encountered during discovery. -- Issue #20765: Add missing documentation for PurePath.with_name() and - PurePath.with_suffix(). +- Issue #21991: Make email.headerregistry's header 'params' attributes + be read-only (MappingProxyType). Previously the dictionary was modifiable + but a new one was created on each access of the attribute. -- Issue #19407: New package installation and distribution guides based on - the Python Packaging Authority tools. Existing guides have been retained - as legacy links from the distutils docs, as they still contain some - required reference material for tool developers that isn't recorded - anywhere else. +- Issue #22638: SSLv3 is now disabled throughout the standard library. + It can still be enabled by instantiating a SSLContext manually. -- Issue #19697: Document cases where __main__.__spec__ is None. +- Issue #22641: In asyncio, the default SSL context for client connections + is now created using ssl.create_default_context(), for stronger security. -Tests ------ +- Issue #17401: Include closefd in io.FileIO repr. -- Issue #18604: Consolidated checks for GUI availability. All platforms now - at least check whether Tk can be instantiated when the GUI resource is - requested. +- Issue #21338: Add silent mode for compileall. quiet parameters of + compile_{dir, file, path} functions now have a multilevel value. Also, + -q option of the CLI now have a multilevel value. Patch by Thomas Kluyver. -- Issue #21275: Fix a socket test on KFreeBSD. +- Issue #20152: Convert the array and cmath modules to Argument Clinic. -- Issue #21223: Pass test_site/test_startup_imports when some of the extensions - are built as builtins. +- Issue #18643: Add socket.socketpair() on Windows. -- Issue #20635: Added tests for Tk geometry managers. +- Issue #22435: Fix a file descriptor leak when SocketServer bind fails. -- Add test case for freeze. +- Issue #13096: Fixed segfault in CTypes POINTER handling of large + values. -- Issue #20743: Fix a reference leak in test_tcl. +- Issue #11694: Raise ConversionError in xdrlib as documented. Patch + by Filip Gruszczyński and Claudiu Popa. -- Issue #21097: Move test_namespace_pkgs into test_importlib. +- Issue #19380: Optimized parsing of regular expressions. -- Issue #20939: Avoid various network test failures due to new - redirect of http://www.python.org/ to https://www.python.org: - use http://www.example.com instead. +- Issue #1519638: Now unmatched groups are replaced with empty strings in re.sub() + and re.subn(). -- Issue #20668: asyncio tests no longer rely on tests.txt file. - (Patch by Vajrasky Kok) +- Issue #18615: sndhdr.what/whathdr now return a namedtuple. -- Issue #21093: Prevent failures of ctypes test_macholib on OS X if a - copy of libz exists in $HOME/lib or /usr/local/lib. +- Issue #22462: Fix pyexpat's creation of a dummy frame to make it + appear in exception tracebacks. -Tools/Demos ------------ +- Issue #21965: Add support for in-memory SSL to the ssl module. Patch + by Geert Jansen. -- Add support for ``yield from`` to 2to3. +- Issue #21173: Fix len() on a WeakKeyDictionary when .clear() was called + with an iterator alive. -- Add support for the PEP 465 matrix multiplication operator to 2to3. +- Issue #11866: Eliminated race condition in the computation of names + for new threads. -- Issue #16047: Fix module exception list and __file__ handling in freeze. - Patch by Meador Inge. +- Issue #21905: Avoid RuntimeError in pickle.whichmodule() when sys.modules + is mutated while iterating. Patch by Olivier Grisel. -- Issue #11824: Consider ABI tags in freeze. Patch by Meador Inge. +- Issue #11271: concurrent.futures.Executor.map() now takes a *chunksize* + argument to allow batching of tasks in child processes and improve + performance of ProcessPoolExecutor. Patch by Dan O'Reilly. -- Issue #20535: PYTHONWARNING no longer affects the run_tests.py script. - Patch by Arfrever Frehtes Taifersar Arahesis. +- Issue #21883: os.path.join() and os.path.relpath() now raise a TypeError with + more helpful error message for unsupported or mismatched types of arguments. +- Issue #22219: The zipfile module CLI now adds entries for directories + (including empty directories) in ZIP file. -What's New in Python 3.4.0? -=========================== +- Issue #22449: In the ssl.SSLContext.load_default_certs, consult the + environmental variables SSL_CERT_DIR and SSL_CERT_FILE on Windows. -Release date: 2014-03-16 +- Issue #22508: The email.__version__ variable has been removed; the email + code is no longer shipped separately from the stdlib, and __version__ + hasn't been updated in several releases. -Library -------- +- Issue #20076: Added non derived UTF-8 aliases to locale aliases table. -- Issue #20939: Fix test_geturl failure in test_urllibnet due to - new redirect of http://www.python.org/ to https://www.python.org. +- Issue #20079: Added locales supported in glibc 2.18 to locale alias table. -Documentation -------------- +- Issue #20218: Added convenience methods read_text/write_text and read_bytes/ + write_bytes to pathlib.Path objects. -- Merge in all documentation changes since branching 3.4.0rc1. +- Issue #22437: Number of capturing groups in regular expression is no longer + limited by 100. +- Issue #17442: InteractiveInterpreter now displays the full chained traceback + in its showtraceback method, to match the built in interactive interpreter. -What's New in Python 3.4.0 release candidate 3? -=============================================== +- Issue #23392: Added tests for marshal C API that works with FILE*. -Release date: 2014-03-09 + -Core and Builtins ------------------ +- Issue #10510: distutils register and upload methods now use HTML standards + compliant CRLF line endings. -- Issue #20786: Fix signatures for dict.__delitem__ and - property.__delete__ builtins. +- Issue #9850: Fixed macpath.join() for empty first component. Patch by + Oleg Oshmyan. -Library -------- +- Issue #5309: distutils' build and build_ext commands now accept a ``-j`` + option to enable parallel building of extension modules. -- Issue #20839: Don't trigger a DeprecationWarning in the still supported - pkgutil.get_loader() API when __loader__ isn't set on a module (nor - when pkgutil.find_loader() is called directly). +- Issue #22448: Improve canceled timer handles cleanup to prevent + unbound memory usage. Patch by Joshua Moore-Oliva. -Build ------ +- Issue #22427: TemporaryDirectory no longer attempts to clean up twice when + used in the with statement in generator. -- Issue #14512: Launch pydoc -b instead of pydocgui.pyw on Windows. +- Issue #22362: Forbidden ambiguous octal escapes out of range 0-0o377 in + regular expressions. -- Issue #20748: Uninstalling pip does not leave behind the pyc of - the uninstaller anymore. +- Issue #20912: Now directories added to ZIP file have correct Unix and MS-DOS + directory attributes. -- Issue #20568: The Windows installer now installs the unversioned ``pip`` - command in addition to the versioned ``pip3`` and ``pip3.4`` commands. +- Issue #21866: ZipFile.close() no longer writes ZIP64 central directory + records if allowZip64 is false. -- Issue #20757: The ensurepip helper for the Windows uninstaller now skips - uninstalling pip (rather than failing) if the user has updated pip to a - different version from the one bundled with ensurepip. +- Issue #22278: Fix urljoin problem with relative urls, a regression observed + after changes to issue22118 were submitted. -- Issue #20465: Update OS X and Windows installer builds to use - SQLite 3.8.3.1. +- Issue #22415: Fixed debugging output of the GROUPREF_EXISTS opcode in the re + module. Removed trailing spaces in debugging output. +- Issue #22423: Unhandled exception in thread no longer causes unhandled + AttributeError when sys.stderr is None. -What's New in Python 3.4.0 release candidate 2? -=============================================== +- Issue #21332: Ensure that ``bufsize=1`` in subprocess.Popen() selects + line buffering, rather than block buffering. Patch by Akira Li. -Release date: 2014-02-23 +- Issue #21091: Fix API bug: email.message.EmailMessage.is_attachment is now + a method. -Core and Builtins ------------------ +- Issue #21079: Fix email.message.EmailMessage.is_attachment to return the + correct result when the header has parameters as well as a value. -- Issue #20625: Parameter names in __annotations__ were not mangled properly. - Discovered by Jonas Wielicki, patch by Yury Selivanov. +- Issue #22247: Add NNTPError to nntplib.__all__. -- Issue #20261: In pickle, lookup __getnewargs__ and __getnewargs_ex__ on the - type of the object. +- Issue #22366: urllib.request.urlopen will accept a context object + (SSLContext) as an argument which will then used be for HTTPS connection. + Patch by Alex Gaynor. -- Issue #20619: Give the AST nodes of keyword-only arguments a column and line - number. +- Issue #4180: The warnings registries are now reset when the filters + are modified. -- Issue #20526: Revert changes of issue #19466 which introduces a regression: - don't clear anymore the state of Python threads early during the Python - shutdown. +- Issue #22419: Limit the length of incoming HTTP request in wsgiref server to + 65536 bytes and send a 414 error code for higher lengths. Patch contributed + by Devin Cook. -Library -------- +- Lax cookie parsing in http.cookies could be a security issue when combined + with non-standard cookie handling in some Web browsers. Reported by + Sergey Bobrov. -- Issue #20710: The pydoc summary line no longer displays the "self" parameter - for bound methods. +- Issue #20537: logging methods now accept an exception instance as well as a + Boolean value or exception tuple. Thanks to Yury Selivanov for the patch. -- Issue #20566: Change asyncio.as_completed() to use a Queue, to - avoid O(N**2) behavior. +- Issue #22384: An exception in Tkinter callback no longer crashes the program + when it is run with pythonw.exe. -- Issue #20704: Implement new debug API in asyncio. Add new methods - BaseEventLoop.set_debug() and BaseEventLoop.get_debug(). - Add support for setting 'asyncio.tasks._DEBUG' variable with - 'PYTHONASYNCIODEBUG' environment variable. +- Issue #22168: Prevent turtle AttributeError with non-default Canvas on OS X. -- asyncio: Refactoring and fixes: BaseEventLoop.sock_connect() raises an - error if the address is not resolved; use __slots__ in Handle and - TimerHandle; as_completed() and wait() raise TypeError if the passed - list of Futures is a single Future; call_soon() and other 'call_*()' - functions raise TypeError if the passed callback is a coroutine - function; _ProactorBasePipeTransport uses _FlowControlMixin; - WriteTransport.set_write_buffer_size() calls _maybe_pause_protocol() - to consider pausing receiving if the watermark limits have changed; - fix _check_resolved_address() for IPv6 address; and other minor - improvements, along with multiple documentation updates. +- Issue #21147: sqlite3 now raises an exception if the request contains a null + character instead of truncate it. Based on patch by Victor Stinner. -- Issue #20684: Fix inspect.getfullargspec() to not to follow __wrapped__ - chains. Make its behaviour consistent with bound methods first argument. - Patch by Nick Coghlan and Yury Selivanov. +- Issue #13968: The glob module now supports recursive search in + subdirectories using the "**" pattern. -- Issue #20681: Add new error handling API in asyncio. New APIs: - loop.set_exception_handler(), loop.default_exception_handler(), and - loop.call_exception_handler(). +- Issue #21951: Fixed a crash in Tkinter on AIX when called Tcl command with + empty string or tuple argument. -- Issue #20673: Implement support for UNIX Domain Sockets in asyncio. - New APIs: loop.create_unix_connection(), loop.create_unix_server(), - streams.open_unix_connection(), and streams.start_unix_server(). +- Issue #21951: Tkinter now most likely raises MemoryError instead of crash + if the memory allocation fails. -- Issue #20616: Add a format() method to tracemalloc.Traceback. +- Issue #22338: Fix a crash in the json module on memory allocation failure. -- Issue #19744: the ensurepip installation step now just prints a warning to - stderr rather than failing outright if SSL/TLS is unavailable. This allows - local installation of POSIX builds without SSL/TLS support. +- Issue #12410: imaplib.IMAP4 now supports the context management protocol. + Original patch by Tarek Ziadé. -- Issue #20594: Avoid name clash with the libc function posix_close. +- Issue #21270: We now override tuple methods in mock.call objects so that + they can be used as normal call attributes. -Build ------ +- Issue #16662: load_tests() is now unconditionally run when it is present in + a package's __init__.py. TestLoader.loadTestsFromModule() still accepts + use_load_tests, but it is deprecated and ignored. A new keyword-only + attribute `pattern` is added and documented. Patch given by Robert Collins, + tweaked by Barry Warsaw. -- Issue #20641: Run MSI custom actions (pip installation, pyc compilation) - with the NoImpersonate flag, to support elevated execution (UAC). +- Issue #22226: First letter no longer is stripped from the "status" key in + the result of Treeview.heading(). -- Issue #20221: Removed conflicting (or circular) hypot definition when - compiled with VS 2010 or above. Initial patch by Tabrez Mohammed. +- Issue #19524: Fixed resource leak in the HTTP connection when an invalid + response is received. Patch by Martin Panter. -- Issue #20609: Restored the ability to build 64-bit Windows binaries on - 32-bit Windows, which was broken by the change in issue #19788. +- Issue #20421: Add a .version() method to SSL sockets exposing the actual + protocol version in use. +- Issue #19546: configparser exceptions no longer expose implementation details. + Chained KeyErrors are removed, which leads to cleaner tracebacks. Patch by + Claudiu Popa. -What's New in Python 3.4.0 release candidate 1? -=============================================== +- Issue #22051: turtledemo no longer reloads examples to re-run them. + Initialization of variables and gui setup should be done in main(), + which is called each time a demo is run, but not on import. -Release date: 2014-02-10 +- Issue #21933: Turtledemo users can change the code font size with a menu + selection or control(command) '-' or '+' or control-mousewheel. + Original patch by Lita Cho. -Core and Builtins ------------------ +- Issue #21597: The separator between the turtledemo text pane and the drawing + canvas can now be grabbed and dragged with a mouse. The code text pane can + be widened to easily view or copy the full width of the text. The canvas + can be widened on small screens. Original patches by Jan Kanis and Lita Cho. -- Issue #19255: The builtins module is restored to initial value before - cleaning other modules. The sys and builtins modules are cleaned last. +- Issue #18132: Turtledemo buttons no longer disappear when the window is + shrunk. Original patches by Jan Kanis and Lita Cho. -- Issue #20588: Make Python-ast.c C89 compliant. +- Issue #22043: time.monotonic() is now always available. + ``threading.Lock.acquire()``, ``threading.RLock.acquire()`` and socket + operations now use a monotonic clock, instead of the system clock, when a + timeout is used. -- Issue #20437: Fixed 22 potential bugs when deleting objects references. +- Issue #21527: Add a default number of workers to ThreadPoolExecutor equal + to 5 times the number of CPUs. Patch by Claudiu Popa. -- Issue #20500: Displaying an exception at interpreter shutdown no longer - risks triggering an assertion failure in PyObject_Str. +- Issue #22216: smtplib now resets its state more completely after a quit. The + most obvious consequence of the previous behavior was a STARTTLS failure + during a connect/starttls/quit/connect/starttls sequence. -- Issue #20538: UTF-7 incremental decoder produced inconsistent string when - input was truncated in BASE64 section. +- Issue #22098: ctypes' BigEndianStructure and LittleEndianStructure now + define an empty __slots__ so that subclasses don't always get an instance + dict. Patch by Claudiu Popa. -- Issue #20404: io.TextIOWrapper (and hence the open() builtin) now uses the - internal codec marking system added for issue #19619 to throw LookupError - for known non-text encodings at stream construction time. The existing - output type checks remain in place to deal with unmarked third party - codecs. +- Issue #22185: Fix an occasional RuntimeError in threading.Condition.wait() + caused by mutation of the waiters queue without holding the lock. Patch + by Doug Zongker. -- Issue #17162: Add PyType_GetSlot. +- Issue #22287: On UNIX, _PyTime_gettimeofday() now uses + clock_gettime(CLOCK_REALTIME) if available. As a side effect, Python now + depends on the librt library on Solaris and on Linux (only with glibc older + than 2.17). -- Issue #20162: Fix an alignment issue in the siphash24() hash function which - caused a crash on PowerPC 64-bit (ppc64). +- Issue #22182: Use e.args to unpack exceptions correctly in + distutils.file_util.move_file. Patch by Claudiu Popa. -Library -------- +- The webbrowser module now uses subprocess's start_new_session=True rather + than a potentially risky preexec_fn=os.setsid call. -- Issue #20530: The signatures for slot builtins have been updated - to reflect the fact that they only accept positional-only arguments. +- Issue #22042: signal.set_wakeup_fd(fd) now raises an exception if the file + descriptor is in blocking mode. -- Issue #20517: Functions in the os module that accept two filenames - now register both filenames in the exception on failure. +- Issue #16808: inspect.stack() now returns a named tuple instead of a tuple. + Patch by Daniel Shahaf. -- Issue #20563: The ipaddress module API is now considered stable. +- Issue #22236: Fixed Tkinter images copying operations in NoDefaultRoot mode. -- Issue #14983: email.generator now always adds a line end after each MIME - boundary marker, instead of doing so only when there is an epilogue. This - fixes an RFC compliance bug and solves an issue with signed MIME parts. +- Issue #2527: Add a *globals* argument to timeit functions, in order to + override the globals namespace in which the timed code is executed. + Patch by Ben Roberts. -- Issue #20540: Fix a performance regression (vs. Python 3.2) when layering - a multiprocessing Connection over a TCP socket. For small payloads, Nagle's - algorithm would introduce idle delays before the entire transmission of a - message. +- Issue #22118: Switch urllib.parse to use RFC 3986 semantics for the + resolution of relative URLs, rather than RFCs 1808 and 2396. + Patch by Demian Brecht. -- Issue #16983: the new email header parsing code will now decode encoded words - that are (incorrectly) surrounded by quotes, and register a defect. +- Issue #21549: Added the "members" parameter to TarFile.list(). -- Issue #19772: email.generator no longer mutates the message object when - doing a down-transform from 8bit to 7bit CTEs. +- Issue #19628: Allow compileall recursion depth to be specified with a -r + option. -- Issue #20536: the statistics module now correctly handle Decimal instances - with positive exponents +- Issue #15696: Add a __sizeof__ implementation for mmap objects on Windows. -- Issue #18805: the netmask/hostmask parsing in ipaddress now more reliably - filters out illegal values and correctly allows any valid prefix length. +- Issue #22068: Avoided reference loops with Variables and Fonts in Tkinter. -- Issue #20481: For at least Python 3.4, the statistics module will require - that all inputs for a single operation be of a single consistent type, or - else a mixed of ints and a single other consistent type. This avoids - some interoperability issues that arose with the previous approach of - coercing to a suitable common type. +- Issue #22165: SimpleHTTPRequestHandler now supports undecodable file names. -- Issue #20478: the statistics module now treats collections.Counter inputs - like any other iterable. +- Issue #15381: Optimized line reading in io.BytesIO. -- Issue #17369: get_filename was raising an exception if the filename - parameter's RFC2231 encoding was broken in certain ways. This was - a regression relative to python2. +- Issue #8797: Raise HTTPError on failed Basic Authentication immediately. + Initial patch by Sam Bull. -- Issue #20013: Some imap servers disconnect if the current mailbox is - deleted, and imaplib did not handle that case gracefully. Now it - handles the 'bye' correctly. +- Issue #20729: Restored the use of lazy iterkeys()/itervalues()/iteritems() + in the mailbox module. -- Issue #20531: Revert 3.4 version of fix for #19063, and apply the 3.3 - version. That is, do *not* raise an error if unicode is passed to - email.message.Message.set_payload. +- Issue #21448: Changed FeedParser feed() to avoid O(N**2) behavior when + parsing long line. Original patch by Raymond Hettinger. -- Issue #20476: If a non-compat32 policy is used with any of the email parsers, - EmailMessage is now used as the factory class. The factory class should - really come from the policy; that will get fixed in 3.5. +- Issue #22184: The functools LRU Cache decorator factory now gives an earlier + and clearer error message when the user forgets the required parameters. -- Issue #19920: TarFile.list() no longer fails when outputs a listing - containing non-encodable characters. Based on patch by Vajrasky Kok. +- Issue #17923: glob() patterns ending with a slash no longer match non-dirs on + AIX. Based on patch by Delhallt. -- Issue #20515: Fix NULL pointer dereference introduced by issue #20368. +- Issue #21725: Added support for RFC 6531 (SMTPUTF8) in smtpd. -- Issue #19186: Restore namespacing of expat symbols inside the pyexpat module. +- Issue #22176: Update the ctypes module's libffi to v3.1. This release + adds support for the Linux AArch64 and POWERPC ELF ABIv2 little endian + architectures. -- Issue #20053: ensurepip (and hence venv) are no longer affected by the - settings in the default pip configuration file. +- Issue #5411: Added support for the "xztar" format in the shutil module. -- Issue #20426: When passing the re.DEBUG flag, re.compile() displays the - debug output every time it is called, regardless of the compilation cache. +- Issue #21121: Don't force 3rd party C extensions to be built with + -Werror=declaration-after-statement. -- Issue #20368: The null character now correctly passed from Tcl to Python. - Improved error handling in variables-related commands. +- Issue #21975: Fixed crash when using uninitialized sqlite3.Row (in particular + when unpickling pickled sqlite3.Row). sqlite3.Row is now initialized in the + __new__() method. -- Issue #20435: Fix _pyio.StringIO.getvalue() to take into account newline - translation settings. +- Issue #20170: Convert posixmodule to use Argument Clinic. -- tracemalloc: Fix slicing traces and fix slicing a traceback. +- Issue #21539: Add a *exists_ok* argument to `Pathlib.mkdir()` to mimic + `mkdir -p` and `os.makedirs()` functionality. When true, ignore + FileExistsErrors. Patch by Berker Peksag. -- Issue #20354: Fix an alignment issue in the tracemalloc module on 64-bit - platforms. Bug seen on 64-bit Linux when using "make profile-opt". +- Issue #22127: Bypass IDNA for pure-ASCII host names in the socket module + (in particular for numeric IPs). -- Issue #17159: inspect.signature now accepts duck types of functions, - which adds support for Cython functions. Initial patch by Stefan Behnel. +- Issue #21047: set the default value for the *convert_charrefs* argument + of HTMLParser to True. Patch by Berker Peksag. -- Issue #18801: Fix inspect.classify_class_attrs to correctly classify - object.__new__ and object.__init__. +- Add an __all__ to html.entities. -- Fixed cmath.isinf's name in its argument parsing code. +- Issue #15114: the strict mode and argument of HTMLParser, HTMLParser.error, + and the HTMLParserError exception have been removed. -- Issue #20311, #20452: poll and epoll now round the timeout away from zero, - instead of rounding towards zero, in select and selectors modules: - select.epoll.poll(), selectors.PollSelector.poll() and - selectors.EpollSelector.poll(). For example, a timeout of one microsecond - (1e-6) is now rounded to one millisecondi (1e-3), instead of being rounded to - zero. However, the granularity property and asyncio's resolution feature - were removed again. +- Issue #22085: Dropped support of Tk 8.3 in Tkinter. -- asyncio: Some refactoring; various fixes; add write flow control to - unix pipes; Future.set_exception() instantiates the exception - argument if it is a class; improved proactor pipe transport; support - wait_for(f, None); don't log broken/disconnected pipes; use - ValueError instead of assert for forbidden subprocess_{shell,exec} - arguments; added a convenience API for subprocess management; added - StreamReader.at_eof(); properly handle duplicate coroutines/futures - in gather(), wait(), as_completed(); use a bytearray for buffering - in StreamReader; and more. +- Issue #21580: Now Tkinter correctly handles bytes arguments passed to Tk. + In particular this allows to initialize images from binary data. -- Issue #20288: fix handling of invalid numeric charrefs in HTMLParser. +- Issue #22003: When initialized from a bytes object, io.BytesIO() now + defers making a copy until it is mutated, improving performance and + memory use on some use cases. Patch by David Wilson. -- Issue #20424: Python implementation of io.StringIO now supports lone surrogates. +- Issue #22018: On Windows, signal.set_wakeup_fd() now also supports sockets. + A side effect is that Python depends to the WinSock library. -- Issue #20308: inspect.signature now works on classes without user-defined - __init__ or __new__ methods. +- Issue #22054: Add os.get_blocking() and os.set_blocking() functions to get + and set the blocking mode of a file descriptor (False if the O_NONBLOCK flag + is set, True otherwise). These functions are not available on Windows. -- Issue #20372: inspect.getfile (and a bunch of other inspect functions that - use it) doesn't crash with unexpected AttributeError on classes defined in C - without __module__. +- Issue #17172: Make turtledemo start as active on OS X even when run with + subprocess. Patch by Lita Cho. -- Issue #20356: inspect.signature formatting uses '/' to separate - positional-only parameters from others. +- Issue #21704: Fix build error for _multiprocessing when semaphores + are not available. Patch by Arfrever Frehtes Taifersar Arahesis. -- Issue #20223: inspect.signature now supports methods defined with - functools.partialmethods. +- Issue #20173: Convert sha1, sha256, sha512 and md5 to ArgumentClinic. + Patch by Vajrasky Kok. -- Issue #19456: ntpath.join() now joins relative paths correctly when a drive - is present. +- Fix repr(_socket.socket) on Windows 64-bit: don't fail with OverflowError + on closed socket. repr(socket.socket) already works fine. -- Issue #19077: tempfile.TemporaryDirectory cleanup no longer fails when - called during shutdown. Emitting resource warning in __del__ no longer fails. - Original patch by Antoine Pitrou. +- Issue #22033: Reprs of most Python implemened classes now contain actual + class name instead of hardcoded one. -- Issue #20394: Silence Coverity warning in audioop module. +- Issue #21947: The dis module can now disassemble generator-iterator + objects based on their gi_code attribute. Patch by Clement Rouault. -- Issue #20367: Fix behavior of concurrent.futures.as_completed() for - duplicate arguments. Patch by Glenn Langford. +- Issue #16133: The asynchat.async_chat.handle_read() method now ignores + BlockingIOError exceptions. -- Issue #8260: The read(), readline() and readlines() methods of - codecs.StreamReader returned incomplete data when were called after - readline() or read(size). Based on patch by Amaury Forgeot d'Arc. +- Issue #22044: Fixed premature DECREF in call_tzinfo_method. + Patch by Tom Flanagan. -- Issue #20105: the codec exception chaining now correctly sets the - traceback of the original exception as its __traceback__ attribute. +- Issue #19884: readline: Disable the meta modifier key if stdout is not + a terminal to not write the ANSI sequence "\033[1034h" into stdout. This + sequence is used on some terminal (ex: TERM=xterm-256color") to enable + support of 8 bit characters. -- Issue #17481: inspect.getfullargspec() now uses inspect.signature() API. +- Issue #4350: Removed a number of out-of-dated and non-working for a long time + Tkinter methods. -- Issue #15304: concurrent.futures.wait() can block forever even if - Futures have completed. Patch by Glenn Langford. +- Issue #6167: Scrollbar.activate() now returns the name of active element if + the argument is not specified. Scrollbar.set() now always accepts only 2 + arguments. -- Issue #14455: plistlib: fix serializing integers in the range - of an unsigned long long but outside of the range of signed long long for - binary plist files. +- Issue #15275: Clean up and speed up the ntpath module. -IDLE ----- +- Issue #21888: plistlib's load() and loads() now work if the fmt parameter is + specified. -- Issue #20406: Use Python application icons for Idle window title bars. - Patch mostly by Serhiy Storchaka. +- Issue #22032: __qualname__ instead of __name__ is now always used to format + fully qualified class names of Python implemented classes. -- Update the python.gif icon for the Idle classbrowser and pathbowser - from the old green snake to the new blue and yellow snakes. +- Issue #22031: Reprs now always use hexadecimal format with the "0x" prefix + when contain an id in form " at 0x...". -- Issue #17721: Remove non-functional configuration dialog help button until we - make it actually gives some help when clicked. Patch by Guilherme Simões. +- Issue #22018: signal.set_wakeup_fd() now raises an OSError instead of a + ValueError on ``fstat()`` failure. -Tests ------ +- Issue #21044: tarfile.open() now handles fileobj with an integer 'name' + attribute. Based on patch by Antoine Pietri. -- Issue #20532: Tests which use _testcapi now are marked as CPython only. +- Issue #21966: Respect -q command-line option when code module is ran. -- Issue #19920: Added tests for TarFile.list(). Based on patch by Vajrasky Kok. +- Issue #19076: Don't pass the redundant 'file' argument to self.error(). -- Issue #19990: Added tests for the imghdr module. Based on patch by - Claudiu Popa. +- Issue #16382: Improve exception message of warnings.warn() for bad + category. Initial patch by Phil Elson. -- Issue #20474: Fix test_socket "unexpected success" failures on OS X 10.7+. +- Issue #21932: os.read() now uses a :c:func:`Py_ssize_t` type instead of + :c:type:`int` for the size to support reading more than 2 GB at once. On + Windows, the size is truncted to INT_MAX. As any call to os.read(), the OS + may read less bytes than the number of requested bytes. -Tools/Demos ------------ +- Issue #21942: Fixed source file viewing in pydoc's server mode on Windows. -- Issue #20530: Argument Clinic's signature format has been revised again. - The new syntax is highly human readable while still preventing false - positives. The syntax also extends Python syntax to denote "self" and - positional-only parameters, allowing inspect.Signature objects to be - totally accurate for all supported builtins in Python 3.4. +- Issue #11259: asynchat.async_chat().set_terminator() now raises a ValueError + if the number of received bytes is negative. -- Issue #20456: Argument Clinic now observes the C preprocessor conditional - compilation statements of the C files it parses. When a Clinic block is - inside a conditional code, it adjusts its output to match, including - automatically generating an empty methoddef macro. +- Issue #12523: asynchat.async_chat.push() now raises a TypeError if it doesn't + get a bytes string -- Issue #20456: Cloned functions in Argument Clinic now use the correct - name, not the name of the function they were cloned from, for text - strings inside generated code. +- Issue #21707: Add missing kwonlyargcount argument to + ModuleFinder.replace_paths_in_code(). -- Issue #20456: Fixed Argument Clinic's test suite and "--converters" feature. +- Issue #20639: calling Path.with_suffix('') allows removing the suffix + again. Patch by July Tikhonov. -- Issue #20456: Argument Clinic now allows specifying different names - for a parameter in Python and C, using "as" on the parameter line. +- Issue #21714: Disallow the construction of invalid paths using + Path.with_name(). Original patch by Antony Lee. -- Issue #20326: Argument Clinic now uses a simple, unique signature to - annotate text signatures in docstrings, resulting in fewer false - positives. "self" parameters are also explicitly marked, allowing - inspect.Signature() to authoritatively detect (and skip) said parameters. +- Issue #15014: Added 'auth' method to smtplib to make implementing auth + mechanisms simpler, and used it internally in the login method. -- Issue #20326: Argument Clinic now generates separate checksums for the - input and output sections of the block, allowing external tools to verify - that the input has not changed (and thus the output is not out-of-date). +- Issue #21151: Fixed a segfault in the winreg module when ``None`` is passed + as a ``REG_BINARY`` value to SetValueEx. Patch by John Ehresman. -Build ------ +- Issue #21090: io.FileIO.readall() does not ignore I/O errors anymore. Before, + it ignored I/O errors if at least the first C call read() succeed. -- Issue #20465: Update SQLite shipped with OS X installer to 3.8.3. +- Issue #5800: headers parameter of wsgiref.headers.Headers is now optional. + Initial patch by Pablo Torres Navarrete and SilentGhost. -C-API ------ +- Issue #21781: ssl.RAND_add() now supports strings longer than 2 GB. -- Issue #20517: Added new functions allowing OSError exceptions to reference - two filenames instead of one: PyErr_SetFromErrnoWithFilenameObjects() and - PyErr_SetExcFromWindowsErrWithFilenameObjects(). +- Issue #21679: Prevent extraneous fstat() calls during open(). Patch by + Bohuslav Kabrda. -Documentation -------------- +- Issue #21863: cProfile now displays the module name of C extension functions, + in addition to their own name. -- Issue #20488: Change wording to say importlib is *the* implementation of - import instead of just *an* implementation. +- Issue #11453: asyncore: emit a ResourceWarning when an unclosed file_wrapper + object is destroyed. The destructor now closes the file if needed. The + close() method can now be called twice: the second call does nothing. -- Issue #6386: Clarify in the tutorial that specifying a symlink to execute - means the directory containing the executed script and not the symlink is - added to sys.path. +- Issue #21858: Better handling of Python exceptions in the sqlite3 module. +- Issue #21476: Make sure the email.parser.BytesParser TextIOWrapper is + discarded after parsing, so the input file isn't unexpectedly closed. -What's New in Python 3.4.0 Beta 3? -================================== +- Issue #20295: imghdr now recognizes OpenEXR format images. -Release date: 2014-01-26 +- Issue #21729: Used the "with" statement in the dbm.dumb module to ensure + files closing. Patch by Claudiu Popa. -Core and Builtins ------------------ +- Issue #21491: socketserver: Fix a race condition in child processes reaping. -- Issue #20189: Four additional builtin types (PyTypeObject, - PyMethodDescr_Type, _PyMethodWrapper_Type, and PyWrapperDescr_Type) - have been modified to provide introspection information for builtins. +- Issue #21719: Added the ``st_file_attributes`` field to os.stat_result on + Windows. -- Issue #17825: Cursor "^" is correctly positioned for SyntaxError and - IndentationError. +- Issue #21832: Require named tuple inputs to be exact strings. -- Issue #2382: SyntaxError cursor "^" is now written at correct position in most - cases when multibyte characters are in line (before "^"). This still not - works correctly with wide East Asian characters. +- Issue #21722: The distutils "upload" command now exits with a non-zero + return code when uploading fails. Patch by Martin Dengler. -- Issue #18960: The first line of Python script could be executed twice when - the source encoding was specified on the second line. Now the source encoding - declaration on the second line isn't effective if the first line contains - anything except a comment. 'python -x' works now again with files with the - source encoding declarations, and can be used to make Python batch files - on Windows. +- Issue #21723: asyncio.Queue: support any type of number (ex: float) for the + maximum size. Patch written by Vajrasky Kok. -Library -------- +- Issue #21711: support for "site-python" directories has now been removed + from the site module (it was deprecated in 3.4). -- asyncio: Various improvements and small changes not all covered by - issues listed below. E.g. wait_for() now cancels the inner task if - the timeout occcurs; tweaked the set of exported symbols; renamed - Empty/Full to QueueEmpty/QueueFull; "with (yield from lock)" now - uses a separate context manager; readexactly() raises if not enough - data was read; PTY support tweaks. +- Issue #17552: new socket.sendfile() method allowing to send a file over a + socket by using high-performance os.sendfile() on UNIX. + Patch by Giampaolo Rodola'. -- Issue #20311: asyncio: Add a granularity attribute to BaseEventLoop: maximum - between the resolution of the BaseEventLoop.time() method and the resolution - of the selector. The granuarility is used in the scheduler to round time and - deadline. +- Issue #18039: dbm.dump.open() now always creates a new database when the + flag has the value 'n'. Patch by Claudiu Popa. -- Issue #20311: selectors: Add a resolution attribute to BaseSelector. +- Issue #21326: Add a new is_closed() method to asyncio.BaseEventLoop. + run_forever() and run_until_complete() methods of asyncio.BaseEventLoop now + raise an exception if the event loop was closed. -- Issue #20189: unittest.mock now no longer assumes that any object for - which it could get an inspect.Signature is a callable written in Python. - Fix courtesy of Michael Foord. +- Issue #21766: Prevent a security hole in CGIHTTPServer by URL unquoting paths + before checking for a CGI script at that path. -- Issue #20317: ExitStack.__exit__ could create a self-referential loop if an - exception raised by a cleanup operation already had its context set - correctly (for example, by the @contextmanager decorator). The infinite - loop this caused is now avoided by checking if the expected context is - already set before trying to fix it. +- Issue #21310: Fixed possible resource leak in failed open(). -- Issue #20374: Fix build with GNU readline >= 6.3. +- Issue #21256: Printout of keyword args should be in deterministic order in + a mock function call. This will help to write better doctests. -- Issue #20262: Warnings are raised now when duplicate names are added in the - ZIP file or too long ZIP file comment is truncated. +- Issue #21677: Fixed chaining nonnormalized exceptions in io close() methods. -- Issue #20165: The unittest module no longer considers tests marked with - @expectedFailure successful if they pass. +- Issue #11709: Fix the pydoc.help function to not fail when sys.stdin is not a + valid file. -- Issue #18574: Added missing newline in 100-Continue reply from - http.server.BaseHTTPRequestHandler. Patch by Nikolaus Rath. +- Issue #21515: tempfile.TemporaryFile now uses os.O_TMPFILE flag is available. -- Issue #20270: urllib.urlparse now supports empty ports. +- Issue #13223: Fix pydoc.writedoc so that the HTML documentation for methods + that use 'self' in the example code is generated correctly. -- Issue #20243: TarFile no longer raise ReadError when opened in write mode. +- Issue #21463: In urllib.request, fix pruning of the FTP cache. -- Issue #20238: TarFile opened with external fileobj and "w:gz" mode didn't - write complete output on close. +- Issue #21618: The subprocess module could fail to close open fds that were + inherited by the calling process and already higher than POSIX resource + limits would otherwise allow. On systems with a functioning /proc/self/fd + or /dev/fd interface the max is now ignored and all fds are closed. -- Issue #20245: The open functions in the tarfile module now correctly handle - empty mode. +- Issue #20383: Introduce importlib.util.module_from_spec() as the preferred way + to create a new module. -- Issue #20242: Fixed basicConfig() format strings for the alternative - formatting styles. Thanks to kespindler for the bug report and patch. +- Issue #21552: Fixed possible integer overflow of too long string lengths in + the tkinter module on 64-bit platforms. -- Issue #20246: Fix buffer overflow in socket.recvfrom_into. +- Issue #14315: The zipfile module now ignores extra fields in the central + directory that are too short to be parsed instead of letting a struct.unpack + error bubble up as this "bad data" appears in many real world zip files in + the wild and is ignored by other zip tools. -- Issues #20206 and #5803: Fix edge case in email.quoprimime.encode where it - truncated lines ending in a character needing encoding but no newline by - using a more efficient algorithm that doesn't have the bug. +- Issue #13742: Added "key" and "reverse" parameters to heapq.merge(). + (First draft of patch contributed by Simon Sapin.) -- Issue #19082: Working xmlrpc.server and xmlrpc.client examples. Both in - modules and in documentation. Initial patch contributed by Vajrasky Kok. +- Issue #21402: tkinter.ttk now works when default root window is not set. -- Issue #20138: The wsgiref.application_uri() and wsgiref.request_uri() - functions now conform to PEP 3333 when handle non-ASCII URLs. +- Issue #3015: _tkinter.create() now creates tkapp object with wantobject=1 by + default. -- Issue #19097: Raise the correct Exception when cgi.FieldStorage is given an - invalid fileobj. +- Issue #10203: sqlite3.Row now truly supports sequence protocol. In particulr + it supports reverse() and negative indices. Original patch by Claudiu Popa. -- Issue #20152: Ported Python/import.c over to Argument Clinic. +- Issue #18807: If copying (no symlinks) specified for a venv, then the python + interpreter aliases (python, python3) are now created by copying rather than + symlinking. -- Issue #13107: argparse and optparse no longer raises an exception when output - a help on environment with too small COLUMNS. Based on patch by - Elazar Gershuni. +- Issue #20197: Added support for the WebP image type in the imghdr module. + Patch by Fabrice Aneche and Claudiu Popa. -- Issue #20207: Always disable SSLv2 except when PROTOCOL_SSLv2 is explicitly - asked for. +- Issue #21513: Speedup some properties of IP addresses (IPv4Address, + IPv6Address) such as .is_private or .is_multicast. -- Issue #18960: The tokenize module now ignore the source encoding declaration - on the second line if the first line contains anything except a comment. +- Issue #21137: Improve the repr for threading.Lock() and its variants + by showing the "locked" or "unlocked" status. Patch by Berker Peksag. -- Issue #20078: Reading malformed zipfiles no longer hangs with 100% CPU - consumption. +- Issue #21538: The plistlib module now supports loading of binary plist files + when reference or offset size is not a power of two. -- Issue #20113: os.readv() and os.writev() now raise an OSError exception on - error instead of returning -1. +- Issue #21455: Add a default backlog to socket.listen(). -- Issue #19719: Make importlib.abc.MetaPathFinder.find_module(), - PathEntryFinder.find_loader(), and Loader.load_module() use PEP 451 APIs to - help with backwards-compatibility. +- Issue #21525: Most Tkinter methods which accepted tuples now accept lists too. -- Issue #20144: inspect.Signature now supports parsing simple symbolic - constants as parameter default values in __text_signature__. +- Issue #22166: with the assistance of a new internal _codecs._forget_codec + helping function, test_codecs now clears the encoding caches to avoid the + appearance of a reference leak -- Issue #20072: Fixed multiple errors in tkinter with wantobjects is False. +- Issue #22236: Tkinter tests now don't reuse default root window. New root + window is created for every test class. -- Issue #20229: Avoid plistlib deprecation warning in platform.mac_ver(). +- Issue #10744: Fix PEP 3118 format strings on ctypes objects with a nontrivial + shape. -- Issue #14455: Fix some problems with the new binary plist support in plistlib. +- Issue #20826: Optimize ipaddress.collapse_addresses(). -IDLE ----- +- Issue #21487: Optimize ipaddress.summarize_address_range() and + ipaddress.{IPv4Network,IPv6Network}.subnets(). -- Issue #17390: Add Python version to Idle editor window title bar. - Original patches by Edmond Burnett and Kent Johnson. +- Issue #21486: Optimize parsing of netmasks in ipaddress.IPv4Network and + ipaddress.IPv6Network. -- Issue #18960: IDLE now ignores the source encoding declaration on the second - line if the first line contains anything except a comment. +- Issue #13916: Disallowed the surrogatepass error handler for non UTF-* + encodings. -Tests ------ +- Issue #20998: Fixed re.fullmatch() of repeated single character pattern + with ignore case. Original patch by Matthew Barnett. -- Issue #20358: Tests for curses.window.overlay and curses.window.overwrite - no longer specify min{row,col} > max{row,col}. +- Issue #21075: fileinput.FileInput now reads bytes from standard stream if + binary mode is specified. Patch by Sam Kimbrel. -- Issue #19804: The test_find_mac test in test_uuid is now skipped if the - ifconfig executable is not available. +- Issue #19775: Add a samefile() method to pathlib Path objects. Initial + patch by Vajrasky Kok. -- Issue #19886: Use better estimated memory requirements for bigmem tests. +- Issue #21226: Set up modules properly in PyImport_ExecCodeModuleObject + (and friends). -Tools/Demos ------------ +- Issue #21398: Fix an unicode error in the pydoc pager when the documentation + contains characters not encodable to the stdout encoding. -- Issue #20390: Argument Clinic's "file" output preset now defaults to - "{dirname}/clinic/{basename}.h". +- Issue #16531: ipaddress.IPv4Network and ipaddress.IPv6Network now accept + an (address, netmask) tuple argument, so as to easily construct network + objects from existing addresses. -- Issue #20390: Argument Clinic's "class" directive syntax has been extended - with two new required arguments: "typedef" and "type_object". +- Issue #21156: importlib.abc.InspectLoader.source_to_code() is now a + staticmethod. -- Issue #20390: Argument Clinic: If __new__ or __init__ functions didn't use - kwargs (or args), the PyArg_NoKeywords (or PyArg_NoPositional) calls - generated are only run when the type object is an exact match. +- Issue #21424: Simplified and optimized heaqp.nlargest() and nmsmallest() + to make fewer tuple comparisons. -- Issue #20390: Argument Clinic now fails if you have required parameters after - optional parameters. +- Issue #21396: Fix TextIOWrapper(..., write_through=True) to not force a + flush() on the underlying binary stream. Patch by akira. -- Issue #20390: Argument Clinic converters now have a new template they can - inject code into: "modifiers". Code put there is run in the parsing - function after argument parsing but before the call to the impl. +- Issue #18314: Unlink now removes junctions on Windows. Patch by Kim Gräsman -- Issue #20376: Argument Clinic now escapes backslashes in docstrings. +- Issue #21088: Bugfix for curses.window.addch() regression in 3.4.0. + In porting to Argument Clinic, the first two arguments were reversed. -- Issue #20381: Argument Clinic now sanity checks the default argument when - c_default is also specified, providing a nice failure message for - disallowed values. +- Issue #21407: _decimal: The module now supports function signatures. -- Issue #20189: Argument Clinic now ensures that parser functions for - __new__ are always of type newfunc, the type of the tp_new slot. - Similarly, parser functions for __init__ are now always of type initproc, - the type of tp_init. +- Issue #10650: Remove the non-standard 'watchexp' parameter from the + Decimal.quantize() method in the Python version. It had never been + present in the C version. -- Issue #20189: Argument Clinic now suppresses the docstring for __new__ - and __init__ functions if no docstring is provided in the input. +- Issue #21469: Reduced the risk of false positives in robotparser by + checking to make sure that robots.txt has been read or does not exist + prior to returning True in can_fetch(). -- Issue #20189: Argument Clinic now suppresses the "self" parameter in the - impl for @staticmethod functions. +- Issue #19414: Have the OrderedDict mark deleted links as unusable. + This gives an early failure if the link is deleted during iteration. -- Issue #20294: Argument Clinic now supports argument parsing for __new__ and - __init__ functions. +- Issue #21421: Add __slots__ to the MappingViews ABC. + Patch by Josh Rosenberg. -- Issue #20299: Argument Clinic custom converters may now change the default - value of c_default and py_default with a class member. - -- Issue #20287: Argument Clinic's output is now configurable, allowing - delaying its output or even redirecting it to a separate file. +- Issue #21101: Eliminate double hashing in the C speed-up code for + collections.Counter(). -- Issue #20226: Argument Clinic now permits simple expressions - (e.g. "sys.maxsize - 1") as default values for parameters. +- Issue #21321: itertools.islice() now releases the reference to the source + iterator when the slice is exhausted. Patch by Anton Afanasyev. -- Issue #19936: Added executable bits or shebang lines to Python scripts which - requires them. Disable executable bits and shebang lines in test and - benchmark files in order to prevent using a random system python, and in - source files of modules which don't provide command line interface. Fixed - shebang lines in the unittestgui and checkpip scripts. +- Issue #21057: TextIOWrapper now allows the underlying binary stream's + read() or read1() method to return an arbitrary bytes-like object + (such as a memoryview). Patch by Nikolaus Rath. -- Issue #20268: Argument Clinic now supports cloning the parameters and - return converter of existing functions. +- Issue #20951: SSLSocket.send() now raises either SSLWantReadError or + SSLWantWriteError on a non-blocking socket if the operation would block. + Previously, it would return 0. Patch by Nikolaus Rath. -- Issue #20228: Argument Clinic now has special support for class special - methods. +- Issue #13248: removed previously deprecated asyncore.dispatcher __getattr__ + cheap inheritance hack. -- Issue #20214: Fixed a number of small issues and documentation errors in - Argument Clinic (see issue for details). +- Issue #9815: assertRaises now tries to clear references to local variables + in the exception's traceback. -- Issue #20196: Fixed a bug where Argument Clinic did not generate correct - parsing code for functions with positional-only parameters where all arguments - are optional. +- Issue #19940: ssl.cert_time_to_seconds() now interprets the given time + string in the UTC timezone (as specified in RFC 5280), not the local + timezone. -- Issue #18960: 2to3 and the findnocoding.py script now ignore the source - encoding declaration on the second line if the first line contains anything - except a comment. +- Issue #13204: Calling sys.flags.__new__ would crash the interpreter, + now it raises a TypeError. -- Issue #19723: The marker comments Argument Clinic uses have been changed - to improve readability. +- Issue #19385: Make operations on a closed dbm.dumb database always raise the + same exception. -- Issue #20157: When Argument Clinic renames a parameter because its name - collides with a C keyword, it no longer exposes that rename to PyArg_Parse. +- Issue #21207: Detect when the os.urandom cached fd has been closed or + replaced, and open it anew. -- Issue #20141: Improved Argument Clinic's support for the PyArg_Parse "O!" - format unit. +- Issue #21291: subprocess's Popen.wait() is now thread safe so that + multiple threads may be calling wait() or poll() on a Popen instance + at the same time without losing the Popen.returncode value. -- Issue #20144: Argument Clinic now supports simple symbolic constants - as parameter default values. +- Issue #21127: Path objects can now be instantiated from str subclass + instances (such as ``numpy.str_``). -- Issue #20143: The line numbers reported in Argument Clinic errors are - now more accurate. +- Issue #15002: urllib.response object to use _TemporaryFileWrapper (and + _TemporaryFileCloser) facility. Provides a better way to handle file + descriptor close. Patch contributed by Christian Theune. -- Issue #20142: Py_buffer variables generated by Argument Clinic are now - initialized with a default value. +- Issue #12220: mindom now raises a custom ValueError indicating it doesn't + support spaces in URIs instead of letting a 'split' ValueError bubble up. -Build ------ +- Issue #21068: The ssl.PROTOCOL* constants are now enum members. -- Issue #12837: Silence a tautological comparison warning on OS X under Clang in - socketmodule.c. +- Issue #21276: posixmodule: Don't define USE_XATTRS on KFreeBSD and the Hurd. +- Issue #21262: New method assert_not_called for Mock. + It raises AssertionError if the mock has been called. -What's New in Python 3.4.0 Beta 2? -================================== +- Issue #21238: New keyword argument `unsafe` to Mock. It raises + `AttributeError` incase of an attribute startswith assert or assret. -Release date: 2014-01-05 +- Issue #20896: ssl.get_server_certificate() now uses PROTOCOL_SSLv23, not + PROTOCOL_SSLv3, for maximum compatibility. -Core and Builtins ------------------ +- Issue #21239: patch.stopall() didn't work deterministically when the same + name was patched more than once. -- Issue #17432: Drop UCS2 from names of Unicode functions in python3.def. +- Issue #21203: Updated fileConfig and dictConfig to remove inconsistencies. + Thanks to Jure Koren for the patch. -- Issue #19526: Exclude all new API from the stable ABI. Exceptions can be - made if a need is demonstrated. +- Issue #21222: Passing name keyword argument to mock.create_autospec now + works. -- Issue #19969: PyBytes_FromFormatV() now raises an OverflowError if "%c" - argument is not in range [0; 255]. +- Issue #21197: Add lib64 -> lib symlink in venvs on 64-bit non-OS X POSIX. -- Issue #19995: %c, %o, %x, and %X now issue a DeprecationWarning on non-integer - input; reworded docs to clarify that an integer type should define both __int__ - and __index__. +- Issue #17498: Some SMTP servers disconnect after certain errors, violating + strict RFC conformance. Instead of losing the error code when we issue the + subsequent RSET, smtplib now returns the error code and defers raising the + SMTPServerDisconnected error until the next command is issued. -- Issue #19787: PyThread_set_key_value() now always set the value. In Python - 3.3, the function did nothing if the key already exists (if the current value - is a non-NULL pointer). +- Issue #17826: setting an iterable side_effect on a mock function created by + create_autospec now works. Patch by Kushal Das. -- Issue #14432: Remove the thread state field from the frame structure. Fix a - crash when a generator is created in a C thread that is destroyed while the - generator is still used. The issue was that a generator contains a frame, and - the frame kept a reference to the Python state of the destroyed C thread. The - crash occurs when a trace function is setup. +- Issue #7776: Fix ``Host:`` header and reconnection when using + http.client.HTTPConnection.set_tunnel(). Patch by Nikolaus Rath. -- Issue #19576: PyGILState_Ensure() now initializes threads. At startup, Python - has no concrete GIL. If PyGILState_Ensure() is called from a new thread for - the first time and PyEval_InitThreads() was not called yet, a GIL needs to be - created. +- Issue #20968: unittest.mock.MagicMock now supports division. + Patch by Johannes Baiter. -- Issue #17576: Deprecation warning emitted now when __int__() or __index__() - return not int instance. +- Fix arbitrary memory access in JSONDecoder.raw_decode with a negative second + parameter. Bug reported by Guido Vranken. -- Issue #19932: Fix typo in import.h, missing whitespaces in function prototypes. +- Issue #21169: getpass now handles non-ascii characters that the + input stream encoding cannot encode by re-encoding using the + replace error handler. -- Issue #19736: Add module-level statvfs constants defined for GNU/glibc - based systems. +- Issue #21171: Fixed undocumented filter API of the rot13 codec. + Patch by Berker Peksag. -- Issue #20097: Fix bad use of "self" in importlib's WindowsRegistryFinder. +- Issue #20539: Improved math.factorial error message for large positive inputs + and changed exception type (OverflowError -> ValueError) for large negative + inputs. -- Issue #19729: In str.format(), fix recursive expansion in format spec. +- Issue #21172: isinstance check relaxed from dict to collections.Mapping. -- Issue #19638: Fix possible crash / undefined behaviour from huge (more than 2 - billion characters) input strings in _Py_dg_strtod. +- Issue #21155: asyncio.EventLoop.create_unix_server() now raises a ValueError + if path and sock are specified at the same time. -Library -------- +- Issue #21136: Avoid unnecessary normalization of Fractions resulting from + power and other operations. Patch by Raymond Hettinger. -- Issue #20154: Deadlock in asyncio.StreamReader.readexactly(). +- Issue #17621: Introduce importlib.util.LazyLoader. -- Issue #16113: Remove sha3 module again. +- Issue #21076: signal module constants were turned into enums. + Patch by Giampaolo Rodola'. -- Issue #20111: pathlib.Path.with_suffix() now sanity checks the given suffix. +- Issue #20636: Improved the repr of Tkinter widgets. -- Fix breakage in TestSuite.countTestCases() introduced by issue #11798. +- Issue #19505: The items, keys, and values views of OrderedDict now support + reverse iteration using reversed(). -- Issue #20108: Avoid parameter name clash in inspect.getcallargs(). +- Issue #21149: Improved thread-safety in logging cleanup during interpreter + shutdown. Thanks to Devin Jeanpierre for the patch. -- Issue #19918: Fix PurePath.relative_to() under Windows. +- Issue #21058: Fix a leak of file descriptor in + :func:`tempfile.NamedTemporaryFile`, close the file descriptor if + :func:`io.open` fails -- Issue #19422: Explicitly disallow non-SOCK_STREAM sockets in the ssl - module, rather than silently let them emit clear text data. +- Issue #21200: Return None from pkgutil.get_loader() when __spec__ is missing. -- Issue #20046: Locale alias table no longer contains entities which can be - calculated. Generalized support of the euro modifier. +- Issue #21013: Enhance ssl.create_default_context() when used for server side + sockets to provide better security by default. -- Issue #20027: Fixed locale aliases for devanagari locales. +- Issue #20145: `assertRaisesRegex` and `assertWarnsRegex` now raise a + TypeError if the second argument is not a string or compiled regex. -- Issue #20067: Tkinter variables now work when wantobjects is false. +- Issue #20633: Replace relative import by absolute import. -- Issue #19020: Tkinter now uses splitlist() instead of split() in configure - methods. +- Issue #20980: Stop wrapping exception when using ThreadPool. -- Issue #19744: ensurepip now provides a better error message when Python is - built without SSL/TLS support (pip currently requires that support to run, - even if only operating with local wheel files) +- Issue #21082: In os.makedirs, do not set the process-wide umask. Note this + changes behavior of makedirs when exist_ok=True. -- Issue #19734: ensurepip now ignores all pip environment variables to avoid - odd behaviour based on user configuration settings +- Issue #20990: Fix issues found by pyflakes for multiprocessing. -- Fix TypeError on "setup.py upload --show-response". +- Issue #21015: SSL contexts will now automatically select an elliptic + curve for ECDH key exchange on OpenSSL 1.0.2 and later, and otherwise + default to "prime256v1". -- Issue #20045: Fix "setup.py register --list-classifiers". +- Issue #21000: Improve the command-line interface of json.tool. -- Issue #18879: When a method is looked up on a temporary file, avoid closing - the file before the method is possibly called. +- Issue #20995: Enhance default ciphers used by the ssl module to enable + better security an prioritize perfect forward secrecy. -- Issue #20037: Avoid crashes when opening a text file late at interpreter - shutdown. +- Issue #20884: Don't assume that __file__ is defined on importlib.__init__. -- Issue #19967: Thanks to the PEP 442, asyncio.Future now uses a - destructor to log uncaught exceptions, instead of the dedicated - _TracebackLogger class. +- Issue #21499: Ignore __builtins__ in several test_importlib.test_api tests. -- Added a Task.current_task() class method to asyncio. +- Issue #20627: xmlrpc.client.ServerProxy is now a context manager. -- Issue #19850: Set SA_RESTART in asyncio when registering a signal - handler to limit EINTR occurrences. +- Issue #19165: The formatter module now raises DeprecationWarning instead of + PendingDeprecationWarning. -- Implemented write flow control in asyncio for proactor event loop (Windows). +- Issue #13936: Remove the ability of datetime.time instances to be considered + false in boolean contexts. -- Change write buffer in asyncio use to avoid O(N**2) behavior. Make - write()/sendto() accept bytearray/memoryview. +- Issue 18931: selectors module now supports /dev/poll on Solaris. + Patch by Giampaolo Rodola'. -- Issue #20034: Updated alias mapping to most recent locale.alias file - from X.org distribution using makelocalealias.py. +- Issue #19977: When the ``LC_TYPE`` locale is the POSIX locale (``C`` locale), + :py:data:`sys.stdin` and :py:data:`sys.stdout` are now using the + ``surrogateescape`` error handler, instead of the ``strict`` error handler. -- Issue #5815: Fixed support for locales with modifiers. Fixed support for - locale encodings with hyphens. +- Issue #20574: Implement incremental decoder for cp65001 code (Windows code + page 65001, Microsoft UTF-8). -- Issue #20026: Fix the sqlite module to handle correctly invalid isolation - level (wrong type). +- Issue #20879: Delay the initialization of encoding and decoding tables for + base32, ascii85 and base85 codecs in the base64 module, and delay the + initialization of the unquote_to_bytes() table of the urllib.parse module, to + not waste memory if these modules are not used. -- Issue #18829: csv.Dialect() now checks type for delimiter, escapechar and - quotechar fields. Original patch by Vajrasky Kok. +- Issue #19157: Include the broadcast address in the usuable hosts for IPv6 + in ipaddress. -- Issue #19855: uuid.getnode() on Unix now looks on the PATH for the - executables used to find the mac address, with /sbin and /usr/sbin as - fallbacks. +- Issue #11599: When an external command (e.g. compiler) fails, distutils now + prints out the whole command line (instead of just the command name) if the + environment variable DISTUTILS_DEBUG is set. -- Issue #20007: HTTPResponse.read(0) no more prematurely closes connection. - Original patch by Simon Sapin. +- Issue #4931: distutils should not produce unhelpful "error: None" messages + anymore. distutils.util.grok_environment_error is kept but doc-deprecated. -- Issue #19946: multiprocessing now uses runpy to initialize __main__ in - child processes when necessary, allowing it to correctly handle scripts - without suffixes and submodules that use explicit relative imports or - otherwise rely on parent modules being correctly imported prior to - execution. +- Issue #20875: Prevent possible gzip "'read' is not defined" NameError. + Patch by Claudiu Popa. -- Issue #19921: When Path.mkdir() is called with parents=True, any missing - parent is created with the default permissions, ignoring the mode argument - (mimicking the POSIX "mkdir -p" command). +- Issue #11558: ``email.message.Message.attach`` now returns a more + useful error message if ``attach`` is called on a message for which + ``is_multipart`` is False. -- Issue #19887: Improve the Path.resolve() algorithm to support certain - symlink chains. +- Issue #20283: RE pattern methods now accept the string keyword parameters + as documented. The pattern and source keyword parameters are left as + deprecated aliases. -- Issue #19912: Fixed numerous bugs in ntpath.splitunc(). +- Issue #20778: Fix modulefinder to work with bytecode-only modules. -- Issue #19911: ntpath.splitdrive() now correctly processes the 'İ' character - (U+0130, LATIN CAPITAL LETTER I WITH DOT ABOVE). +- Issue #20791: copy.copy() now doesn't make a copy when the input is + a bytes object. Initial patch by Peter Otten. -- Issue #19532: python -m compileall with no filename/directory arguments now - respects the -f and -q flags instead of ignoring them. +- Issue #19748: On AIX, time.mktime() now raises an OverflowError for year + outsize range [1902; 2037]. -- Issue #19623: Fixed writing to unseekable files in the aifc module. +- Issue #19573: inspect.signature: Use enum for parameter kind constants. -- Issue #19946: multiprocessing.spawn now raises ImportError when the module to - be used as the main module cannot be imported. +- Issue #20726: inspect.signature: Make Signature and Parameter picklable. -- Issue #17919: select.poll.register() again works with poll.POLLNVAL on AIX. - Fixed integer overflow in the eventmask parameter. +- Issue #17373: Add inspect.Signature.from_callable method. -- Issue #19063: if a Charset's body_encoding was set to None, the email - package would generate a message claiming the Content-Transfer-Encoding - was 7bit, and produce garbage output for the content. This now works. - A couple of other set_payload mishandlings of non-ASCII are also fixed. - In addition, calling set_payload with a string argument without - specifying a charset now raises an error (this is a new error in 3.4). +- Issue #20378: Improve repr of inspect.Signature and inspect.Parameter. -- Issue #15475: Add __sizeof__ implementations for itertools objects. +- Issue #20816: Fix inspect.getcallargs() to raise correct TypeError for + missing keyword-only arguments. Patch by Jeremiah Lowin. -- Issue #19944: Fix importlib.find_spec() so it imports parents as needed - and move the function to importlib.util. +- Issue #20817: Fix inspect.getcallargs() to fail correctly if more + than 3 arguments are missing. Patch by Jeremiah Lowin. -- Issue #19880: Fix a reference leak in unittest.TestCase. Explicitly break - reference cycles between frames and the _Outcome instance. +- Issue #6676: Ensure a meaningful exception is raised when attempting + to parse more than one XML document per pyexpat xmlparser instance. + (Original patches by Hirokazu Yamamoto and Amaury Forgeot d'Arc, with + suggested wording by David Gutteridge) -- Issue #17429: platform.linux_distribution() now decodes files from the UTF-8 - encoding with the surrogateescape error handler, instead of decoding from the - locale encoding in strict mode. It fixes the function on Fedora 19 which is - probably the first major distribution release with a non-ASCII name. Patch - written by Toshio Kuratomi. +- Issue #21117: Fix inspect.signature to better support functools.partial. + Due to the specifics of functools.partial implementation, + positional-or-keyword arguments passed as keyword arguments become + keyword-only. -- Issue #19343: Expose FreeBSD-specific APIs in resource module. Original - patch by Koobs. +- Issue #20334: inspect.Signature and inspect.Parameter are now hashable. + Thanks to Antony Lee for bug reports and suggestions. -- Issue #19929: Call os.read with 32768 within subprocess.Popen.communicate - rather than 4096 for efficiency. A microbenchmark shows Linux and OS X - both using ~50% less cpu time this way. +- Issue #15916: doctest.DocTestSuite returns an empty unittest.TestSuite instead + of raising ValueError if it finds no tests -- Issue #19506: Use a memoryview to avoid a data copy when piping data - to stdin within subprocess.Popen.communicate. 5-10% less cpu usage. +- Issue #21209: Fix asyncio.tasks.CoroWrapper to workaround a bug + in yield-from implementation in CPythons prior to 3.4.1. -- Issue #19876: selectors unregister() no longer raises ValueError or OSError - if the FD is closed (as long as it was registered). +- asyncio: Add gi_{frame,running,code} properties to CoroWrapper + (upstream issue #163). -- Issue #19908: pathlib now joins relative Windows paths correctly when a drive - is present. Original patch by Antoine Pitrou. +- Issue #21311: Avoid exception in _osx_support with non-standard compiler + configurations. Patch by John Szakmeister. -- Issue #19296: Silence compiler warning in dbm_open +- Issue #11571: Ensure that the turtle window becomes the topmost window + when launched on OS X. -- Issue #6784: Strings from Python 2 can now be unpickled as bytes - objects by setting the encoding argument of Unpickler to be 'bytes'. - Initial patch by Merlijn van Deen. +- Issue #21801: Validate that __signature__ is None or an instance of Signature. -- Issue #19839: Fix regression in bz2 module's handling of non-bzip2 data at - EOF, and analogous bug in lzma module. +- Issue #21923: Prevent AttributeError in distutils.sysconfig.customize_compiler + due to possible uninitialized _config_vars. -- Issue #19881: Fix pickling bug where cpickle would emit bad pickle data for - large bytes string (i.e., with size greater than 2**32-1). +- Issue #21323: Fix http.server to again handle scripts in CGI subdirectories, + broken by the fix for security issue #19435. Patch by Zach Byrne. -- Issue #19138: doctest's IGNORE_EXCEPTION_DETAIL now allows a match when - no exception detail exists (no colon following the exception's name, or - a colon does follow but no text follows the colon). +- Issue #22733: Fix ffi_prep_args not zero-extending argument values correctly + on 64-bit Windows. -- Issue #19927: Add __eq__ to path-based loaders in importlib. +- Issue #23302: Default to TCP_NODELAY=1 upon establishing an HTTPConnection. + Removed use of hard-coded MSS as it's an optimization that's no longer needed + with Nagle disabled. -- Issue #19827: On UNIX, setblocking() and settimeout() methods of - socket.socket can now avoid a second syscall if the ioctl() function can be - used, or if the non-blocking flag of the socket is unchanged. +IDLE +---- -- Issue #19785: smtplib now supports SSLContext.check_hostname and server name - indication for TLS/SSL connections. +- Issue #20577: Configuration of the max line length for the FormatParagraph + extension has been moved from the General tab of the Idle preferences dialog + to the FormatParagraph tab of the Config Extensions dialog. + Patch by Tal Einat. -- Issue #19784: poplib now supports SSLContext.check_hostname and server name - indication for TLS/SSL connections. +- Issue #16893: Update Idle doc chapter to match current Idle and add new + information. -- Issue #19783: nntplib now supports SSLContext.check_hostname and server name - indication for TLS/SSL connections. +- Issue #3068: Add Idle extension configuration dialog to Options menu. + Changes are written to HOME/.idlerc/config-extensions.cfg. + Original patch by Tal Einat. -- Issue #19782: imaplib now supports SSLContext.check_hostname and server name - indication for TLS/SSL connections. +- Issue #16233: A module browser (File : Class Browser, Alt+C) requires a + editor window with a filename. When Class Browser is requested otherwise, + from a shell, output window, or 'Untitled' editor, Idle no longer displays + an error box. It now pops up an Open Module box (Alt+M). If a valid name + is entered and a module is opened, a corresponding browser is also opened. -- Issue #20123: Fix pydoc.synopsis() for "binary" modules. +- Issue #4832: Save As to type Python files automatically adds .py to the + name you enter (even if your system does not display it). Some systems + automatically add .txt when type is Text files. -- Issue #19834: Support unpickling of exceptions pickled by Python 2. +- Issue #21986: Code objects are not normally pickled by the pickle module. + To match this, they are no longer pickled when running under Idle. -- Issue #19781: ftplib now supports SSLContext.check_hostname and server name - indication for TLS/SSL connections. +- Issue #17390: Adjust Editor window title; remove 'Python', + move version to end. -- Issue #19509: Add SSLContext.check_hostname to match the peer's certificate - with server_hostname on handshake. +- Issue #14105: Idle debugger breakpoints no longer disappear + when inseting or deleting lines. -- Issue #15798: Fixed subprocess.Popen() to no longer fail if file - descriptor 0, 1 or 2 is closed. +- Issue #17172: Turtledemo can now be run from Idle. + Currently, the entry is on the Help menu, but it may move to Run. + Patch by Ramchandra Apt and Lita Cho. -- Issue #17897: Optimized unpickle prefetching. +- Issue #21765: Add support for non-ascii identifiers to HyperParser. -- Issue #3693: Make the error message more helpful when the array.array() - constructor is given a str. Move the array module typecode documentation to - the docstring of the constructor. +- Issue #21940: Add unittest for WidgetRedirector. Initial patch by Saimadhav + Heblikar. -- Issue #19088: Fixed incorrect caching of the copyreg module in - object.__reduce__() and object.__reduce_ex__(). +- Issue #18592: Add unittest for SearchDialogBase. Patch by Phil Webster. -- Issue #19698: Removed exec_module() methods from - importlib.machinery.BuiltinImporter and ExtensionFileLoader. +- Issue #21694: Add unittest for ParenMatch. Patch by Saimadhav Heblikar. -- Issue #18864: Added a setter for ModuleSpec.has_location. +- Issue #21686: add unittest for HyperParser. Original patch by Saimadhav + Heblikar. -- Fixed _pickle.Unpickler to not fail when loading empty strings as - persistent IDs. +- Issue #12387: Add missing upper(lower)case versions of default Windows key + bindings for Idle so Caps Lock does not disable them. Patch by Roger Serwy. -- Issue #11480: Fixed copy.copy to work with classes with custom metaclasses. - Patch by Daniel Urban. +- Issue #21695: Closing a Find-in-files output window while the search is + still in progress no longer closes Idle. -- Issue #6477: Added support for pickling the types of built-in singletons - (i.e., Ellipsis, NotImplemented, None). +- Issue #18910: Add unittest for textView. Patch by Phil Webster. -- Issue #19713: Add remaining PEP 451-related deprecations and move away - from using find_module/find_loaer/load_module. +- Issue #18292: Add unittest for AutoExpand. Patch by Saihadhav Heblikar. -- Issue #19708: Update pkgutil to use the new importer APIs. +- Issue #18409: Add unittest for AutoComplete. Patch by Phil Webster. -- Issue #19703: Update pydoc to use the new importer APIs. +- Issue #21477: htest.py - Improve framework, complete set of tests. + Patches by Saimadhav Heblikar -- Issue #19851: Fixed a regression in reloading sub-modules. +- Issue #18104: Add idlelib/idle_test/htest.py with a few sample tests to begin + consolidating and improving human-validated tests of Idle. Change other files + as needed to work with htest. Running the module as __main__ runs all tests. -- ssl.create_default_context() sets OP_NO_COMPRESSION to prevent CRIME. +- Issue #21139: Change default paragraph width to 72, the PEP 8 recommendation. -- Issue #19802: Add socket.SO_PRIORITY. +- Issue #21284: Paragraph reformat test passes after user changes reformat width. -- Issue #11508: Fixed uuid.getnode() and uuid.uuid1() on environment with - virtual interface. Original patch by Kent Frazier. +- Issue #17654: Ensure IDLE menus are customized properly on OS X for + non-framework builds and for all variants of Tk. -- Issue #11489: JSON decoder now accepts lone surrogates. +- Issue #23180: Rename IDLE "Windows" menu item to "Window". + Patch by Al Sweigart. -- Issue #19545: Avoid chained exceptions while passing stray % to - time.strptime(). Initial patch by Claudiu Popa. +Build +----- -IDLE ----- +- Issue #15506: Use standard PKG_PROG_PKG_CONFIG autoconf macro in the configure + script. -- Issue #20058: sys.stdin.readline() in IDLE now always returns only one line. +- Issue #22935: Allow the ssl module to be compiled if openssl doesn't support + SSL 3. -- Issue #19481: print() of string subclass instance in IDLE no longer hangs. +- Issue #22592: Drop support of the Borland C compiler to build Python. The + distutils module still supports it to build extensions. -- Issue #18270: Prevent possible IDLE AttributeError on OS X when no initial - shell window is present. +- Issue #22591: Drop support of MS-DOS, especially of the DJGPP compiler + (MS-DOS port of GCC). -Tests ------ +- Issue #16537: Check whether self.extensions is empty in setup.py. Patch by + Jonathan Hosmer. -- Issue #20055: Fix test_shutil under Windows with symlink privileges held. - Patch by Vajrasky Kok. +- Issue #22359: Remove incorrect uses of recursive make. Patch by Jonas + Wagner. -- Issue #20070: Don't run test_urllib2net when network resources are not - enabled. +- Issue #21958: Define HAVE_ROUND when building with Visual Studio 2013 and + above. Patch by Zachary Turner. -- Issue #19938: Re-enabled test_bug_1333982 in test_dis, which had been - disabled since 3.0 due to the changes in listcomp handling. +- Issue #18093: the programs that embed the CPython runtime are now in a + separate "Programs" directory, rather than being kept in the Modules + directory. -- Issue #19320: test_tcl no longer fails when wantobjects is false. +- Issue #15759: "make suspicious", "make linkcheck" and "make doctest" in Doc/ + now display special message when and only when there are failures. -- Issue #19919: Fix flaky SSL test. connect_ex() sometimes returns - EWOULDBLOCK on Windows or VMs hosted on Windows. +- Issue #21141: The Windows build process no longer attempts to find Perl, + instead relying on OpenSSL source being configured and ready to build. The + ``PCbuild\build_ssl.py`` script has been re-written and re-named to + ``PCbuild\prepare_ssl.py``, and takes care of configuring OpenSSL source + for both 32 and 64 bit platforms. OpenSSL sources obtained from + svn.python.org will always be pre-configured and ready to build. -- Issue #19912: Added tests for ntpath.splitunc(). +- Issue #21037: Add a build option to enable AddressSanitizer support. -- Issue #19828: Fixed test_site when the whole suite is run with -S. +- Issue #19962: The Windows build process now creates "python.bat" in the + root of the source tree, which passes all arguments through to the most + recently built interpreter. -- Issue #19928: Implemented a test for repr() of cell objects. +- Issue #21285: Refactor and fix curses configure check to always search + in a ncursesw directory. -- Issue #19535: Fixed test_docxmlrpc, test_functools, test_inspect, and - test_statistics when python is run with -OO. +- Issue #15234: For BerkelyDB and Sqlite, only add the found library and + include directories if they aren't already being searched. This avoids + an explicit runtime library dependency. -- Issue #19926: Removed unneeded test_main from test_abstract_numbers. - Patch by Vajrasky Kok. +- Issue #17861: Tools/scripts/generate_opcode_h.py automatically regenerates + Include/opcode.h from Lib/opcode.py if the later gets any change. -- Issue #19572: More skipped tests explicitly marked as skipped. +- Issue #20644: OS X installer build support for documentation build changes + in 3.4.1: assume externally supplied sphinx-build is available in /usr/bin. -- Issue #19595, #19987: Re-enabled a long-disabled test in test_winsound. +- Issue #20022: Eliminate use of deprecated bundlebuilder in OS X builds. -- Issue #19588: Fixed tests in test_random that were silently skipped most - of the time. Patch by Julian Gindi. +- Issue #15968: Incorporated Tcl, Tk, and Tix builds into the Windows build + solution. -Build ------ +- Issue #17095: Fix Modules/Setup *shared* support. -- Issue #19728: Enable pip installation by default on Windows. +- Issue #21811: Anticipated fixes to support OS X versions > 10.9. -- Issue #16136: Remove VMS support +- Issue #21166: Prevent possible segfaults and other random failures of + python --generate-posix-vars in pybuilddir.txt build target. -- Issue #18215: Add script Tools/ssl/test_multiple_versions.py to compile and - run Python's unit tests with multiple versions of OpenSSL. +- Issue #18096: Fix library order returned by python-config. -- Issue #19922: define _INCLUDE__STDC_A1_SOURCE in HP-UX to include mbstate_t - for mbrtowc(). +- Issue #17219: Add library build dir for Python extension cross-builds. -- Issue #19788: kill_python(_d).exe is now run as a PreBuildEvent on the - pythoncore sub-project. This should prevent build errors due a previous - build's python(_d).exe still running. +- Issue #22919: Windows build updated to support VC 14.0 (Visual Studio 2015), + which will be used for the official release. -Documentation -------------- +- Issue #21236: Build _msi.pyd with cabinet.lib instead of fci.lib -- Issue #20265: Updated some parts of the Using Windows document. +- Issue #17128: Use private version of OpenSSL for OS X 10.5+ installer. -- Issue #20266: Updated some parts of the Windows FAQ. +C API +----- -- Issue #20255: Updated the about and bugs pages. +- Issue #14203: Remove obsolete support for view==NULL in PyBuffer_FillInfo(), + bytearray_getbuffer(), bytesiobuf_getbuffer() and array_buffer_getbuf(). + All functions now raise BufferError in that case. -- Issue #20253: Fixed a typo in the ipaddress docs that advertised an - illegal attribute name. Found by INADA Naoki. +- Issue #22445: PyBuffer_IsContiguous() now implements precise contiguity + tests, compatible with NumPy's NPY_RELAXED_STRIDES_CHECKING compilation + flag. Previously the function reported false negatives for corner cases. -- Issue #18840: Introduce the json module in the tutorial, and de-emphasize - the pickle module. +- Issue #22079: PyType_Ready() now checks that statically allocated type has + no dynamically allocated bases. -- Issue #19845: Updated the Compiling Python on Windows section. +- Issue #22453: Removed non-documented macro PyObject_REPR(). -- Issue #19795: Improved markup of True/False constants. +- Issue #18395: Rename ``_Py_char2wchar()`` to :c:func:`Py_DecodeLocale`, + rename ``_Py_wchar2char()`` to :c:func:`Py_EncodeLocale`, and document + these functions. -Tools/Demos ------------ +- Issue #21233: Add new C functions: PyMem_RawCalloc(), PyMem_Calloc(), + PyObject_Calloc(), _PyObject_GC_Calloc(). bytes(int) is now using + ``calloc()`` instead of ``malloc()`` for large objects which is faster and + use less memory. -- Issue #19659: Added documentation for Argument Clinic. +- Issue #20942: PyImport_ImportFrozenModuleObject() no longer sets __file__ to + match what importlib does; this affects _frozen_importlib as well as any + module loaded using imp.init_frozen(). -- Issue #19976: Argument Clinic METH_NOARGS functions now always - take two parameters. +Documentation +------------- +- Issue #19548: Update the codecs module documentation to better cover the + distinction between text encodings and other codecs, together with other + clarifications. Patch by Martin Panter. -What's New in Python 3.4.0 Beta 1? -================================== +- Issue #22394: Doc/Makefile now supports ``make venv PYTHON=../python`` to + create a venv for generating the documentation, e.g., + ``make html PYTHON=venv/bin/python3``. -Release date: 2013-11-24 +- Issue #21514: The documentation of the json module now refers to new JSON RFC + 7159 instead of obsoleted RFC 4627. -Core and Builtins ------------------ +- Issue #21777: The binary sequence methods on bytes and bytearray are now + documented explicitly, rather than assuming users will be able to derive + the expected behaviour from the behaviour of the corresponding str methods. -- Use the repr of a module name in more places in import, especially - exceptions. +- Issue #6916: undocument deprecated asynchat.fifo class. -- Issue #19619: str.encode, bytes.decode and bytearray.decode now use an - internal API to throw LookupError for known non-text encodings, rather - than attempting the encoding or decoding operation and then throwing a - TypeError for an unexpected output type. (The latter mechanism remains - in place for third party non-text encodings) +- Issue #17386: Expanded functionality of the ``Doc/make.bat`` script to make + it much more comparable to ``Doc/Makefile``. -- Issue #19183: Implement PEP 456 'secure and interchangeable hash algorithm'. - Python now uses SipHash24 on all major platforms. +- Issue #21312: Update the thread_foobar.h template file to include newer + threading APIs. Patch by Jack McCracken. -- Issue #12892: The utf-16* and utf-32* encoders no longer allow surrogate code - points (U+D800-U+DFFF) to be encoded. The utf-32* decoders no longer decode - byte sequences that correspond to surrogate code points. The surrogatepass - error handler now works with the utf-16* and utf-32* codecs. Based on - patches by Victor Stinner and Kang-Hao (Kenny) Lu. +- Issue #21043: Remove the recommendation for specific CA organizations and to + mention the ability to load the OS certificates. -- Issue #17806: Added keyword-argument support for "tabsize" to - str/bytes.expandtabs(). +- Issue #20765: Add missing documentation for PurePath.with_name() and + PurePath.with_suffix(). -- Issue #17828: Output type errors in str.encode(), bytes.decode() and - bytearray.decode() now direct users to codecs.encode() or codecs.decode() - as appropriate. +- Issue #19407: New package installation and distribution guides based on + the Python Packaging Authority tools. Existing guides have been retained + as legacy links from the distutils docs, as they still contain some + required reference material for tool developers that isn't recorded + anywhere else. -- Issue #17828: The interpreter now attempts to chain errors that occur in - codec processing with a replacement exception of the same type that - includes the codec name in the error message. It ensures it only does this - when the creation of the replacement exception won't lose any information. +- Issue #19697: Document cases where __main__.__spec__ is None. -- Issue #19466: Clear the frames of daemon threads earlier during the - Python shutdown to call objects destructors. So "unclosed file" resource - warnings are now corretly emitted for daemon threads. +Tests +----- -- Issue #19514: Deduplicate some _Py_IDENTIFIER declarations. - Patch by Andrei Dorian Duma. +- Issue #18982: Add tests for CLI of the calendar module. -- Issue #17936: Fix O(n**2) behaviour when adding or removing many subclasses - of a given type. +- Issue #19548: Added some additional checks to test_codecs to ensure that + statements in the updated documentation remain accurate. Patch by Martin + Panter. -- Issue #19428: zipimport now handles errors when reading truncated or invalid - ZIP archive. +- Issue #22838: All test_re tests now work with unittest test discovery. -- Issue #18408: Add a new PyFrame_FastToLocalsWithError() function to handle - exceptions when merging fast locals into f_locals of a frame. - PyEval_GetLocals() now raises an exception and return NULL on failure. +- Issue #22173: Update lib2to3 tests to use unittest test discovery. -- Issue #19369: Optimized the usage of __length_hint__(). +- Issue #16000: Convert test_curses to use unittest. -- Issue #18603: Ensure that PyOS_mystricmp and PyOS_mystrnicmp are in the - Python executable and not removed by the linker's optimizer. +- Issue #21456: Skip two tests in test_urllib2net.py if _ssl module not + present. Patch by Remi Pointel. -- Issue #19306: Add extra hints to the faulthandler module's stack - dumps that these are "upside down". +- Issue #20746: Fix test_pdb to run in refleak mode (-R). Patch by Xavier + de Gaye. -Library -------- +- Issue #22060: test_ctypes has been somewhat cleaned up and simplified; it + now uses unittest test discovery to find its tests. -- Issue #3158: doctest can now find doctests in functions and methods - written in C. +- Issue #22104: regrtest.py no longer holds a reference to the suite of tests + loaded from test modules that don't define test_main(). -- Issue #13477: Added command line interface to the tarfile module. - Original patch by Berker Peksag. +- Issue #22111: Assorted cleanups in test_imaplib. Patch by Milan Oberkirch. -- Issue #19674: inspect.signature() now produces a correct signature - for some builtins. +- Issue #22002: Added ``load_package_tests`` function to test.support and used + it to implement/augment test discovery in test_asyncio, test_email, + test_importlib, test_json, and test_tools. -- Issue #19722: Added opcode.stack_effect(), which - computes the stack effect of bytecode instructions. +- Issue #21976: Fix test_ssl to accept LibreSSL version strings. Thanks + to William Orr. -- Issue #19735: Implement private function ssl._create_stdlib_context() to - create SSLContext objects in Python's stdlib module. It provides a single - configuration point and makes use of SSLContext.load_default_certs(). +- Issue #21918: Converted test_tools from a module to a package containing + separate test files for each tested script. -- Issue #16203: Add re.fullmatch() function and regex.fullmatch() method, - which anchor the pattern at both ends of the string to match. - Original patch by Matthew Barnett. +- Issue #9554: Use modern unittest features in test_argparse. Initial patch by + Denver Coneybeare and Radu Voicilas. -- Issue #13592: Improved the repr for regular expression pattern objects. - Based on patch by Hugo Lopes Tavares. +- Issue #20155: Changed HTTP method names in failing tests in test_httpservers + so that packet filtering software (specifically Windows Base Filtering Engine) + does not interfere with the transaction semantics expected by the tests. -- Issue #19641: Added the audioop.byteswap() function to convert big-endian - samples to little-endian and vice versa. +- Issue #19493: Refactored the ctypes test package to skip tests explicitly + rather than silently. -- Issue #15204: Deprecated the 'U' mode in file-like objects. +- Issue #18492: All resources are now allowed when tests are not run by + regrtest.py. -- Issue #17810: Implement PEP 3154, pickle protocol 4. +- Issue #21634: Fix pystone micro-benchmark: use floor division instead of true + division to benchmark integers instead of floating point numbers. Set pystone + version to 1.2. Patch written by Lennart Regebro. -- Issue #19668: Added support for the cp1125 encoding. +- Issue #21605: Added tests for Tkinter images. -- Issue #19689: Add ssl.create_default_context() factory function. It creates - a new SSLContext object with secure default settings. +- Issue #21493: Added test for ntpath.expanduser(). Original patch by + Claudiu Popa. -- Issue #19727: os.utime(..., None) is now potentially more precise - under Windows. +- Issue #19925: Added tests for the spwd module. Original patch by Vajrasky Kok. -- Issue #17201: ZIP64 extensions now are enabled by default. Patch by - William Mallard. +- Issue #21522: Added Tkinter tests for Listbox.itemconfigure(), + PanedWindow.paneconfigure(), and Menu.entryconfigure(). -- Issue #19292: Add SSLContext.load_default_certs() to load default root CA - certificates from default stores or system stores. By default the method - loads CA certs for authentication of server certs. +- Issue #17756: Fix test_code test when run from the installed location. -- Issue #19673: Add pathlib to the stdlib as a provisional module (PEP 428). +- Issue #17752: Fix distutils tests when run from the installed location. -- Issue #16596: pdb in a generator now properly skips over yield and - yield from rather than stepping out of the generator into its - caller. (This is essential for stepping through asyncio coroutines.) +- Issue #18604: Consolidated checks for GUI availability. All platforms now + at least check whether Tk can be instantiated when the GUI resource is + requested. -- Issue #17916: Added dis.Bytecode.from_traceback() and - dis.Bytecode.current_offset to easily display "current instruction" - markers in the new disassembly API (Patch by Claudiu Popa). +- Issue #21275: Fix a socket test on KFreeBSD. -- Issue #19552: venv now supports bootstrapping pip into virtual environments +- Issue #21223: Pass test_site/test_startup_imports when some of the extensions + are built as builtins. -- Issue #17134: Finalize interface to Windows' certificate store. Cert and - CRL enumeration are now two functions. enum_certificates() also returns - purpose flags as set of OIDs. +- Issue #20635: Added tests for Tk geometry managers. -- Issue #19555: Restore sysconfig.get_config_var('SO'), (and the distutils - equivalent) with a DeprecationWarning pointing people at $EXT_SUFFIX. +- Add test case for freeze. -- Issue #8813: Add SSLContext.verify_flags to change the verification flags - of the context in order to enable certification revocation list (CRL) - checks or strict X509 rules. +- Issue #20743: Fix a reference leak in test_tcl. -- Issue #18294: Fix the zlib module to make it 64-bit safe. +- Issue #21097: Move test_namespace_pkgs into test_importlib. -- Issue #19682: Fix compatibility issue with old version of OpenSSL that - was introduced by Issue #18379. +- Issue #21503: Use test_both() consistently in test_importlib. -- Issue #14455: plistlib now supports binary plists and has an updated API. +- Issue #20939: Avoid various network test failures due to new + redirect of http://www.python.org/ to https://www.python.org: + use http://www.example.com instead. -- Issue #19633: Fixed writing not compressed 16- and 32-bit wave files on - big-endian platforms. +- Issue #20668: asyncio tests no longer rely on tests.txt file. + (Patch by Vajrasky Kok) -- Issue #18379: SSLSocket.getpeercert() returns CA issuer AIA fields, OCSP - and CRL distribution points. +- Issue #21093: Prevent failures of ctypes test_macholib on OS X if a + copy of libz exists in $HOME/lib or /usr/local/lib. -- Issue #18138: Implement cadata argument of SSLContext.load_verify_location() - to load CA certificates and CRL from memory. It supports PEM and DER - encoded strings. +- Issue #22770: Prevent some Tk segfaults on OS X when running gui tests. -- Issue #18775: Add name and block_size attribute to HMAC object. They now - provide the same API elements as non-keyed cryptographic hash functions. +- Issue #23211: Workaround test_logging failure on some OS X 10.6 systems. -- Issue #17276: MD5 as default digestmod for HMAC is deprecated. The HMAC - module supports digestmod names, e.g. hmac.HMAC('sha1'). +- Issue #23345: Prevent test_ssl failures with large OpenSSL patch level + values (like 0.9.8zc). -- Issue #19449: in csv's writerow, handle non-string keys when generating the - error message that certain keys are not in the 'fieldnames' list. +Tools/Demos +----------- -- Issue #13633: Added a new convert_charrefs keyword arg to HTMLParser that, - when True, automatically converts all character references. +- Issue #22314: pydoc now works when the LINES environment variable is set. -- Issue #2927: Added the unescape() function to the html module. +- Issue #22615: Argument Clinic now supports the "type" argument for the + int converter. This permits using the int converter with enums and + typedefs. -- Issue #8402: Added the escape() function to the glob module. +- Issue #20076: The makelocalealias.py script no longer ignores UTF-8 mapping. -- Issue #17618: Add Base85 and Ascii85 encoding/decoding to the base64 module. +- Issue #20079: The makelocalealias.py script now can parse the SUPPORTED file + from glibc sources and supports command line options for source paths. -- Issue #19634: time.strftime("%y") now raises a ValueError on AIX when given a - year before 1900. +- Issue #22201: Command-line interface of the zipfile module now correctly + extracts ZIP files with directory entries. Patch by Ryan Wilson. -- Fix test.support.bind_port() to not cause an error when Python was compiled - on a system with SO_REUSEPORT defined in the headers but run on a system - with an OS kernel that does not support that reasonably new socket option. +- Issue #22120: For functions using an unsigned integer return converter, + Argument Clinic now generates a cast to that type for the comparison + to -1 in the generated code. (This supresses a compilation warning.) -- Fix compilation error under gcc of the ctypes module bundled libffi for arm. +- Issue #18974: Tools/scripts/diff.py now uses argparse instead of optparse. -- Issue #19448: Add private API to SSL module to lookup ASN.1 objects by OID, - NID, short name and long name. +- Issue #21906: Make Tools/scripts/md5sum.py work in Python 3. + Patch by Zachary Ware. -- Issue #19282: dbm.open now supports the context management protocol. (Inital - patch by Claudiu Popa) +- Issue #21629: Fix Argument Clinic's "--converters" feature. -- Issue #8311: Added support for writing any bytes-like objects in the aifc, - sunau, and wave modules. +- Add support for ``yield from`` to 2to3. -- Issue #5202: Added support for unseekable files in the wave module. +- Add support for the PEP 465 matrix multiplication operator to 2to3. -- Issue #19544 and Issue #1180: Restore global option to ignore - ~/.pydistutils.cfg in Distutils, accidentally removed in backout of - distutils2 changes. +- Issue #16047: Fix module exception list and __file__ handling in freeze. + Patch by Meador Inge. -- Issue #19523: Closed FileHandler leak which occurred when delay was set. +- Issue #11824: Consider ABI tags in freeze. Patch by Meador Inge. -- Issue #19544 and Issue #6516: Restore support for --user and --group - parameters to sdist command accidentally rolled back as part of the - distutils2 rollback. +- Issue #20535: PYTHONWARNING no longer affects the run_tests.py script. + Patch by Arfrever Frehtes Taifersar Arahesis. -- Issue #13674: Prevented time.strftime from crashing on Windows when given - a year before 1900 and a format of %y. +Windows +------- -- Issue #19406: implementation of the ensurepip module (part of PEP 453). - Patch by Donald Stufft and Nick Coghlan. +- Issue #23260: Update Windows installer -- Issue #19544 and Issue #6286: Restore use of urllib over http allowing use - of http_proxy for Distutils upload command, a feature accidentally lost - in the rollback of distutils2. +- The bundled version of Tcl/Tk has been updated to 8.6.3. The most visible + result of this change is the addition of new native file dialogs when + running on Windows Vista or newer. See Tcl/Tk's TIP 432 for more + information. Also, this version of Tcl/Tk includes support for Windows 10. -- Issue #19544 and Issue #7457: Restore the read_pkg_file method to - distutils.dist.DistributionMetadata accidentally removed in the undo of - distutils2. +- Issue #17896: The Windows build scripts now expect external library sources + to be in ``PCbuild\..\externals`` rather than ``PCbuild\..\..``. -- Issue #16685: Added support for any bytes-like objects in the audioop module. - Removed support for strings. +- Issue #17717: The Windows build scripts now use a copy of NASM pulled from + svn.python.org to build OpenSSL. -- Issue #7171: Add Windows implementation of ``inet_ntop`` and ``inet_pton`` - to socket module. Patch by Atsuo Ishimoto. +- Issue #21907: Improved the batch scripts provided for building Python. -- Issue #19261: Added support for writing 24-bit samples in the sunau module. +- Issue #22644: The bundled version of OpenSSL has been updated to 1.0.1j. -- Issue #1097797: Added CP273 encoding, used on IBM mainframes in - Germany and Austria. Mapping provided by Michael Bierenfeld. +- Issue #10747: Use versioned labels in the Windows start menu. + Patch by Olive Kilburn. -- Issue #1575020: Fixed support of 24-bit wave files on big-endian platforms. +- Issue #22980: .pyd files with a version and platform tag (for example, + ".cp35-win32.pyd") will now be loaded in preference to those without tags. -- Issue #19378: Fixed a number of cases in the dis module where the new - "file" parameter was not being honoured correctly + -- Issue #19378: Removed the "dis.Bytecode.show_info" method +What's New in Python 3.4.0? +=========================== -- Issue #19378: Renamed the "dis.Bytecode.display_code" method to - "dis.Bytecode.dis" and converted it to returning a string rather than - printing output. +Release date: 2014-03-16 -- Issue #19378: the "line_offset" parameter in the new "dis.get_instructions" - API has been renamed to "first_line" (and the default value and usage - changed accordingly). This should reduce confusion with the more common use - of "offset" in the dis docs to refer to bytecode offsets. +Library +------- -- Issue #18678: Corrected spwd struct member names in spwd module: - sp_nam->sp_namp, and sp_pwd->sp_pwdp. The old names are kept as extra - structseq members, for backward compatibility. +- Issue #20939: Fix test_geturl failure in test_urllibnet due to + new redirect of http://www.python.org/ to https://www.python.org. -- Issue #6157: Fixed tkinter.Text.debug(). tkinter.Text.bbox() now raises - TypeError instead of TclError on wrong number of arguments. Original patch - by Guilherme Polo. - -- Issue #10197: Rework subprocess.get[status]output to use subprocess - functionality and thus to work on Windows. Patch by Nick Coghlan - -- Issue #6160: The bbox() method of tkinter.Spinbox now returns a tuple of - integers instead of a string. Based on patch by Guilherme Polo. - -- Issue #19403: contextlib.redirect_stdout is now reentrant - -- Issue #19286: Directories in ``package_data`` are no longer added to - the filelist, preventing failure outlined in the ticket. - -- Issue #19480: HTMLParser now accepts all valid start-tag names as defined - by the HTML5 standard. - -- Issue #15114: The html.parser module now raises a DeprecationWarning when the - strict argument of HTMLParser or the HTMLParser.error method are used. - -- Issue #19410: Undo the special-casing removal of '' for - importlib.machinery.FileFinder. - -- Issue #19424: Fix the warnings module to accept filename containing surrogate - characters. - -- Issue #19435: Fix directory traversal attack on CGIHttpRequestHandler. - -- Issue #19227: Remove pthread_atfork() handler. The handler was added to - solve #18747 but has caused issues. - -- Issue #19420: Fix reference leak in module initalization code of - _hashopenssl.c - -- Issue #19329: Optimized compiling charsets in regular expressions. - -- Issue #19227: Try to fix deadlocks caused by re-seeding then OpenSSL - pseudo-random number generator on fork(). - -- Issue #16037: HTTPMessage.readheaders() raises an HTTPException when more than - 100 headers are read. Adapted from patch by Jyrki Pulliainen. - -- Issue #16040: CVE-2013-1752: nntplib: Limit maximum line lengths to 2048 to - prevent readline() calls from consuming too much memory. Patch by Jyrki - Pulliainen. - -- Issue #16041: CVE-2013-1752: poplib: Limit maximum line lengths to 2048 to - prevent readline() calls from consuming too much memory. Patch by Jyrki - Pulliainen. - -- Issue #17997: Change behavior of ``ssl.match_hostname()`` to follow RFC 6125, - for security reasons. It now doesn't match multiple wildcards nor wildcards - inside IDN fragments. - -- Issue #16039: CVE-2013-1752: Change use of readline in imaplib module to limit - line length. Patch by Emil Lind. - -- Issue #19330: the unnecessary wrapper functions have been removed from the - implementations of the new contextlib.redirect_stdout and - contextlib.suppress context managers, which also ensures they provide - reasonable help() output on instances - -- Issue #19393: Fix symtable.symtable function to not be confused when there are - functions or classes named "top". - -- Issue #18685: Restore re performance to pre-PEP 393 levels. - -- Issue #19339: telnetlib module is now using time.monotonic() when available - to compute timeout. - -- Issue #19399: fix sporadic test_subprocess failure. - -- Issue #13234: Fix os.listdir to work with extended paths on Windows. - Patch by Santoso Wijaya. - -- Issue #19375: The site module adding a "site-python" directory to sys.path, - if it exists, is now deprecated. - -- Issue #19379: Lazily import linecache in the warnings module, to make - startup with warnings faster until a warning gets printed. - -- Issue #19288: Fixed the "in" operator of dbm.gnu databases for string - argument. Original patch by Arfrever Frehtes Taifersar Arahesis. - -- Issue #19287: Fixed the "in" operator of dbm.ndbm databases for string - argument. Original patch by Arfrever Frehtes Taifersar Arahesis. - -- Issue #19327: Fixed the working of regular expressions with too big charset. - -- Issue #17400: New 'is_global' attribute for ipaddress to tell if an address - is allocated by IANA for global or private networks. - -- Issue #19350: Increasing the test coverage of macurl2path. Patch by Colin - Williams. - -- Issue #19365: Optimized the parsing of long replacement string in re.sub*() - functions. - -- Issue #19352: Fix unittest discovery when a module can be reached - through several paths (e.g. under Debian/Ubuntu with virtualenv). - -- Issue #15207: Fix mimetypes to read from correct part of Windows registry - Original patch by Dave Chambers - -- Issue #16595: Add prlimit() to resource module. - -- Issue #19324: Expose Linux-specific constants in resource module. - -- Load SSL's error strings in hashlib. - -- Issue #18527: Upgrade internal copy of zlib to 1.2.8. - -- Issue #19274: Add a filterfunc parameter to PyZipFile.writepy. - -- Issue #8964: fix platform._sys_version to handle IronPython 2.6+. - Patch by Martin Matusiak. - -- Issue #19413: Restore pre-3.3 reload() semantics of re-finding modules. - -- Issue #18958: Improve error message for json.load(s) while passing a string - that starts with a UTF-8 BOM. - -- Issue #19307: Improve error message for json.load(s) while passing objects - of the wrong type. - -- Issue #16038: CVE-2013-1752: ftplib: Limit amount of data read by - limiting the call to readline(). Original patch by Michał - Jastrzębski and Giampaolo Rodola. - -- Issue #17087: Improved the repr for regular expression match objects. - -Tests ------ - -- Issue #19664: test_userdict's repr test no longer depends on the order - of dict elements. - -- Issue #19440: Clean up test_capi by removing an unnecessary __future__ - import, converting from test_main to unittest.main, and running the - _testcapi module tests as subTests of a unittest TestCase method. - -- Issue #19378: the main dis module tests are now run with both stdout - redirection *and* passing an explicit file parameter - -- Issue #19378: removed the not-actually-helpful assertInstructionMatches - and assertBytecodeExactlyMatches helpers from bytecode_helper - -- Issue #18702: All skipped tests now reported as skipped. - -- Issue #19439: interpreter embedding tests are now executed on Windows - (Patch by Zachary Ware) - -- Issue #19085: Added basic tests for all tkinter widget options. - -- Issue #19384: Fix test_py_compile for root user, patch by Claudiu Popa. - -Documentation -------------- - -- Issue #18326: Clarify that list.sort's arguments are keyword-only. Also, - attempt to reduce confusion in the glossary by not saying there are - different "types" of arguments and parameters. - -Build ------ - -- Issue #19358: "make clinic" now runs the Argument Clinic preprocessor - over all CPython source files. - -- Update SQLite to 3.8.1, xz to 5.0.5, and Tcl/Tk to 8.6.1 on Windows. - -- Issue #16632: Enable DEP and ASLR on Windows. - -- Issue #17791: Drop PREFIX and EXEC_PREFIX definitions from PC/pyconfig.h - -- Add workaround for VS 2010 nmake clean issue. VS 2010 doesn't set up PATH - for nmake.exe correctly. - -- Issue #19550: Implement Windows installer changes of PEP 453 (ensurepip). - -- Issue #19520: Fix compiler warning in the _sha3 module on 32bit Windows. - -- Issue #19356: Avoid using a C variabled named "_self", it's a reserved - word in some C compilers. - -- Issue #15792: Correct build options on Win64. Patch by Jeremy Kloth. - -- Issue #19373: Apply upstream change to Tk 8.5.15 fixing OS X 10.9 - screen refresh problem for OS X installer build. - -- Issue #19649: On OS X, the same set of file names are now installed - in bin directories for all configurations: non-framework vs framework, - and single arch vs universal builds. pythonx.y-32 is now always - installed for 64-bit/32-bit universal builds. The obsolete and - undocumented pythonw* symlinks are no longer installed anywhere. - -- Issue #19553: PEP 453 - "make install" and "make altinstall" now install or - upgrade pip by default, using the bundled pip provided by the new ensurepip - module. A new configure option, --with-ensurepip[=upgrade|install|no], is - available to override the default ensurepip "--upgrade" option. The option - can also be set with "make [alt]install ENSUREPIP=[upgrade|install\no]". - -- Issue #19551: PEP 453 - the OS X installer now installs pip by default. - -- Update third-party libraries for OS X installers: xz 5.0.3 -> 5.0.5, - SQLite 3.7.13 -> 3.8.1 - -- Issue #15663: Revert OS X installer built-in Tcl/Tk support for 3.4.0b1. - Some third-party projects, such as Matplotlib and PIL/Pillow, - depended on being able to build with Tcl and Tk frameworks in - /Library/Frameworks. - -Tools/Demos ------------ - -- Issue #19730: Argument Clinic now supports all the existing PyArg - "format units" as legacy converters, as well as two new features: - "self converters" and the "version" directive. - -- Issue #19552: pyvenv now bootstraps pip into virtual environments by - default (pass --without-pip to request the old behaviour) - -- Issue #19390: Argument Clinic no longer accepts malformed Python - and C ids. - - -What's New in Python 3.4.0 Alpha 4? -=================================== - -Release date: 2013-10-20 - -Core and Builtins ------------------ - -- Issue #19301: Give classes and functions that are explicitly marked global a - global qualname. - -- Issue #19279: UTF-7 decoder no longer produces illegal strings. - -- Issue #16612: Add "Argument Clinic", a compile-time preprocessor for - C files to generate argument parsing code. (See PEP 436.) - -- Issue #18810: Shift stat calls in importlib.machinery.FileFinder such that - the code is optimistic that if something exists in a directory named exactly - like the possible package being searched for that it's in actuality a - directory. - -- Issue #18416: importlib.machinery.PathFinder now treats '' as the cwd and - importlib.machinery.FileFinder no longer special-cases '' to '.'. This leads - to modules imported from cwd to now possess an absolute file path for - __file__ (this does not affect modules specified by path on the CLI but it - does affect -m/runpy). It also allows FileFinder to be more consistent by not - having an edge case. - -- Issue #4555: All exported C symbols are now prefixed with either - "Py" or "_Py". - -- Issue #19219: Speed up marshal.loads(), and make pyc files slightly - (5% to 10%) smaller. - -- Issue #19221: Upgrade Unicode database to version 6.3.0. - -- Issue #16742: The result of the C callback PyOS_ReadlineFunctionPointer must - now be a string allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL - if an error occurred), instead of a string allocated by PyMem_Malloc() or - PyMem_Realloc(). - -- Issue #19199: Remove ``PyThreadState.tick_counter`` field - -- Fix macro expansion of _PyErr_OCCURRED(), and make sure to use it in at - least one place so as to avoid regressions. - -- Issue #19087: Improve bytearray allocation in order to allow cheap popping - of data at the front (slice deletion). - -- Issue #19014: memoryview.cast() is now allowed on zero-length views. - -- Issue #18690: memoryview is now automatically registered with - collections.abc.Sequence - -- Issue #19078: memoryview now correctly supports the reversed builtin - (Patch by Claudiu Popa) - -Library -------- - -- Issue #17457: unittest test discovery now works with namespace packages. - Patch by Claudiu Popa. - -- Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX. - Patch by David Edelsohn. - -- Issue #18606: Add the new "statistics" module (PEP 450). Contributed - by Steven D'Aprano. - -- Issue #12866: The audioop module now supports 24-bit samples. - -- Issue #19254: Provide an optimized Python implementation of pbkdf2_hmac. - -- Issues #19201, Issue #19222, Issue #19223: Add "x" mode (exclusive creation) - in opening file to bz2, gzip and lzma modules. Patches by Tim Heaney and - Vajrasky Kok. - -- Fix a reference count leak in _sre. - -- Issue #19262: Initial check in of the 'asyncio' package (a.k.a. Tulip, - a.k.a. PEP 3156). There are no docs yet, and the PEP is slightly - out of date with the code. This module will have *provisional* status - in Python 3.4. - -- Issue #19276: Fixed the wave module on 64-bit big-endian platforms. - -- Issue #19266: Rename the new-in-3.4 ``contextlib.ignore`` context manager - to ``contextlib.suppress`` in order to be more consistent with existing - descriptions of that operation elsewhere in the language and standard - library documentation (Patch by Zero Piraeus). - -- Issue #18891: Completed the new email package (provisional) API additions - by adding new classes EmailMessage, MIMEPart, and ContentManager. - -- Issue #18281: Unused stat constants removed from `tarfile`. - -- Issue #18999: Multiprocessing now supports 'contexts' with the same API - as the module, but bound to specified start methods. - -- Issue #18468: The re.split, re.findall, and re.sub functions and the group() - and groups() methods of match object now always return a string or a bytes - object. - -- Issue #18725: The textwrap module now supports truncating multiline text. - -- Issue #18776: atexit callbacks now display their full traceback when they - raise an exception. - -- Issue #17827: Add the missing documentation for ``codecs.encode`` and - ``codecs.decode``. - -- Issue #19218: Rename collections.abc to _collections_abc in order to - speed up interpreter start. - -- Issue #18582: Add 'pbkdf2_hmac' to the hashlib module. It implements PKCS#5 - password-based key derivation functions with HMAC as pseudorandom function. - -- Issue #19131: The aifc module now correctly reads and writes sampwidth of - compressed streams. - -- Issue #19209: Remove import of copyreg from the os module to speed up - interpreter startup. stat_result and statvfs_result are now hard-coded to - reside in the os module. - -- Issue #19205: Don't import the 're' module in site and sysconfig module to - speed up interpreter start. - -- Issue #9548: Add a minimal "_bootlocale" module that is imported by the - _io module instead of the full locale module. - -- Issue #18764: remove the 'print' alias for the PDB 'p' command so that it no - longer shadows the print function. - -- Issue #19158: a rare race in BoundedSemaphore could allow .release() too - often. - -- Issue #15805: Add contextlib.redirect_stdout(). - -- Issue #18716: Deprecate the formatter module. - -- Issue #10712: 2to3 has a new "asserts" fixer that replaces deprecated names - of unittest methods (e.g. failUnlessEqual -> assertEqual). - -- Issue #18037: 2to3 now escapes '\u' and '\U' in native strings. - -- Issue #17839: base64.decodebytes and base64.encodebytes now accept any - object that exports a 1 dimensional array of bytes (this means the same - is now also true for base64_codec) - -- Issue #19132: The pprint module now supports compact mode. - -- Issue #19137: The pprint module now correctly formats instances of set and - frozenset subclasses. - -- Issue #10042: functools.total_ordering now correctly handles - NotImplemented being returned by the underlying comparison function (Patch - by Katie Miller) - -- Issue #19092: contextlib.ExitStack now correctly reraises exceptions - from the __exit__ callbacks of inner context managers (Patch by Hrvoje - Nikšić) - -- Issue #12641: Avoid passing "-mno-cygwin" to the mingw32 compiler, except - when necessary. Patch by Oscar Benjamin. - -- Issue #5845: In site.py, only load readline history from ~/.python_history - if no history has been read already. This avoids double writes to the - history file at shutdown. - -- Properly initialize all fields of a SSL object after allocation. - -- Issue #19095: SSLSocket.getpeercert() now raises ValueError when the - SSL handshake hasn't been done. - -- Issue #4366: Fix building extensions on all platforms when --enable-shared - is used. - -- Issue #19030: Fixed `inspect.getmembers` and `inspect.classify_class_attrs` - to attempt activating descriptors before falling back to a __dict__ search - for faulty descriptors. `inspect.classify_class_attrs` no longer returns - Attributes whose home class is None. - -C API ------ - -- Issue #1772673: The type of `char*` arguments now changed to `const char*`. - -- Issue #16129: Added a `Py_SetStandardStreamEncoding` pre-initialization API - to allow embedding applications like Blender to force a particular - encoding and error handler for the standard IO streams (initial patch by - Bastien Montagne) - -Tests ------ - -- Issue #19275: Fix test_site on AMD64 Snow Leopard - -- Issue #14407: Fix unittest test discovery in test_concurrent_futures. - -- Issue #18919: Unified and extended tests for audio modules: aifc, sunau and - wave. - -- Issue #18714: Added tests for ``pdb.find_function()``. - -Documentation -------------- - -- Issue #18758: Fixed and improved cross-references. - -- Issue #18972: Modernize email examples and use the argparse module in them. - -Build ------ - -- Issue #19130: Correct PCbuild/readme.txt, Python 3.3 and 3.4 require VS 2010. - -- Issue #15663: Update OS X 10.6+ installer to use Tcl/Tk 8.5.15. - -- Issue #14499: Fix several problems with OS X universal build support: - 1. ppc arch detection for extension module builds broke with Xcode 5 - 2. ppc arch detection in configure did not work on OS X 10.4 - 3. -sysroot and -arch flags were unnecessarily duplicated - 4. there was no obvious way to configure an intel-32 only build. - -- Issue #19019: Change the OS X installer build script to use CFLAGS instead - of OPT for special build options. By setting OPT, some compiler-specific - options like -fwrapv were overridden and thus not used, which could result - in broken interpreters when building with clang. - - -What's New in Python 3.4.0 Alpha 3? -=================================== - -Release date: 2013-09-29 - -Core and Builtins ------------------ - -- Issue #18818: The "encodingname" part of PYTHONIOENCODING is now optional. - -- Issue #19098: Prevent overflow in the compiler when the recursion limit is set - absurdly high. - -Library -------- - -- Issue #18929: `inspect.classify_class_attrs()` now correctly finds class - attributes returned by `dir()` that are located in the metaclass. - -- Issue #18950: Fix miscellaneous bugs in the sunau module. - Au_read.readframes() now updates current file position and reads correct - number of frames from multichannel stream. Au_write.writeframesraw() now - correctly updates current file position. Au_read.getnframes() now returns an - integer (as in Python 2). Au_read and Au_write now correctly works with file - object if start file position is not a zero. - -- Issue #18594: The fast path for collections.Counter() was never taken - due to an over-restrictive type check. - -- Issue #19053: ZipExtFile.read1() with non-zero argument no more returns empty - bytes until end of data. - -- logging: added support for Unix domain sockets to SocketHandler and - DatagramHandler. - -- Issue #18996: TestCase.assertEqual() now more cleverly shorten differing - strings in error report. - -- Issue #19034: repr() for tkinter.Tcl_Obj now exposes string reperesentation. - -- Issue #18978: ``urllib.request.Request`` now allows the method to be - indicated on the class and no longer sets it to None in ``__init__``. - -- Issue #18626: the inspect module now offers a basic command line - introspection interface (Initial patch by Claudiu Popa) - -- Issue #3015: Fixed tkinter with wantobject=False. Any Tcl command call - returned empty string. - -- Issue #19037: The mailbox module now makes all changes to maildir files - before moving them into place, to avoid race conditions with other programs - that may be accessing the maildir directory. - -- Issue #14984: On POSIX systems, when netrc is called without a filename - argument (and therefore is reading the user's $HOME/.netrc file), it now - enforces the same security rules as typical ftp clients: the .netrc file must - be owned by the user that owns the process and must not be readable by any - other user. - -- Issue #18873: The tokenize module now detects Python source code encoding - only in comment lines. - -- Issue #17764: Enable http.server to bind to a user specified network - interface. Patch contributed by Malte Swart. - -- Issue #18937: Add an assertLogs() context manager to unittest.TestCase - to ensure that a block of code emits a message using the logging module. - -- Issue #17324: Fix http.server's request handling case on trailing '/'. Patch - contributed by Vajrasky Kok. - -- Issue #19018: The heapq.merge() function no longer suppresses IndexError - in the underlying iterables. - -- Issue #18784: The uuid module no longer attempts to load libc via ctypes.CDLL - if all the necessary functions have already been found in libuuid. Patch by - Evgeny Sologubov. - -- The :envvar:`PYTHONFAULTHANDLER` environment variable now only enables the - faulthandler module if the variable is non-empty. Same behaviour than other - variables like :envvar:`PYTHONDONTWRITEBYTECODE`. - -- Issue #1565525: New function ``traceback.clear_frames`` will clear - the local variables of all the stack frames referenced by a traceback - object. - -Tests ------ - -- Issue #18952: Fix regression in support data downloads introduced when - test.support was converted to a package. Regression noticed by Zachary - Ware. - -IDLE ----- - -- Issue #18873: IDLE now detects Python source code encoding only in comment - lines. - -- Issue #18988: The "Tab" key now works when a word is already autocompleted. - -Documentation -------------- - -- Issue #17003: Unified the size argument names in the io module with common - practice. - -Build ------ - -- Issue #18596: Support the use of address sanity checking in recent versions - of clang and GCC by appropriately marking known false alarms in the small - object allocator. Patch contributed by Dhiru Kholia. - -Tools/Demos ------------ - -- Issue #18873: 2to3 and the findnocoding.py script now detect Python source - code encoding only in comment lines. - - -What's New in Python 3.4.0 Alpha 2? -=================================== - -Release date: 2013-09-09 - -Core and Builtins ------------------ - -- Issue #18942: sys._debugmallocstats() output was damaged on Windows. - -- Issue #18571: Implementation of the PEP 446: file descriptors and file - handles are now created non-inheritable; add functions - os.get/set_inheritable(), os.get/set_handle_inheritable() and - socket.socket.get/set_inheritable(). - -- Issue #11619: The parser and the import machinery do not encode Unicode - filenames anymore on Windows. - -- Issue #18808: Non-daemon threads are now automatically joined when - a sub-interpreter is shutdown (it would previously dump a fatal error). - -- Remove support for compiling on systems without getcwd(). - -- Issue #18774: Remove last bits of GNU PTH thread code and thread_pth.h. - -- Issue #18771: Add optimization to set object lookups to reduce the cost - of hash collisions. The core idea is to inspect a second key/hash pair - for each cache line retrieved. - -- Issue #16105: When a signal handler fails to write to the file descriptor - registered with ``signal.set_wakeup_fd()``, report an exception instead - of ignoring the error. - -- Issue #18722: Remove uses of the "register" keyword in C code. - -- Issue #18667: Add missing "HAVE_FCHOWNAT" symbol to posix._have_functions. - -- Issue #16499: Add command line option for isolated mode. - -- Issue #15301: Parsing fd, uid, and gid parameters for builtins - in Modules/posixmodule.c is now far more robust. - -- Issue #18368: PyOS_StdioReadline() no longer leaks memory when realloc() - fail. - -- Issue #17934: Add a clear() method to frame objects, to help clean up - expensive details (local variables) and break reference cycles. - -- Issue #18780: %-formatting codes %d, %i, and %u now treat int-subclasses - as int (displays value of int-subclass instead of str(int-subclass) ). - -Library -------- - -- Issue #18808: Thread.join() now waits for the underlying thread state to - be destroyed before returning. This prevents unpredictable aborts in - Py_EndInterpreter() when some non-daemon threads are still running. - -- Issue #18458: Prevent crashes with newer versions of libedit. Its readline - emulation has changed from 0-based indexing to 1-based like gnu readline. - -- Issue #18852: Handle case of ``readline.__doc__`` being ``None`` in the new - readline activation code in ``site.py``. - -- Issue #18672: Fixed format specifiers for Py_ssize_t in debugging output in - the _sre module. - -- Issue #18830: inspect.getclasstree() no longer produces duplicate entries even - when input list contains duplicates. - -- Issue #18878: sunau.open now supports the context management protocol. Based on - patches by Claudiu Popa and R. David Murray. - -- Issue #18909: Fix _tkinter.tkapp.interpaddr() on Windows 64-bit, don't cast - 64-bit pointer to long (32 bits). - -- Issue #18876: The FileIO.mode attribute now better reflects the actual mode - under which the file was opened. Patch by Erik Bray. - -- Issue #16853: Add new selectors module. - -- Issue #18882: Add threading.main_thread() function. - -- Issue #18901: The sunau getparams method now returns a namedtuple rather than - a plain tuple. Patch by Claudiu Popa. - -- Issue #17487: The result of the wave getparams method now is pickleable again. - Patch by Claudiu Popa. - -- Issue #18756: os.urandom() now uses a lazily-opened persistent file - descriptor, so as to avoid using many file descriptors when run in - parallel from multiple threads. - -- Issue #18418: After fork(), reinit all threads states, not only active ones. - Patch by A. Jesse Jiryu Davis. - -- Issue #17974: Switch unittest from using getopt to using argparse. - -- Issue #11798: TestSuite now drops references to own tests after execution. - -- Issue #16611: http.cookie now correctly parses the 'secure' and 'httponly' - cookie flags. - -- Issue #11973: Fix a problem in kevent. The flags and fflags fields are now - properly handled as unsigned. - -- Issue #18807: ``pyvenv`` now takes a --copies argument allowing copies - instead of symlinks even where symlinks are available and the default. - -- Issue #18538: ``python -m dis`` now uses argparse for argument processing. - Patch by Michele Orrù. - -- Issue #18394: Close cgi.FieldStorage's optional file. - -- Issue #17702: On error, os.environb now suppresses the exception context - when raising a new KeyError with the original key. - -- Issue #16809: Fixed some tkinter incompabilities with Tcl/Tk 8.6. - -- Issue #16809: Tkinter's splitlist() and split() methods now accept Tcl_Obj - argument. - -- Issue #18324: set_payload now correctly handles binary input. This also - supersedes the previous fixes for #14360, #1717, and #16564. - -- Issue #18794: Add a fileno() method and a closed attribute to select.devpoll - objects. - -- Issue #17119: Fixed integer overflows when processing large strings and tuples - in the tkinter module. - -- Issue #18747: Re-seed OpenSSL's pseudo-random number generator after fork. - A pthread_atfork() parent handler is used to seed the PRNG with pid, time - and some stack data. - -- Issue #8865: Concurrent invocation of select.poll.poll() now raises a - RuntimeError exception. Patch by Christian Schubert. - -- Issue #18777: The ssl module now uses the new CRYPTO_THREADID API of - OpenSSL 1.0.0+ instead of the deprecated CRYPTO id callback function. - -- Issue #18768: Correct doc string of RAND_edg(). Patch by Vajrasky Kok. - -- Issue #18178: Fix ctypes on BSD. dlmalloc.c was compiled twice which broke - malloc weak symbols. - -- Issue #18709: Fix CVE-2013-4238. The SSL module now handles NULL bytes - inside subjectAltName correctly. Formerly the module has used OpenSSL's - GENERAL_NAME_print() function to get the string represention of ASN.1 - strings for ``rfc822Name`` (email), ``dNSName`` (DNS) and - ``uniformResourceIdentifier`` (URI). - -- Issue #18701: Remove support of old CPython versions (<3.0) from C code. - -- Issue #18756: Improve error reporting in os.urandom() when the failure - is due to something else than /dev/urandom not existing (for example, - exhausting the file descriptor limit). - -- Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel - 3.11 or newer. It's only defined on system with 3.11 uapi headers, too. - -- Issue #18532: Change the builtin hash algorithms' names to lower case names - as promised by hashlib's documentation. - -- Issue #8713: add new spwan and forkserver start methods, and new functions - get_all_start_methods, get_start_method, and set_start_method, to - multiprocessing. - -- Issue #18405: Improve the entropy of crypt.mksalt(). - -- Issue #12015: The tempfile module now uses a suffix of 8 random characters - instead of 6, to reduce the risk of filename collision. The entropy was - reduced when uppercase letters were removed from the charset used to generate - random characters. - -- Issue #18585: Add :func:`textwrap.shorten` to collapse and truncate a - piece of text to a given length. - -- Issue #18598: Tweak exception message for importlib.import_module() to - include the module name when a key argument is missing. - -- Issue #19151: Fix docstring and use of _get_supported_file_loaders() to - reflect 2-tuples. - -- Issue #19152: Add ExtensionFileLoader.get_filename(). - -- Issue #18676: Change 'positive' to 'non-negative' in queue.py put and get - docstrings and ValueError messages. Patch by Zhongyue Luo - -- Fix refcounting issue with extension types in tkinter. - -- Issue #8112: xlmrpc.server's DocXMLRPCServer server no longer raises an error - if methods have annotations; it now correctly displays the annotations. - -- Issue #18600: Added policy argument to email.message.Message.as_string, - and as_bytes and __bytes__ methods to Message. - -- Issue #18671: Output more information when logging exceptions occur. - -- Issue #18621: Prevent the site module's patched builtins from keeping - too many references alive for too long. - -- Issue #4885: Add weakref support to mmap objects. Patch by Valerie Lambert. - -- Issue #8860: Fixed rounding in timedelta constructor. - -- Issue #18849: Fixed a Windows-specific tempfile bug where collision with an - existing directory caused mkstemp and related APIs to fail instead of - retrying. Report and fix by Vlad Shcherbina. - -- Issue #18920: argparse's default destination for the version action (-v, - --version) has also been changed to stdout, to match the Python executable. - -Tests ------ - -- Issue #18623: Factor out the _SuppressCoreFiles context manager into - test.support. Patch by Valerie Lambert. - -- Issue #12037: Fix test_email for desktop Windows. - -- Issue #15507: test_subprocess's test_send_signal could fail if the test - runner were run in an environment where the process inherited an ignore - setting for SIGINT. Restore the SIGINT handler to the desired - KeyboardInterrupt raising one during that test. - -- Issue #16799: Switched from getopt to argparse style in regrtest's argument - parsing. Added more tests for regrtest's argument parsing. - -- Issue #18792: Use "127.0.0.1" or "::1" instead of "localhost" as much as - possible, since "localhost" goes through a DNS lookup under recent Windows - versions. - -IDLE ----- - -- Issue #18489: Add tests for SearchEngine. Original patch by Phil Webster. - -Documentation -------------- - -- Issue #18743: Fix references to non-existant "StringIO" module. - -- Issue #18783: Removed existing mentions of Python long type in docstrings, - error messages and comments. - -Build ------ - -- Issue #1584: Provide configure options to override default search paths for - Tcl and Tk when building _tkinter. - -- Issue #15663: Tcl/Tk 8.5.14 is now included with the OS X 10.6+ 64-/32-bit - installer. It is no longer necessary to install a third-party version of - Tcl/Tk 8.5 to work around the problems in the Apple-supplied Tcl/Tk 8.5 - shipped in OS X 10.6 and later releases. - -Tools/Demos ------------ - -- Issue #18922: Now The Lib/smtpd.py and Tools/i18n/msgfmt.py scripts write - their version strings to stdout, and not to sderr. - - -What's New in Python 3.4.0 Alpha 1? -=================================== - -Release date: 2013-08-03 - -Core and Builtins ------------------ - -- Issue #16741: Fix an error reporting in int(). - -- Issue #17899: Fix rare file descriptor leak in os.listdir(). - -- Issue #10241: Clear extension module dict copies at interpreter shutdown. - Patch by Neil Schemenauer, minimally modified. - -- Issue #9035: ismount now recognises volumes mounted below a drive root - on Windows. Original patch by Atsuo Ishimoto. - -- Issue #18214: Improve finalization of Python modules to avoid setting - their globals to None, in most cases. - -- Issue #18112: PEP 442 implementation (safe object finalization). - -- Issue #18552: Check return value of PyArena_AddPyObject() in - obj2ast_object(). - -- Issue #18560: Fix potential NULL pointer dereference in sum(). - -- Issue #18520: Add a new PyStructSequence_InitType2() function, same than - PyStructSequence_InitType() except that it has a return value (0 on success, - -1 on error). - -- Issue #15905: Fix theoretical buffer overflow in handling of sys.argv[0], - prefix and exec_prefix if the operation system does not obey MAXPATHLEN. - -- Issue #18408: Fix many various bugs in code handling errors, especially - on memory allocation failure (MemoryError). - -- Issue #18344: Fix potential ref-leaks in _bufferedreader_read_all(). - -- Issue #18342: Use the repr of a module name when an import fails when using - ``from ... import ...``. - -- Issue #17872: Fix a segfault in marshal.load() when input stream returns - more bytes than requested. - -- Issue #18338: `python --version` now prints version string to stdout, and - not to stderr. Patch by Berker Peksag and Michael Dickens. - -- Issue #18426: Fix NULL pointer dereference in C extension import when - PyModule_GetDef() returns an error. - -- Issue #17206: On Windows, increase the stack size from 2 MB to 4.2 MB to fix - a stack overflow in the marshal module (fix a crash in test_marshal). - Patch written by Jeremy Kloth. - -- Issue #3329: Implement the PEP 445: Add new APIs to customize Python memory - allocators. - -- Issue #18328: Reorder ops in PyThreadState_Delete*() functions. Now the - tstate is first removed from TLS and then deallocated. - -- Issue #13483: Use VirtualAlloc in obmalloc on Windows. - -- Issue #18184: PyUnicode_FromFormat() and PyUnicode_FromFormatV() now raise - OverflowError when an argument of %c format is out of range. - -- Issue #18111: The min() and max() functions now support a default argument - to be returned instead of raising a ValueError on an empty sequence. - (Contributed by Julian Berman.) - -- Issue #18137: Detect integer overflow on precision in float.__format__() - and complex.__format__(). - -- Issue #18183: Fix various unicode operations on strings with large unicode - codepoints. - -- Issue #18180: Fix ref leak in _PyImport_GetDynLoadWindows(). - -- Issue #18038: SyntaxError raised during compilation sources with illegal - encoding now always contains an encoding name. - -- Issue #17931: Resolve confusion on Windows between pids and process - handles. - -- Tweak the exception message when the magic number or size value in a bytecode - file is truncated. - -- Issue #17932: Fix an integer overflow issue on Windows 64-bit in iterators: - change the C type of seqiterobject.it_index from long to Py_ssize_t. - -- Issue #18065: Don't set __path__ to the package name for frozen packages. - -- Issue #18088: When reloading a module, unconditionally reset all relevant - attributes on the module (e.g. __name__, __loader__, __package__, __file__, - __cached__). - -- Issue #17937: Try harder to collect cyclic garbage at shutdown. - -- Issue #12370: Prevent class bodies from interfering with the __class__ - closure. - -- Issue #17644: Fix a crash in str.format when curly braces are used in square - brackets. - -- Issue #17237: Fix crash in the ASCII decoder on m68k. - -- Issue #17927: Frame objects kept arguments alive if they had been - copied into a cell, even if the cell was cleared. - -- Issue #1545463: At shutdown, defer finalization of codec modules so - that stderr remains usable. - -- Issue #7330: Implement width and precision (ex: "%5.3s") for the format - string of PyUnicode_FromFormat() function, original patch written by Ysj Ray. - -- Issue #1545463: Global variables caught in reference cycles are now - garbage-collected at shutdown. - -- Issue #17094: Clear stale thread states after fork(). Note that this - is a potentially disruptive change since it may release some system - resources which would otherwise remain perpetually alive (e.g. database - connections kept in thread-local storage). - -- Issue #17408: Avoid using an obsolete instance of the copyreg module when - the interpreter is shutdown and then started again. - -- Issue #5845: Enable tab-completion in the interactive interpreter by - default, thanks to a new sys.__interactivehook__. - -- Issue #17115,17116: Module initialization now includes setting __package__ and - __loader__ attributes to None. - -- Issue #17853: Ensure locals of a class that shadow free variables always win - over the closures. - -- Issue #17863: In the interactive console, don't loop forever if the encoding - can't be fetched from stdin. - -- Issue #17867: Raise an ImportError if __import__ is not found in __builtins__. - -- Issue #18698: Ensure importlib.reload() returns the module out of sys.modules. - -- Issue #17857: Prevent build failures with pre-3.5.0 versions of sqlite3, - such as was shipped with Centos 5 and Mac OS X 10.4. - -- Issue #17413: sys.settrace callbacks were being passed a string instead of an - exception instance for the 'value' element of the arg tuple if the exception - originated from C code; now an exception instance is always provided. - -- Issue #17782: Fix undefined behaviour on platforms where - ``struct timespec``'s "tv_nsec" member is not a C long. - -- Issue #17722: When looking up __round__, resolve descriptors. - -- Issue #16061: Speed up str.replace() for replacing 1-character strings. - -- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__ - method. - -- Issue #17643: Add __callback__ attribute to weakref.ref. - -- Issue #16447: Fixed potential segmentation fault when setting __name__ on a - class. - -- Issue #17669: Fix crash involving finalization of generators using yield from. - -- Issue #14439: Python now prints the traceback on runpy failure at startup. - -- Issue #17469: Fix _Py_GetAllocatedBlocks() and sys.getallocatedblocks() - when running on valgrind. - -- Issue #17619: Make input() check for Ctrl-C correctly on Windows. - -- Issue #17357: Add missing verbosity messages for -v/-vv that were lost during - the importlib transition. - -- Issue #17610: Don't rely on non-standard behavior of the C qsort() function. - -- Issue #17323: The "[X refs, Y blocks]" printed by debug builds has been - disabled by default. It can be re-enabled with the `-X showrefcount` option. - -- Issue #17328: Fix possible refleak in dict.setdefault. - -- Issue #17275: Corrected class name in init error messages of the C version of - BufferedWriter and BufferedRandom. - -- Issue #7963: Fixed misleading error message that issued when object is - called without arguments. - -- Issue #8745: Small speed up zipimport on Windows. Patch by Catalin Iacob. - -- Issue #5308: Raise ValueError when marshalling too large object (a sequence - with size >= 2**31), instead of producing illegal marshal data. - -- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError - and a full traceback including line number. - -- Issue #16967: In function definition, evaluate positional defaults before - keyword-only defaults. - -- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.) - in the interpreter. - -- Issue #17137: When an Unicode string is resized, the internal wide character - string (wstr) format is now cleared. - -- Issue #17043: The unicode-internal decoder no longer read past the end of - input buffer. - -- Issue #17098: All modules now have __loader__ set even if they pre-exist the - bootstrapping of importlib. - -- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder. - -- Issue #16772: The base argument to the int constructor no longer accepts - floats, or other non-integer objects with an __int__ method. Objects - with an __index__ method are now accepted. - -- Issue #10156: In the interpreter's initialization phase, unicode globals - are now initialized dynamically as needed. - -- Issue #16980: Fix processing of escaped non-ascii bytes in the - unicode-escape-decode decoder. - -- Issue #16975: Fix error handling bug in the escape-decode bytes decoder. - -- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping" - in any mapping, not only in a string. - -- Issue #16613: Add *m* argument to ``collections.Chainmap.new_child`` to - allow the new child map to be specified explicitly. - -- Issue #16730: importlib.machinery.FileFinder now no longers raises an - exception when trying to populate its cache and it finds out the directory is - unreadable or has turned into a file. Reported and diagnosed by - David Pritchard. - -- Issue #16906: Fix a logic error that prevented most static strings from being - cleared. - -- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by - Amaury Forgeot d'Arc. - -- Issue #16856: Fix a segmentation fault from calling repr() on a dict with - a key whose repr raise an exception. - -- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB. - -- Issue #16761: Calling int() with base argument only now raises TypeError. - -- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py - when retrieving a REG_DWORD value. This corrects functions like - winreg.QueryValueEx that may have been returning truncated values. - -- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg - when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx. - -- Issue #11939: Set the st_dev attribute of stat_result to allow Windows to - take advantage of the os.path.samefile/sameopenfile/samestat implementations - used by other platforms. - -- Issue #16772: The int() constructor's second argument (base) no longer - accepts non integer values. Consistent with the behavior in Python 2. - -- Issue #14470: Remove w9xpopen support per PEP 11. - -- Issue #9856: Replace deprecation warning with raising TypeError - in object.__format__. Patch by Florent Xicluna. - -- Issue #16597: In buffered and text IO, call close() on the underlying stream - if invoking flush() fails. - -- Issue #16722: In the bytes() constructor, try to call __bytes__ on the - argument before __index__. - -- Issue #16421: loading multiple modules from one shared object is now - handled correctly (previously, the first module loaded from that file - was silently returned). Patch by Václav Šmilauer. - -- Issue #16602: When a weakref's target was part of a long deallocation - chain, the object could remain reachable through its weakref even though - its refcount had dropped to zero. - -- Issue #16495: Remove extraneous NULL encoding check from bytes_decode(). - -- Issue #16619: Create NameConstant AST class to represent None, True, and False - literals. As a result, these constants are never loaded at runtime from - builtins. - -- Issue #16455: On FreeBSD and Solaris, if the locale is C, the - ASCII/surrogateescape codec is now used (instead of the locale encoding) to - decode the command line arguments. This change fixes inconsistencies with - os.fsencode() and os.fsdecode(), because these operating systems announce an - ASCII locale encoding, but actually use the ISO-8859-1 encoding in practice. - -- Issue #16562: Optimize dict equality testing. Patch by Serhiy Storchaka. - -- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread - -- Issue #16592: stringlib_bytes_join doesn't raise MemoryError on allocation - failure. - -- Issue #16546: Fix: ast.YieldFrom argument is now mandatory. - -- Issue #16514: Fix regression causing a traceback when sys.path[0] is None - (actually, any non-string or non-bytes type). - -- Issue #16306: Fix multiple error messages when unknown command line - parameters where passed to the interpreter. Patch by Hieu Nguyen. - -- Issue #16215: Fix potential double memory free in str.replace(). Patch - by Serhiy Storchaka. - -- Issue #16290: A float return value from the __complex__ special method is no - longer accepted in the complex() constructor. - -- Issue #16416: On Mac OS X, operating system data are now always - encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding - (which may be ASCII if no locale environment variable is set), to avoid - inconsistencies with os.fsencode() and os.fsdecode() functions which are - already using UTF-8/surrogateescape. - -- Issue #16453: Fix equality testing of dead weakref objects. - -- Issue #9535: Fix pending signals that have been received but not yet - handled by Python to not persist after os.fork() in the child process. - -- Issue #14794: Fix slice.indices to return correct results for huge values, - rather than raising OverflowError. - -- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor - Stinner. - -- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD - characters when used with the 'replace' error handler on invalid utf-8 - sequences. Patch by Serhiy Storchaka, tests by Ezio Melotti. - -- Issue #5765: Apply a hard recursion limit in the compiler instead of - blowing the stack and segfaulting. Initial patch by Andrea Griffini. - -- Issue #16402: When slicing a range, fix shadowing of exceptions from - __index__. - -- Issue #16336: fix input checking in the surrogatepass error handler. - Patch by Serhiy Storchaka. - -- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now - raises an error. - -- Issue #7317: Display full tracebacks when an error occurs asynchronously. - Patch by Alon Horev with update by Alexey Kachayev. - -- Issue #16309: Make PYTHONPATH="" behavior the same as if PYTHONPATH - not set at all. - -- Issue #10189: Improve the error reporting of SyntaxErrors related to global - and nonlocal statements. - -- Fix segfaults on setting __qualname__ on builtin types and attempting to - delete it on any type. - -- Issue #14625: Rewrite the UTF-32 decoder. It is now 3x to 4x faster. Patch - written by Serhiy Storchaka. - -- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass - received a nonempty dict from the constructor. - -- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a - class's __dict__ and on type. - -- Issue #12805: Make bytes.join and bytearray.join faster when the separator - is empty. Patch by Serhiy Storchaka. - -- Issue #6074: Ensure cached bytecode files can always be updated by the - user that created them, even when the source file is read-only. - -- Issue #15958: bytes.join and bytearray.join now accept arbitrary buffer - objects. - -- Issue #14783: Improve int() docstring and switch docstrings for str(), - range(), and slice() to use multi-line signatures. - -- Issue #16160: Subclass support now works for types.SimpleNamespace. - -- Issue #16148: Implement PEP 424, adding operator.length_hint and - PyObject_LengthHint. - -- Upgrade Unicode data (UCD) to version 6.2. - -- Issue #15379: Fix passing of non-BMP characters as integers for the charmap - decoder (already working as unicode strings). Patch by Serhiy Storchaka. - -- Issue #15144: Fix possible integer overflow when handling pointers as integer - values, by using `Py_uintptr_t` instead of `size_t`. Patch by Serhiy - Storchaka. - -- Issue #15965: Explicitly cast `AT_FDCWD` as (int). Required on Solaris 10 - (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms. - -- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors. - -- Issue #15448: Buffered IO now frees the buffer when closed, instead - of when deallocating. - -- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an - exception handler on code with syntax errors. - -- Issue #15897: zipimport.c doesn't check return value of fseek(). - Patch by Felipe Cruz. - -- Issue #15801: Make sure mappings passed to '%' formatting are actually - subscriptable. - -- Issue #15111: __import__ should propagate ImportError when raised as a - side-effect of a module triggered from using fromlist. - -- Issue #15022: Add pickle and comparison support to types.SimpleNamespace. - -Library -------- - -- Issue #4331: Added functools.partialmethod (Initial patch by Alon Horev) - -- Issue #13461: Fix a crash in the TextIOWrapper.tell method on 64-bit - platforms. Patch by Yogesh Chaudhari. - -- Issue #18681: Fix a NameError in importlib.reload() (noticed by Weizhao Li). - -- Issue #14323: Expanded the number of digits in the coefficients for the - RGB -- YIQ conversions so that they match the FCC NTSC versions. - -- Issue #17998: Fix an internal error in regular expression engine. - -- Issue #17557: Fix os.getgroups() to work with the modified behavior of - getgroups(2) on OS X 10.8. Original patch by Mateusz Lenik. - -- Issue #18608: Avoid keeping a strong reference to the locale module - inside the _io module. - -- Issue #18619: Fix atexit leaking callbacks registered from sub-interpreters, - and make it GC-aware. - -- Issue #15699: The readline module now uses PEP 3121-style module - initialization, so as to reclaim allocated resources (Python callbacks) - at shutdown. Original patch by Robin Schreiber. - -- Issue #17616: wave.open now supports the context management protocol. - -- Issue #18599: Fix name attribute of _sha1.sha1() object. It now returns - 'SHA1' instead of 'SHA'. - -- Issue #13266: Added inspect.unwrap to easily unravel __wrapped__ chains - (initial patch by Daniel Urban and Aaron Iles) - -- Issue #18561: Skip name in ctypes' _build_callargs() if name is NULL. - -- Issue #18559: Fix NULL pointer dereference error in _pickle module - -- Issue #18556: Check the return type of PyUnicode_AsWideChar() in ctype's - U_set(). - -- Issue #17818: aifc.getparams now returns a namedtuple. - -- Issue #18549: Eliminate dead code in socket_ntohl() - -- Issue #18530: Remove additional stat call from posixpath.ismount. - Patch by Alex Gaynor. - -- Issue #18514: Fix unreachable Py_DECREF() call in PyCData_FromBaseObj() - -- Issue #9177: Calling read() or write() now raises ValueError, not - AttributeError, on a closed SSL socket. Patch by Senko Rasic. - -- Issue #18513: Fix behaviour of cmath.rect w.r.t. signed zeros on OS X 10.8 + - gcc. - -- Issue #18479: Changed venv Activate.ps1 to make deactivate a function, and - removed Deactivate.ps1. - -- Issue #18480: Add missing call to PyType_Ready to the _elementtree extension. - -- Issue #17778: Fix test discovery for test_multiprocessing. (Patch by - Zachary Ware.) - -- Issue #18393: The private module _gestalt and private functions - platform._mac_ver_gestalt, platform._mac_ver_lookup and - platform._bcd2str have been removed. This does not affect the public - interface of the platform module. - -- Issue #17482: functools.update_wrapper (and functools.wraps) now set the - __wrapped__ attribute correctly even if the underlying function has a - __wrapped__ attribute set. - -- Issue #18431: The new email header parser now decodes RFC2047 encoded words - in structured headers. - -- Issue #18432: The sched module's queue method was incorrectly returning - an iterator instead of a list. - -- Issue #18044: The new email header parser was mis-parsing encoded words where - an encoded character immediately followed the '?' that follows the CTE - character, resulting in a decoding failure. They are now decoded correctly. - -- Issue #18101: Tcl.split() now process strings nested in a tuple as it - do with byte strings. - -- Issue #18116: getpass was always getting an error when testing /dev/tty, - and thus was always falling back to stdin, and would then raise an exception - if stdin could not be used (such as /dev/null). It also leaked an open file. - All of these issues are now fixed. - -- Issue #17198: Fix a NameError in the dbm module. Patch by Valentina - Mukhamedzhanova. - -- Issue #18013: Fix cgi.FieldStorage to parse the W3C sample form. - -- Issue #18020: improve html.escape speed by an order of magnitude. - Patch by Matt Bryant. - -- Issue #18347: ElementTree's html serializer now preserves the case of - closing tags. - -- Issue #17261: Ensure multiprocessing's proxies use proper address. - -- Issue #18343: faulthandler.register() now keeps the previous signal handler - when the function is called twice, so faulthandler.unregister() restores - correctly the original signal handler. - -- Issue #17097: Make multiprocessing ignore EINTR. - -- Issue #18339: Negative ints keys in unpickler.memo dict no longer cause a - segfault inside the _pickle C extension. - -- Issue #18240: The HMAC module is no longer restricted to bytes and accepts - any bytes-like object, e.g. memoryview. Original patch by Jonas Borgström. - -- Issue #18224: Removed pydoc script from created venv, as it causes problems - on Windows and adds no value over and above python -m pydoc ... - -- Issue #18155: The csv module now correctly handles csv files that use - a delimter character that has a special meaning in regexes, instead of - throwing an exception. - -- Issue #14360: encode_quopri can now be successfully used as an encoder - when constructing a MIMEApplication object. - -- Issue #11390: Add -o and -f command line options to the doctest CLI to - specify doctest options (and convert it to using argparse). - -- Issue #18135: ssl.SSLSocket.write() now raises an OverflowError if the input - string in longer than 2 gigabytes, and ssl.SSLContext.load_cert_chain() - raises a ValueError if the password is longer than 2 gigabytes. The ssl - module does not support partial write. - -- Issue #11016: Add C implementation of the stat module as _stat. - -- Issue #18248: Fix libffi build on AIX. - -- Issue #18259: Declare sethostname in socketmodule.c for AIX - -- Issue #18147: Add diagnostic functions to ssl.SSLContext(). get_ca_list() - lists all loaded CA certificates and cert_store_stats() returns amount of - loaded X.509 certs, X.509 CA certs and CRLs. - -- Issue #18167: cgi.FieldStorage no longer fails to handle multipart/form-data - when \r\n appears at end of 65535 bytes without other newlines. - -- Issue #18076: Introduce importlib.util.decode_source(). - -- Issue #18357: add tests for dictview set difference. - Patch by Fraser Tweedale. - -- importlib.abc.SourceLoader.get_source() no longer changes SyntaxError or - UnicodeDecodeError into ImportError. - -- Issue #18058, 18057: Make the namespace package loader meet the - importlib.abc.InspectLoader ABC, allowing for namespace packages to work with - runpy. - -- Issue #17177: The imp module is pending deprecation. - -- subprocess: Prevent a possible double close of parent pipe fds when the - subprocess exec runs into an error. Prevent a regular multi-close of the - /dev/null fd when any of stdin, stdout and stderr was set to DEVNULL. - -- Issue #18194: Introduce importlib.util.cache_from_source() and - source_from_cache() while documenting the equivalent functions in imp as - deprecated. - -- Issue #17907: Document imp.new_module() as deprecated in favour of - types.ModuleType. - -- Issue #18192: Introduce importlib.util.MAGIC_NUMBER and document as deprecated - imp.get_magic(). - -- Issue #18149: Add filecmp.clear_cache() to manually clear the filecmp cache. - Patch by Mark Levitt - -- Issue #18193: Add importlib.reload(). - -- Issue #18157: Stop using imp.load_module() in pydoc. - -- Issue #16102: Make uuid._netbios_getnode() work again on Python 3. - -- Issue #17134: Add ssl.enum_cert_store() as interface to Windows' cert store. - -- Issue #18143: Implement ssl.get_default_verify_paths() in order to debug - the default locations for cafile and capath. - -- Issue #17314: Move multiprocessing.forking over to importlib. - -- Issue #11959: SMTPServer and SMTPChannel now take an optional map, use of - which avoids affecting global state. - -- Issue #18109: os.uname() now decodes fields from the locale encoding, and - socket.gethostname() now decodes the hostname from the locale encoding, - instead of using the UTF-8 encoding in strict mode. - -- Issue #18089: Implement importlib.abc.InspectLoader.load_module. - -- Issue #18088: Introduce importlib.abc.Loader.init_module_attrs for setting - module attributes. Leads to the pending deprecation of - importlib.util.module_for_loader. - -- Issue #17403: urllib.parse.robotparser normalizes the urls before adding to - ruleline. This helps in handling certain types invalid urls in a conservative - manner. Patch contributed by Mher Movsisyan. - -- Issue #18070: Have importlib.util.module_for_loader() set attributes - unconditionally in order to properly support reloading. - -- Added importlib.util.module_to_load to return a context manager to provide the - proper module object to load. - -- Issue #18025: Fixed a segfault in io.BufferedIOBase.readinto() when raw - stream's read() returns more bytes than requested. - -- Issue #18011: As was originally intended, base64.b32decode() now raises a - binascii.Error if there are non-b32-alphabet characters present in the input - string, instead of a TypeError. - -- Issue #18072: Implement importlib.abc.InspectLoader.get_code() and - importlib.abc.ExecutionLoader.get_code(). - -- Issue #8240: Set the SSL_MODE_ACCEPT_MOVING_WRITE_BUFFER flag on SSL - sockets. - -- Issue #17269: Workaround for socket.getaddrinfo crash on MacOS X - with port None or "0" and flags AI_NUMERICSERV. - -- Issue #16986: ElementTree now correctly works with string input when the - internal XML encoding is not UTF-8 or US-ASCII. - -- Issue #17996: socket module now exposes AF_LINK constant on BSD and OSX. - -- Issue #17900: Allowed pickling of recursive OrderedDicts. Decreased pickled - size and pickling time. - -- Issue #17914: Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an - initial patch by Trent Nelson. - -- Issue #17812: Fixed quadratic complexity of base64.b32encode(). - Optimize base64.b32encode() and base64.b32decode() (speed up to 3x). - -- Issue #17980: Fix possible abuse of ssl.match_hostname() for denial of - service using certificates with many wildcards (CVE-2013-2099). - -- Issue #15758: Fix FileIO.readall() so it no longer has O(n**2) complexity. - -- Issue #14596: The struct.Struct() objects now use a more compact - implementation. - -- Issue #17981: logging's SysLogHandler now closes the socket when it catches - socket OSErrors. - -- Issue #17964: Fix os.sysconf(): the return type of the C sysconf() function - is long, not int. - -- Fix typos in the multiprocessing module. - -- Issue #17754: Make ctypes.util.find_library() independent of the locale. - -- Issue #17968: Fix memory leak in os.listxattr(). - -- Issue #17606: Fixed support of encoded byte strings in the XMLGenerator - characters() and ignorableWhitespace() methods. Original patch by Sebastian - Ortiz Vasquez. - -- Issue #17732: Ignore distutils.cfg options pertaining to install paths if a - virtual environment is active. - -- Issue #17915: Fix interoperability of xml.sax with file objects returned by - codecs.open(). - -- Issue #16601: Restarting iteration over tarfile really restarts rather - than continuing from where it left off. Patch by Michael Birtwell. - -- Issue #17289: The readline module now plays nicer with external modules - or applications changing the rl_completer_word_break_characters global - variable. Initial patch by Bradley Froehle. - -- Issue #12181: select module: Fix struct kevent definition on OpenBSD 64-bit - platforms. Patch by Federico Schwindt. - -- Issue #11816: multiple improvements to the dis module: get_instructions - generator, ability to redirect output to a file, Bytecode and Instruction - abstractions. Patch by Nick Coghlan, Ryan Kelly and Thomas Kluyver. - -- Issue #13831: Embed stringification of remote traceback in local - traceback raised when pool task raises an exception. - -- Issue #15528: Add weakref.finalize to support finalization using - weakref callbacks. - -- Issue #14173: Avoid crashing when reading a signal handler during - interpreter shutdown. - -- Issue #15902: Fix imp.load_module() accepting None as a file when loading an - extension module. - -- Issue #13721: SSLSocket.getpeercert() and SSLSocket.do_handshake() now - raise an OSError with ENOTCONN, instead of an AttributeError, when the - SSLSocket is not connected. - -- Issue #14679: add an __all__ (that contains only HTMLParser) to html.parser. - -- Issue #17802: Fix an UnboundLocalError in html.parser. Initial tests by - Thomas Barlow. - -- Issue #17358: Modules loaded by imp.load_source() and load_compiled() (and by - extention load_module()) now have a better chance of working when reloaded. - -- Issue #17804: New function ``struct.iter_unpack`` allows for streaming - struct unpacking. - -- Issue #17830: When keyword.py is used to update a keyword file, it now - preserves the line endings of the original file. - -- Issue #17272: Making the urllib.request's Request.full_url a descriptor. - Fixes bugs with assignment to full_url. Patch by Demian Brecht. - -- Issue #17353: Plistlib emitted empty data tags with deeply nested datastructures - -- Issue #11714: Use 'with' statements to assure a Semaphore releases a - condition variable. Original patch by Thomas Rachel. - -- Issue #16624: `subprocess.check_output` now accepts an `input` argument, - allowing the subprocess's stdin to be provided as a (byte) string. - Patch by Zack Weinberg. - -- Issue #17795: Reverted backwards-incompatible change in SysLogHandler with - Unix domain sockets. - -- Issue #16694: Add a pure Python implementation of the operator module. - Patch by Zachary Ware. - -- Issue #11182: remove the unused and undocumented pydoc.Scanner class. - Patch by Martin Morrison. - -- Issue #17741: Add ElementTree.XMLPullParser, an event-driven parser for - non-blocking applications. - -- Issue #17555: Fix ForkAwareThreadLock so that size of after fork - registry does not grow exponentially with generation of process. - -- Issue #17707: fix regression in multiprocessing.Queue's get() method where - it did not block for short timeouts. - -- Issue #17720: Fix the Python implementation of pickle.Unpickler to correctly - process the APPENDS opcode when it is used on non-list objects. - -- Issue #17012: shutil.which() no longer falls back to the PATH environment - variable if an empty path argument is specified. Patch by Serhiy Storchaka. - -- Issue #17710: Fix pickle raising a SystemError on bogus input. - -- Issue #17341: Include the invalid name in the error messages from re about - invalid group names. - -- Issue #17702: os.environ now raises KeyError with the original environment - variable name (str on UNIX), instead of using the encoded name (bytes on - UNIX). - -- Issue #16163: Make the importlib based version of pkgutil.iter_importers - work for submodules. Initial patch by Berker Peksag. - -- Issue #16804: Fix a bug in the 'site' module that caused running - 'python -S -m site' to incorrectly throw an exception. - -- Issue #15480: Remove the deprecated and unused TYPE_INT64 code from marshal. - Initial patch by Daniel Riti. - -- Issue #2118: SMTPException is now a subclass of OSError. - -- Issue #17016: Get rid of possible pointer wraparounds and integer overflows - in the re module. Patch by Nickolai Zeldovich. - -- Issue #16658: add missing return to HTTPConnection.send() - Patch by Jeff Knupp. - -- Issue #9556: the logging package now allows specifying a time-of-day for a - TimedRotatingFileHandler to rotate. - -- Issue #14971: unittest test discovery no longer gets confused when a function - has a different __name__ than its name in the TestCase class dictionary. - -- Issue #17487: The wave getparams method now returns a namedtuple rather than - a plain tuple. - -- Issue #17675: socket repr() provides local and remote addresses (if any). - Patch by Giampaolo Rodola' - -- Issue #17093: Make the ABCs in importlib.abc provide default values or raise - reasonable exceptions for their methods to make them more amenable to super() - calls. - -- Issue #17566: Make importlib.abc.Loader.module_repr() optional instead of an - abstractmethod; now it raises NotImplementedError so as to be ignored by default. - -- Issue #17678: Remove the use of deprecated method in http/cookiejar.py by - changing the call to get_origin_req_host() to origin_req_host. - -- Issue #17666: Fix reading gzip files with an extra field. - -- Issue #16475: Support object instancing, recursion and interned strings - in marshal - -- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator. - -- Issue #16795: On the ast.arguments object, unify vararg with varargannotation - and kwarg and kwargannotation. Change the column offset of ast.Attribute to be - at the attribute name. - -- Issue #17434: Properly raise a SyntaxError when a string occurs between future - imports. - -- Issue #17117: Import and @importlib.util.set_loader now set __loader__ when - it has a value of None or the attribute doesn't exist. - -- Issue #17032: The "global" in the "NameError: global name 'x' is not defined" - error message has been removed. Patch by Ram Rachum. - -- Issue #18080: When building a C extension module on OS X, if the compiler - is overriden with the CC environment variable, use the new compiler as - the default for linking if LDSHARED is not also overriden. This restores - Distutils behavior introduced in 3.2.3 and inadvertently dropped in 3.3.0. - -- Issue #18113: Fixed a refcount leak in the curses.panel module's - set_userptr() method. Reported by Atsuo Ishimoto. - -- Implement PEP 443 "Single-dispatch generic functions". - -- Implement PEP 435 "Adding an Enum type to the Python standard library". - -- Issue #15596: Faster pickling of unicode strings. - -- Issue #17572: Avoid chained exceptions when passing bad directives to - time.strptime(). Initial patch by Claudiu Popa. - -- Issue #17435: threading.Timer's __init__ method no longer uses mutable - default values for the args and kwargs parameters. - -- Issue #17526: fix an IndexError raised while passing code without filename to - inspect.findsource(). Initial patch by Tyler Doyle. - -- Issue #17540: Added style parameter to logging formatter configuration by dict. - -- Issue #16692: The ssl module now supports TLS 1.1 and TLS 1.2. Initial - patch by Michele Orrù. - -- Issue #17025: multiprocessing: Reduce Queue and SimpleQueue contention. - -- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser, - iceweasel, iceape. - -- Issue #17150: pprint now uses line continuations to wrap long string - literals. - -- Issue #17488: Change the subprocess.Popen bufsize parameter default value - from unbuffered (0) to buffering (-1) to match the behavior existing code - expects and match the behavior of the subprocess module in Python 2 to avoid - introducing hard to track down bugs. - -- Issue #17521: Corrected non-enabling of logger following two calls to - fileConfig(). - -- Issue #17508: Corrected logging MemoryHandler configuration in dictConfig() - where the target handler wasn't configured first. - -- Issue #17209: curses.window.get_wch() now correctly handles KeyboardInterrupt - (CTRL+c). - -- Issue #5713: smtplib now handles 421 (closing connection) error codes when - sending mail by closing the socket and reporting the 421 error code via the - exception appropriate to the command that received the error response. - -- Issue #16997: unittest.TestCase now provides a subTest() context manager - to procedurally generate, in an easy way, small test instances. - -- Issue #17485: Also delete the Request Content-Length header if the data - attribute is deleted. (Follow on to issue Issue #16464). - -- Issue #15927: CVS now correctly parses escaped newlines and carriage - when parsing with quoting turned off. - -- Issue #17467: add readline and readlines support to mock_open in - unittest.mock. - -- Issue #13248: removed deprecated and undocumented difflib.isbjunk, - isbpopular. - -- Issue #17192: Update the ctypes module's libffi to v3.0.13. This - specifically addresses a stack misalignment issue on x86 and issues on - some more recent platforms. - -- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal. - -- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO - in subprocess, but the imap code assumes buffered IO. In Python2 this - worked by accident. IMAP4_stream now explicitly uses buffered IO. - -- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc - 'allmethods'; it was missing unbound methods on the class. - -- Issue #17474: Remove the deprecated methods of Request class. - -- Issue #16709: unittest discover order is no-longer filesystem specific. Patch - by Jeff Ramnani. - -- Use the HTTPS PyPI url for upload, overriding any plain HTTP URL in pypirc. - -- Issue #5024: sndhdr.whichhdr now returns the frame count for WAV files - rather than -1. - -- Issue #17460: Remove the strict argument of HTTPConnection and removing the - DeprecationWarning being issued from 3.2 onwards. - -- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module. - -- Issue #16389: Fixed a performance regression relative to Python 3.1 in the - caching of compiled regular expressions. - -- Added missing FeedParser and BytesFeedParser to email.parser.__all__. - -- Issue #17431: Fix missing import of BytesFeedParser in email.parser. - -- Issue #12921: http.server's send_error takes an explain argument to send more - information in response. Patch contributed by Karl. - -- Issue #17414: Add timeit, repeat, and default_timer to timeit.__all__. - -- Issue #1285086: Get rid of the refcounting hack and speed up - urllib.parse.unquote() and urllib.parse.unquote_to_bytes(). - -- Issue #17099: Have importlib.find_loader() raise ValueError when __loader__ - is not set, harmonizing with what happens when the attribute is set to None. - -- Expose the O_PATH constant in the os module if it is available. - -- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused - a failure while decoding empty object literals when object_pairs_hook was - specified. - -- Issue #17385: Fix quadratic behavior in threading.Condition. The FIFO - queue now uses a deque instead of a list. - -- Issue #15806: Add contextlib.ignore(). This creates a context manager to - ignore specified exceptions, replacing the "except SomeException: pass" idiom. - -- Issue #14645: The email generator classes now produce output using the - specified linesep throughout. Previously if the prolog, epilog, or - body were stored with a different linesep, that linesep was used. This - fix corrects an RFC non-compliance issue with smtplib.send_message. - -- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when - the list is being resized concurrently. - -- Issue #16962: Use getdents64 instead of the obsolete getdents syscall - in the subprocess module on Linux. - -- Issue #16935: unittest now counts the module as skipped if it raises SkipTest, - instead of counting it as an error. Patch by Zachary Ware. - -- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR. - -- Issue #17223: array module: Fix a crasher when converting an array containing - invalid characters (outside range [U+0000; U+10ffff]) to Unicode: - repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob. - -- Issue #17197: profile/cProfile modules refactored so that code of run() and - runctx() utility functions is not duplicated in both modules. - -- Issue #14720: sqlite3: Convert datetime microseconds correctly. - Patch by Lowe Thiderman. - -- Issue #15132: Allow a list for the defaultTest argument of - unittest.TestProgram. Patch by Jyrki Pulliainen. - -- Issue #17225: JSON decoder now counts columns in the first line starting - with 1, as in other lines. - -- Issue #6623: Added explicit DeprecationWarning for ftplib.netrc, which has - been deprecated and undocumented for a long time. - -- Issue #13700: Fix byte/string handling in imaplib authentication when an - authobject is specified. - -- Issue #13153: Tkinter functions now raise TclError instead of ValueError when - a string argument contains non-BMP character. - -- Issue #9669: Protect re against infinite loops on zero-width matching in - non-greedy repeat. Patch by Matthew Barnett. - -- Issue #13169: The maximal repetition number in a regular expression has been - increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on - 64-bit). - -- Issue #17143: Fix a missing import in the trace module. Initial patch by - Berker Peksag. - -- Issue #15220: email.feedparser's line splitting algorithm is now simpler and - faster. - -- Issue #16743: Fix mmap overflow check on 32 bit Windows. - -- Issue #16996: webbrowser module now uses shutil.which() to find a - web-browser on the executable search path. - -- Issue #16800: tempfile.gettempdir() no longer left temporary files when - the disk is full. Original patch by Amir Szekely. - -- Issue #17192: Import libffi-3.0.12. - -- Issue #16564: Fixed regression relative to Python2 in the operation of - email.encoders.encode_7or8bit when used with binary data. - -- Issue #17052: unittest discovery should use self.testLoader. - -- Issue #4591: Uid and gid values larger than 2**31 are supported now. - -- Issue #17141: random.vonmisesvariate() no longer hangs for large kappas. - -- Issue #17149: Fix random.vonmisesvariate to always return results in - [0, 2*math.pi]. - -- Issue #1470548: XMLGenerator now works with binary output streams. - -- Issue #6975: os.path.realpath() now correctly resolves multiple nested - symlinks on POSIX platforms. - -- Issue #13773: sqlite3.connect() gets a new `uri` parameter to pass the - filename as a URI, allowing to pass custom options. - -- Issue #16564: Fixed regression relative to Python2 in the operation of - email.encoders.encode_noop when used with binary data. - -- Issue #10355: The mode, name, encoding and newlines properties now work on - SpooledTemporaryFile objects even when they have not yet rolled over. - Obsolete method xreadline (which has never worked in Python 3) has been - removed. - -- Issue #16686: Fixed a lot of bugs in audioop module. Fixed crashes in - avgpp(), maxpp() and ratecv(). Fixed an integer overflow in add(), bias(), - and ratecv(). reverse(), lin2lin() and ratecv() no more lose precision for - 32-bit samples. max() and rms() no more returns a negative result and - various other functions now work correctly with 32-bit sample -0x80000000. - -- Issue #17073: Fix some integer overflows in sqlite3 module. - -- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection - is automatically closed. - -- Issue #15359: Add CAN_BCM protocol support to the socket module. Patch by - Brian Thorne. - -- Issue #16948: Fix quoted printable body encoding for non-latin1 character - sets in the email package. - -- Issue #16811: Fix folding of headers with no value in the provisional email - policies. - -- Issue #17132: Update symbol for "yield from" grammar changes. - -- Issue #17076: Make copying of xattrs more tolerant of missing FS support. - Patch by Thomas Wouters. - -- Issue #17089: Expat parser now correctly works with string input when the - internal XML encoding is not UTF-8 or US-ASCII. It also now accepts bytes - and strings larger than 2 GiB. - -- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple - parses nested mutating sequence. - -- Issue #5289: Fix ctypes.util.find_library on Solaris. - -- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying - stream or a decoder produces data of an unexpected type (i.e. when - io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec). - -- Issue #17015: When it has a spec, a Mock object now inspects its signature - when matching calls, so that arguments can be matched positionally or - by name. - -- Issue #15633: httplib.HTTPResponse is now mark closed when the server - sends less than the advertised Content-Length. - -- Issue #12268: The io module file object write methods no longer abort early - when one of its write system calls is interrupted (EINTR). - -- Issue #6972: The zipfile module no longer overwrites files outside of - its destination path when extracting malicious zip files. - -- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an - incomplete "End of Central Directory" record. Original patch by Guilherme - Polo and Alan McIntyre. - -- Issue #17071: Signature.bind() now works when one of the keyword arguments - is named ``self``. - -- Issue #12004: Fix an internal error in PyZipFile when writing an invalid - Python file. Patch by Ben Morgan. - -- Have py_compile use importlib as much as possible to avoid code duplication. - Code now raises FileExistsError if the file path to be used for the - byte-compiled file is a symlink or non-regular file as a warning that import - will not keep the file path type if it writes to that path. - -- Issue #16972: Have site.addpackage() consider already known paths even when - none are explicitly passed in. Bug report and fix by Kirill. - -- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``) - now fills the ``os.environ`` variable correctly. - -- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is - set to a callable object. - -- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee() - if all other iterators were very advanced before. - -- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries - and bytes data. Patch by Jonas Wagner. - -- Issue #16957: shutil.which() no longer searches a bare file name in the - current directory on Unix and no longer searches a relative file path with - a directory part in PATH directories. Patch by Thomas Kluyver. - -- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file - with truncated header or footer. - -- Issue #16993: shutil.which() now preserves the case of the path and extension - on Windows. - -- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file - descriptor argument. - -- Issue #16422: For compatibility with the Python version, the C version of - decimal now uses strings instead of integers for rounding mode constants. - -- Issue #15861: tkinter now correctly works with lists and tuples containing - strings with whitespaces, backslashes or unbalanced braces. - -- Issue #9720: zipfile now writes correct local headers for files larger than - 4 GiB. - -- Issue #16955: Fix the poll() method for multiprocessing's socket - connections on Windows. - -- SSLContext.load_dh_params() now properly closes the input file. - -- Issue #15031: Refactor some .pyc management code to cut down on code - duplication. Thanks to Ronan Lamy for the report and taking an initial stab - at the problem. - -- Issue #16398: Optimize deque.rotate() so that it only moves pointers - and doesn't touch the underlying data with increfs and decrefs. - -- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed. - -- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals - when used inside character classes (e.g. '[\A]'). Patch by Matthew Barnett. - -- Issue #15545: Fix regression in sqlite3's iterdump method where it was - failing if the connection used a row factory (such as sqlite3.Row) that - produced unsortable objects. (Regression was introduced by fix for 9750). - -- fcntl: add F_DUPFD_CLOEXEC constant, available on Linux 2.6.24+. - -- Issue #15972: Fix error messages when os functions expecting a file name or - file descriptor receive the incorrect type. - -- Issue #8109: The ssl module now has support for server-side SNI, thanks - to a :meth:`SSLContext.set_servername_callback` method. Patch by Daniel - Black. - -- Issue #16860: In tempfile, use O_CLOEXEC when available to set the - close-on-exec flag atomically. - -- Issue #16674: random.getrandbits() is now 20-40% faster for small integers. - -- Issue #16009: JSON error messages now provide more information. - -- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and - bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman. - -- Issue #16833: In http.client.HTTPConnection, do not concatenate the request - headers and body when the payload exceeds 16 KB, since it can consume more - memory for no benefit. Patch by Benno Leslie. - -- Issue #16541: tk_setPalette() now works with keyword arguments. - -- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError. - This makes `parser.clean()` work correctly. - -- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves - section order within the parser. This makes `parser.update()` preserve section - order as well. - -- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly - clears previous values stored in the default section. Same goes for - ``parser.update({'DEFAULT': {}})``. - -- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy. - -- Issue #16787: Increase asyncore and asynchat default output buffers size, to - decrease CPU usage and increase throughput. - -- Issue #10527: make multiprocessing use poll() instead of select() if available. - -- Issue #16688: Now regexes contained backreferences correctly work with - non-ASCII strings. Patch by Matthew Barnett. - -- Issue #16486: Make aifc files act as context managers. - -- Issue #16485: Now file descriptors are closed if file header patching failed - on closing an aifc file. - -- Issue #16640: Run less code under a lock in sched module. - -- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other - threads. - -- Issue #16641: Default values of sched.scheduler.enter() are no longer - modifiable. - -- Issue #16618: Make glob.glob match consistently across strings and bytes - regarding leading dots. Patch by Serhiy Storchaka. - -- Issue #16788: Add samestat to Lib/ntpath.py - -- Issue #16713: Parsing of 'tel' urls using urlparse separates params from - path. - -- Issue #16443: Add docstrings to regular expression match objects. - Patch by Anton Kasyanov. - -- Issue #15701: Fix HTTPError info method call to return the headers information. - -- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag. - -- Issue #16646: ftplib.FTP.makeport() might lose socket error details. - (patch by Serhiy Storchaka) - -- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the - pattern contains a wildcard in the drive or UNC path. Patch by Serhiy - Storchaka. - -- Issue #15783: Except for the number methods, the C version of decimal now - supports all None default values present in decimal.py. These values were - largely undocumented. - -- Issue #11175: argparse.FileType now accepts encoding and errors - arguments. Patch by Lucas Maystre. - -- Issue #16488: epoll() objects now support the `with` statement. Patch - by Serhiy Storchaka. - -- Issue #16298: In HTTPResponse.read(), close the socket when there is no - Content-Length and the incoming stream is finished. Patch by Eran - Rundstein. - -- Issue #16049: Add abc.ABC class to enable the use of inheritance to create - ABCs, rather than the more cumbersome metaclass=ABCMeta. Patch by Bruno - Dupuis. - -- Expose the TCP_FASTOPEN and MSG_FASTOPEN flags in socket when they're - available. - -- Issue #15701: Add a .headers attribute to urllib.error.HTTPError. Patch - contributed by Berker Peksag. - -- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree - that caused it to not ignore certain errors when ignore_errors was set. - Patch by Alessandro Moura and Serhiy Storchaka. - -- Issue #16248: Disable code execution from the user's home directory by - tkinter when the -E flag is passed to Python. Patch by Zachary Ware. - -- Issue #13390: New function :func:`sys.getallocatedblocks()` returns the - number of memory blocks currently allocated. - -- Issue #16628: Fix a memory leak in ctypes.resize(). - -- Issue #13614: Fix setup.py register failure with invalid rst in description. - Patch by Julien Courteau and Pierre Paul Lefebvre. - -- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944). Initial patch by - Philip Jenvey, tested by Mageia and Debian. - -- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later - on. Initial patch by SilentGhost and Jeff Ramnani. - -- Issue #13120: Allow to call pdb.set_trace() from thread. - Patch by Ilya Sandler. - -- Issue #16585: Make CJK encoders support error handlers that return bytes per - PEP 383. - -- Issue #10182: The re module doesn't truncate indices to 32 bits anymore. - Patch by Serhiy Storchaka. - -- Issue #16333: use (",", ": ") as default separator in json when indent is - specified, to avoid trailing whitespace. Patch by Serhiy Storchaka. - -- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous - list() calls aren't added to filter(), map(), and zip() which are directly - passed enumerate(). - -- Issue #16464: Reset the Content-Length header when a urllib Request is reused - with new data. - -- Issue #12848: The pure Python pickle implementation now treats object - lengths as unsigned 32-bit integers, like the C implementation does. - Patch by Serhiy Storchaka. - -- Issue #16423: urllib.request now has support for ``data:`` URLs. Patch by - Mathias Panzenböck. - -- Issue #4473: Add a POP3.stls() to switch a clear-text POP3 session into - an encrypted POP3 session, on supported servers. Patch by Lorenzo Catucci. - -- Issue #4473: Add a POP3.capa() method to query the capabilities advertised - by the POP3 server. Patch by Lorenzo Catucci. - -- Issue #4473: Ensure the socket is shutdown cleanly in POP3.close(). - Patch by Lorenzo Catucci. - -- Issue #16522: added FAIL_FAST flag to doctest. - -- Issue #15627: Add the importlib.abc.InspectLoader.source_to_code() method. - -- Issue #16408: Fix file descriptors not being closed in error conditions - in the zipfile module. Patch by Serhiy Storchaka. - -- Issue #14631: Add a new :class:`weakref.WeakMethod` to simulate weak - references to bound methods. - -- Issue #16469: Fix exceptions from float -> Fraction and Decimal -> Fraction - conversions for special values to be consistent with those for float -> int - and Decimal -> int. Patch by Alexey Kachayev. - -- Issue #16481: multiprocessing no longer leaks process handles on Windows. - -- Issue #12428: Add a pure Python implementation of functools.partial(). - Patch by Brian Thorne. - -- Issue #16140: The subprocess module no longer double closes its child - subprocess.PIPE parent file descriptors on child error prior to exec(). - -- Remove a bare print to stdout from the subprocess module that could have - happened if the child process wrote garbage to its pre-exec error pipe. - -- The subprocess module now raises its own SubprocessError instead of a - RuntimeError in various error situations which should not normally happen. - -- Issue #16327: The subprocess module no longer leaks file descriptors - used for stdin/stdout/stderr pipes to the child when fork() fails. - -- Issue #14396: Handle the odd rare case of waitpid returning 0 when not - expected in subprocess.Popen.wait(). - -- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access - previously-freed memory. Patch by Serhiy Storchaka. - -- Issue #16357: fix calling accept() on a SSLSocket created through - SSLContext.wrap_socket(). Original patch by Jeff McNeil. - -- Issue #16409: The reporthook callback made by the legacy - urllib.request.urlretrieve API now properly supplies a constant non-zero - block_size as it did in Python 3.2 and 2.7. This matches the behavior of - urllib.request.URLopener.retrieve. - -- Issue #16431: Use the type information when constructing a Decimal subtype - from a Decimal argument. - -- Issue #15641: Clean up deprecated classes from importlib - Patch by Taras Lyapun. - -- Issue #16350: zlib.decompressobj().decompress() now accumulates data from - successive calls after EOF in unused_data, instead of only saving the argument - to the last call. decompressobj().flush() now correctly sets unused_data and - unconsumed_tail. A bug in the handling of MemoryError when setting the - unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka. - -- Issue #12759: sre_parse now raises a proper error when the name of the group - is missing. Initial patch by Serhiy Storchaka. - -- Issue #16152: fix tokenize to ignore whitespace at the end of the code when - no newline is found. Patch by Ned Batchelder. - -- Issue #16284: Prevent keeping unnecessary references to worker functions - in concurrent.futures ThreadPoolExecutor. - -- Issue #16230: Fix a crash in select.select() when one the lists changes - size while iterated on. Patch by Serhiy Storchaka. - -- Issue #16228: Fix a crash in the json module where a list changes size - while it is being encoded. Patch by Serhiy Storchaka. - -- Issue #16351: New function gc.get_stats() returns per-generation collection - statistics. - -- Issue #14897: Enhance error messages of struct.pack and - struct.pack_into. Patch by Matti Mäki. - -- Issue #16316: mimetypes now recognizes the .xz and .txz (.tar.xz) extensions. - Patch by Serhiy Storchaka. - -- Issue #12890: cgitb no longer prints spurious

tags in text - mode when the logdir option is specified. - -- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks. - Patch by Janne Karila. - -- Issue #16305: Fix a segmentation fault occurring when interrupting - math.factorial. - -- Issue #16116: Fix include and library paths to be correct when building C - extensions in venvs. - -- Issue #16245: Fix the value of a few entities in html.entities.html5. - -- Issue #16301: Fix the localhost verification in urllib/request.py for file:// - urls. - -- Issue #16250: Fix the invocations of URLError which had misplaced filename - attribute for exception. - -- Issue #10836: Fix exception raised when file not found in urlretrieve - Initial patch by Ezio Melotti. - -- Issue #14398: Fix size truncation and overflow bugs in the bz2 module. - -- Issue #12692: Fix resource leak in urllib.request when talking to an HTTP - server that does not include a ``Connection: close`` header in its responses. - -- Issue #12034: Fix bogus caching of result in check_GetFinalPathNameByHandle. - Patch by Atsuo Ishimoto. - -- Improve performance of `lzma.LZMAFile` (see also issue #16034). - -- Issue #16220: wsgiref now always calls close() on an iterable response. - Patch by Brent Tubbs. - -- Issue #16270: urllib may hang when used for retrieving files via FTP by using - a context manager. Patch by Giampaolo Rodola'. - -- Issue #16461: Wave library should be able to deal with 4GB wav files, - and sample rate of 44100 Hz. - -- Issue #16176: Properly identify Windows 8 via platform.platform() - -- Issue #16088: BaseHTTPRequestHandler's send_error method includes a - Content-Length header in it's response now. Patch by Antoine Pitrou. - -- Issue #16114: The subprocess module no longer provides a misleading error - message stating that args[0] did not exist when either the cwd or executable - keyword arguments specified a path that did not exist. - -- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror. - -- Issue #16110: logging.fileConfig now accepts a pre-initialised ConfigParser - instance. - -- Issue #1492704: shutil.copyfile() raises a distinct SameFileError now if - source and destination are the same file. Patch by Atsuo Ishimoto. - -- Issue #13896: Make shelf instances work with 'with' as context managers. - Original patch by Filip Gruszczyński. - -- Issue #15417: Add support for csh and fish in venv activation scripts. - -- Issue #14377: ElementTree.write and some of the module-level functions have - a new parameter - *short_empty_elements*. It controls how elements with no - contents are emitted. - -- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element - element_factory (fixes a regression in SimpleTAL). - -- Issue #9650: List commonly used format codes in time.strftime and - time.strptime docsttings. Original patch by Mike Hoy. - -- Issue #15452: logging configuration socket listener now has a verify option - that allows an application to apply a verification function to the - received configuration data before it is acted upon. - -- Issue #16034: Fix performance regressions in the new `bz2.BZ2File` - implementation. Initial patch by Serhiy Storchaka. - -- `pty.spawn()` now returns the child process status returned by `os.waitpid()`. - -- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to - return a returncode of 0 when the child has already exited or cannot be waited - on. - -- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`. - -- Issue #16064: ``unittest -m`` claims executable is "python", not "python3". - -- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call. - -- Issue #15222: Insert blank line after each message in mbox mailboxes. - -- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters. - Patch by Serhiy Storchaka. - -- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after - `datetime.MAXYEAR`. Patch by Cédric Krier. - -- Issue #16112: platform.architecture does not correctly escape argument to - /usr/bin/file. Patch by David Benjamin. - -- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML - elements 'meta' and 'param'. - -- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise - ValueError when the file-like object is closed. Patch by Alessandro Moura. - -- Issue #15876: Fix a refleak in the `curses` module: window.encoding. - -- Issue #15881: Fix `atexit` hook in `multiprocessing`. Original patch by Chris - McDonough. - -- Issue #15841: The readable(), writable() and seekable() methods of - `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object - has been closed. Patch by Alessandro Moura. - -- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening - `os.devnull` explicitly and leaving it open. - -- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to - Popen when ``%action`` substitutions produce empty strings. - -- Issue #12776, issue #11839: Call `argparse` type function (specified by - add_argument) only once. Before, the type function was called twice in the - case where the default was specified and the argument was given as well. This - was especially problematic for the FileType type, as a default file would - always be opened, even if a file argument was specified on the command line. - -- Issue #15906: Fix a regression in argparse caused by the preceding change, - when ``action='append'``, ``type='str'`` and ``default=[]``. - -- Issue #16113: Added sha3 module based on the Keccak reference implementation - 3.2. The `hashlib` module has four additional hash algorithms: `sha3_224`, - `sha3_256`, `sha3_384` and `sha3_512`. As part of the patch some common - code was moved from _hashopenssl.c to hashlib.h. - -- ctypes.call_commethod was removed, since its only usage was in the defunct - samples directory. - -- Issue #16692: Added TLSv1.1 and TLSv1.2 support for the ssl modules. - -- Issue #16832: add abc.get_cache_token() to expose cache validity checking - support in ABCMeta. - -IDLE ----- - -- Issue #18429: Format / Format Paragraph, now works when comment blocks - are selected. As with text blocks, this works best when the selection - only includes complete lines. - -- Issue #18226: Add docstrings and unittests for FormatParagraph.py. - Original patches by Todd Rovito and Phil Webster. - -- Issue #18279: Format - Strip trailing whitespace no longer marks a file as - changed when it has not been changed. This fix followed the addition of a - test file originally written by Phil Webster (the issue's main goal). - -- Issue #7136: In the Idle File menu, "New Window" is renamed "New File". - Patch by Tal Einat, Roget Serwy, and Todd Rovito. - -- Remove dead imports of imp. - -- Issue #18196: Avoid displaying spurious SystemExit tracebacks. - -- Issue #5492: Avoid traceback when exiting IDLE caused by a race condition. - -- Issue #17511: Keep IDLE find dialog open after clicking "Find Next". - Original patch by Sarah K. - -- Issue #18055: Move IDLE off of imp and on to importlib. - -- Issue #15392: Create a unittest framework for IDLE. - Initial patch by Rajagopalasarma Jayakrishnan. - See Lib/idlelib/idle_test/README.txt for how to run Idle tests. - -- Issue #14146: Highlight source line while debugging on Windows. - -- Issue #17838: Allow sys.stdin to be reassigned. - -- Issue #13495: Avoid loading the color delegator twice in IDLE. - -- Issue #17798: Allow IDLE to edit new files when specified on command line. - -- Issue #14735: Update IDLE docs to omit "Control-z on Windows". - -- Issue #17532: Always include Options menu for IDLE on OS X. - Patch by Guilherme Simões. - -- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit(). - -- Issue #17657: Show full Tk version in IDLE's about dialog. - Patch by Todd Rovito. - -- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE. - -- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE. - -- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box. - -- Issue #17625: In IDLE, close the replace dialog after it is used. - -- Issue #14254: IDLE now handles readline correctly across shell restarts. - -- Issue #17614: IDLE no longer raises exception when quickly closing a file. - -- Issue #6698: IDLE now opens just an editor window when configured to do so. - -- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer - raises an exception. - -- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo. - -- Issue #17114: IDLE now uses non-strict config parser. - -- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase - interface and support all mandatory methods and properties. - -- Issue #5066: Update IDLE docs. Patch by Todd Rovito. - -- Issue #16829: IDLE printing no longer fails if there are spaces or other - special characters in the file path. - -- Issue #16491: IDLE now prints chained exception tracebacks. - -- Issue #16819: IDLE method completion now correctly works for bytes literals. - -- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by - Roger Serwy. - -- Issue #16511: Use default IDLE width and height if config param is not valid. - Patch Serhiy Storchaka. - -- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu - Patch by Todd Rovito. - -- Issue #16123: IDLE - deprecate running without a subprocess. - Patch by Roger Serwy. - -Tests ------ - -- Issue #1666318: Add a test that shutil.copytree() retains directory - permissions. Patch by Catherine Devlin. - -- Issue #18273: move the tests in Lib/test/json_tests to Lib/test/test_json - and make them discoverable by unittest. Patch by Zachary Ware. - -- Fix a fcntl test case on KFreeBSD, Debian #708653 (Petr Salinger). - -- Issue #18396: Fix spurious test failure in test_signal on Windows when - faulthandler is enabled (Patch by Jeremy Kloth) - -- Issue #17046: Fix broken test_executable_without_cwd in test_subprocess. - -- Issue #15415: Add new temp_dir() and change_cwd() context managers to - test.support, and refactor temp_cwd() to use them. Patch by Chris Jerdonek. - -- Issue #15494: test.support is now a package rather than a module (Initial - patch by Indra Talip) - -- Issue #17944: test_zipfile now discoverable and uses subclassing to - generate tests for different compression types. Fixed a bug with skipping - some tests due to use of exhausted iterators. - -- Issue #18266: test_largefile now works with unittest test discovery and - supports running only selected tests. Patch by Zachary Ware. - -- Issue #17767: test_locale now works with unittest test discovery. - Original patch by Zachary Ware. - -- Issue #18375: Assume --randomize when --randseed is used for running the - testsuite. - -- Issue #11185: Fix test_wait4 under AIX. Patch by Sébastien Sablé. - -- Issue #18207: Fix test_ssl for some versions of OpenSSL that ignore seconds - in ASN1_TIME fields. - -- Issue #18094: test_uuid no longer reports skipped tests as passed. - -- Issue #17992: Add timeouts to asyncore and asynchat tests so that they won't - accidentally hang. - -- Issue #17833: Fix test_gdb failures seen on machines where debug symbols - for glibc are available (seen on PPC64 Linux). - -- Issue #7855: Add tests for ctypes/winreg for issues found in IronPython. - Initial patch by Dino Viehland. - -- Issue #11078: test___all__ now checks for duplicates in __all__. - Initial patch by R. David Murray. - -- Issue #17712: Fix test_gdb failures on Ubuntu 13.04. - -- Issue #17835: Fix test_io when the default OS pipe buffer size is larger - than one million bytes. - -- Issue #17065: Use process-unique key for winreg tests to avoid failures if - test is run multiple times in parallel (eg: on a buildbot host). - -- Issue #12820: add tests for the xml.dom.minicompat module. - Patch by John Chandler and Phil Connell. - -- Issue #17691: test_univnewlines now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17790: test_set now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17789: test_random now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17779: test_osx_env now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17766: test_iterlen now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17690: test_time now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17692: test_sqlite now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #11995: test_pydoc doesn't import all sys.path modules anymore. - -- Issue #17448: test_sax now skips if there are no xml parsers available - instead of raising an ImportError. - -- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set. - Initial patch by Thomas Wouters. - -- Issue #10652: make tcl/tk tests run after __all__ test, patch by - Zachary Ware. - -- Issue #11963: remove human verification from test_parser and test_subprocess. - -- Issue #11732: add a new suppress_crash_popup() context manager to test.support - that disables crash popups on Windows and use it in test_faulthandler and - test_capi. - -- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu. - -- Issue #17283: Share code between `__main__.py` and `regrtest.py` in - `Lib/test`. - -- Issue #17249: convert a test in test_capi to use unittest and reap threads. - -- Issue #17107: Test client-side SNI support in urllib.request thanks to - the new server-side SNI support in the ssl module. Initial patch by - Daniel Black. - -- Issue #17041: Fix testing when Python is configured with the - --without-doc-strings. - -- Issue #16923: Fix ResourceWarnings in test_ssl. - -- Issue #15539: Added regression tests for Tools/scripts/pindent.py. - -- Issue #17479: test_io now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17066: test_robotparser now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17334: test_index now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17333: test_imaplib now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17082: test_dbm* now work with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17079: test_ctypes now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17304: test_hash now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17303: test_future* now work with unittest test discovery. - Patch by Zachary Ware. - -- Issue #17163: test_file now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16925: test_configparser now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16918: test_codecs now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16919: test_crypt now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16910: test_bytes, test_unicode, and test_userstring now work with - unittest test discovery. Patch by Zachary Ware. - -- Issue #16905: test_warnings now works with unittest test discovery. - Initial patch by Berker Peksag. - -- Issue #16898: test_bufio now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16888: test_array now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16896: test_asyncore now works with unittest test discovery. - Patch by Zachary Ware. - -- Issue #16897: test_bisect now works with unittest test discovery. - Initial patch by Zachary Ware. - -- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath - now work with unittest test discovery. Patch by Zachary Ware. - -- Issue #16748: test_heapq now works with unittest test discovery. - -- Issue #10646: Tests rearranged for os.samefile/samestat to check for not - just symlinks but also hard links. - -- Issue #15302: Switch regrtest from using getopt to using argparse. - -- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize - options. - -- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for - localhost tests. - -- Issue #16664: Add regression tests for glob's behaviour concerning entries - starting with a ".". Patch by Sebastian Kreft. - -- Issue #13390: The ``-R`` option to regrtest now also checks for memory - allocation leaks, using :func:`sys.getallocatedblocks()`. +Documentation +------------- -- Issue #16559: Add more tests for the json module, including some from the - official test suite at json.org. Patch by Serhiy Storchaka. +- Merge in all documentation changes since branching 3.4.0rc1. -- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives - the same output as :command:`id -G`. -- Issue #16115: Add some tests for the executable argument to - subprocess.Popen(). Initial patch by Kushal Das. +What's New in Python 3.4.0 release candidate 3? +=============================================== -- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c. - Patch by Serhiy Storchaka. +Release date: 2014-03-09 -- Issue #15304: Fix warning message when `os.chdir()` fails inside - `test.support.temp_cwd()`. Patch by Chris Jerdonek. +Core and Builtins +----------------- -- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by - Serhiy Storchaka. +- Issue #20786: Fix signatures for dict.__delitem__ and + property.__delete__ builtins. -- Issue #15557: Added a test suite for the webbrowser module, thanks to Anton - Barkovsky. +Library +------- -- Issue #16698: Skip posix test_getgroups when built with OS X - deployment target prior to 10.6. +- Issue #20839: Don't trigger a DeprecationWarning in the still supported + pkgutil.get_loader() API when __loader__ isn't set on a module (nor + when pkgutil.find_loader() is called directly). Build ----- @@@ -3444,13 -6163,25 +3445,14 @@@ Tools/Demo Build ----- -- Output lib files for PGO build into PGO directory. - -- Pick up 32-bit launcher from PGO directory on 64-bit PGO build. - -- Drop ``PC\python_nt.h`` as it's not used. Add input dependency on custom - build step. - -- Issue #15511: Drop explicit dependency on pythonxy.lib from _decimal amd64 - configuration. - -- Add missing PGI/PGO configurations for pywlauncher. - -- Issue #15645: Ensure 2to3 grammar pickles are properly installed. +- Issue #12837: Silence a tautological comparison warning on OS X under Clang in + socketmodule.c. + -What's New in Python 3.3.0 Beta 2? +What's New in Python 3.4.0 Beta 2? ================================== -*Release date: 12-Aug-2012* +Release date: 2014-01-05 Core and Builtins ----------------- @@@ -3745,867 -6490,877 +3747,870 @@@ IDL Tests ----- -- Issue #15467: Move helpers for `__sizeof__()` tests into test_support. Patch - by Serhiy Storchaka. - -- Issue #15320: Make iterating the list of tests thread-safe when running tests - in multiprocess mode. Patch by Chris Jerdonek. +- Issue #20055: Fix test_shutil under Windows with symlink privileges held. + Patch by Vajrasky Kok. -- Issue #15168: Move `importlib.test` to `test.test_importlib`. +- Issue #20070: Don't run test_urllib2net when network resources are not + enabled. -- Issue #15091: Reactivate a test on UNIX which was failing thanks to a - forgotten `importlib.invalidate_caches()` call. +- Issue #19938: Re-enabled test_bug_1333982 in test_dis, which had been + disabled since 3.0 due to the changes in listcomp handling. -- Issue #15230: Adopted a more systematic approach in the runpy tests. +- Issue #19320: test_tcl no longer fails when wantobjects is false. -- Issue #15300: Ensure the temporary test working directories are in the same - parent folder when running tests in multiprocess mode from a Python build. - Patch by Chris Jerdonek. +- Issue #19919: Fix flaky SSL test. connect_ex() sometimes returns + EWOULDBLOCK on Windows or VMs hosted on Windows. -- Issue #15284: Skip {send,recv}msg tests in test_socket when IPv6 is not - enabled. Patch by Brian Brazil. +- Issue #19912: Added tests for ntpath.splitunc(). -- Issue #15277: Fix a resource leak in support.py when IPv6 is disabled. Patch - by Brian Brazil. +- Issue #19828: Fixed test_site when the whole suite is run with -S. -Build ------ +- Issue #19928: Implemented a test for repr() of cell objects. -- Issue #11715: Fix multiarch detection without having Debian development tools - (dpkg-dev) installed. +- Issue #19535: Fixed test_docxmlrpc, test_functools, test_inspect, and + test_statistics when python is run with -OO. -- Issue #15037: Build OS X installers with local copy of ncurses 5.9 libraries - to avoid curses.unget_wch bug present in older versions of ncurses such as - those shipped with OS X. +- Issue #19926: Removed unneeded test_main from test_abstract_numbers. + Patch by Vajrasky Kok. -- Issue #15560: Fix building _sqlite3 extension on OS X with an SDK. Also, for - OS X installers, ensure consistent sqlite3 behavior and feature availability - by building a local copy of libsqlite3 rather than depending on the wide range - of versions supplied with various OS X releases. +- Issue #19572: More skipped tests explicitly marked as skipped. -- Issue #8847: Disable COMDAT folding in Windows PGO builds. +- Issue #19595, #19987: Re-enabled a long-disabled test in test_winsound. -- Issue #14018: Fix OS X Tcl/Tk framework checking when using OS X SDKs. +- Issue #19588: Fixed tests in test_random that were silently skipped most + of the time. Patch by Julian Gindi. -- Issue #16256: OS X installer now sets correct permissions for doc directory. +Build +----- -- Issue #15431: Add _freeze_importlib project to regenerate importlib.h on - Windows. Patch by Kristján Valur Jónsson. +- Issue #19728: Enable pip installation by default on Windows. -- Issue #14197: For OS X framework builds, ensure links to the shared library - are created with the proper ABI suffix. +- Issue #16136: Remove VMS support -- Issue #14330: For cross builds, don't use host python, use host search paths - for host compiler. +- Issue #18215: Add script Tools/ssl/test_multiple_versions.py to compile and + run Python's unit tests with multiple versions of OpenSSL. -- Issue #15235: Allow Berkley DB versions up to 5.3 to build the dbm module. +- Issue #19922: define _INCLUDE__STDC_A1_SOURCE in HP-UX to include mbstate_t + for mbrtowc(). -- Issue #15268: Search curses.h in /usr/include/ncursesw. +- Issue #19788: kill_python(_d).exe is now run as a PreBuildEvent on the + pythoncore sub-project. This should prevent build errors due a previous + build's python(_d).exe still running. +Documentation +------------- -What's New in Python 3.3.0 Beta 1? -================================== +- Issue #20265: Updated some parts of the Using Windows document. -*Release date: 27-Jun-2012* +- Issue #20266: Updated some parts of the Windows FAQ. -Core and Builtins ------------------ +- Issue #20255: Updated the about and bugs pages. -- Fix a (most likely) very rare memory leak when calling main() and not being - able to decode a command-line argument. +- Issue #20253: Fixed a typo in the ipaddress docs that advertised an + illegal attribute name. Found by INADA Naoki. -- Issue #14815: Use Py_ssize_t instead of long for the object hash, to - preserve all 64 bits of hash on Win64. +- Issue #18840: Introduce the json module in the tutorial, and de-emphasize + the pickle module. -- Issue #12268: File readline, readlines and read() or readall() methods - no longer lose data when an underlying read system call is interrupted. - IOError is no longer raised due to a read system call returning EINTR - from within these methods. +- Issue #19845: Updated the Compiling Python on Windows section. -- Issue #11626: Add _SizeT functions to stable ABI. +- Issue #19795: Improved markup of True/False constants. -- Issue #15142: Fix reference leak when deallocating instances of types - created using PyType_FromSpec(). +Tools/Demos +----------- -- Issue #10053: Don't close FDs when FileIO.__init__ fails. Loosely based on - the work by Hirokazu Yamamoto. +- Issue #19659: Added documentation for Argument Clinic. -- Issue #15096: Removed support for ur'' as the raw notation isn't - compatible with Python 2.x's raw unicode strings. +- Issue #19976: Argument Clinic METH_NOARGS functions now always + take two parameters. -- Issue #13783: Generator objects now use the identifier APIs internally + -- Issue #14874: Restore charmap decoding speed to pre-PEP 393 levels. - Patch by Serhiy Storchaka. +What's New in Python 3.4.0 Beta 1? +================================== -- Issue #15026: utf-16 encoding is now significantly faster (up to 10x). - Patch by Serhiy Storchaka. +Release date: 2013-11-24 -- Issue #11022: open() and io.TextIOWrapper are now calling - locale.getpreferredencoding(False) instead of locale.getpreferredencoding() - in text mode if the encoding is not specified. Don't change temporary the - locale encoding using locale.setlocale(), use the current locale encoding - instead of the user preferred encoding. +Core and Builtins +----------------- -- Issue #14673: Add Eric Snow's sys.implementation implementation. +- Use the repr of a module name in more places in import, especially + exceptions. -- Issue #15038: Optimize python Locks on Windows. +- Issue #19619: str.encode, bytes.decode and bytearray.decode now use an + internal API to throw LookupError for known non-text encodings, rather + than attempting the encoding or decoding operation and then throwing a + TypeError for an unexpected output type. (The latter mechanism remains + in place for third party non-text encodings) -Library -------- +- Issue #19183: Implement PEP 456 'secure and interchangeable hash algorithm'. + Python now uses SipHash24 on all major platforms. -- Issue #12288: Consider '0' and '0.0' as valid initialvalue - for tkinter SimpleDialog. +- Issue #12892: The utf-16* and utf-32* encoders no longer allow surrogate code + points (U+D800-U+DFFF) to be encoded. The utf-32* decoders no longer decode + byte sequences that correspond to surrogate code points. The surrogatepass + error handler now works with the utf-16* and utf-32* codecs. Based on + patches by Victor Stinner and Kang-Hao (Kenny) Lu. -- Issue #15512: Add a __sizeof__ implementation for parser. - Patch by Serhiy Storchaka. +- Issue #17806: Added keyword-argument support for "tabsize" to + str/bytes.expandtabs(). -- Issue #15469: Add a __sizeof__ implementation for deque objects. - Patch by Serhiy Storchaka. +- Issue #17828: Output type errors in str.encode(), bytes.decode() and + bytearray.decode() now direct users to codecs.encode() or codecs.decode() + as appropriate. -- Issue #15489: Add a __sizeof__ implementation for BytesIO objects. - Patch by Serhiy Storchaka. +- Issue #17828: The interpreter now attempts to chain errors that occur in + codec processing with a replacement exception of the same type that + includes the codec name in the error message. It ensures it only does this + when the creation of the replacement exception won't lose any information. -- Issue #15487: Add a __sizeof__ implementation for buffered I/O objects. - Patch by Serhiy Storchaka. +- Issue #19466: Clear the frames of daemon threads earlier during the + Python shutdown to call objects destructors. So "unclosed file" resource + warnings are now corretly emitted for daemon threads. -- Issue #15514: Correct __sizeof__ support for cpu_set. - Patch by Serhiy Storchaka. +- Issue #19514: Deduplicate some _Py_IDENTIFIER declarations. + Patch by Andrei Dorian Duma. -- Issue #15177: Added dir_fd parameter to os.fwalk(). +- Issue #17936: Fix O(n**2) behaviour when adding or removing many subclasses + of a given type. -- Issue #15061: Re-implemented hmac.compare_digest() in C to prevent further - timing analysis and to support all buffer protocol aware objects as well as - ASCII only str instances safely. +- Issue #19428: zipimport now handles errors when reading truncated or invalid + ZIP archive. -- Issue #15164: Change return value of platform.uname() from a - plain tuple to a collections.namedtuple. +- Issue #18408: Add a new PyFrame_FastToLocalsWithError() function to handle + exceptions when merging fast locals into f_locals of a frame. + PyEval_GetLocals() now raises an exception and return NULL on failure. -- Support Mageia Linux in the platform module. +- Issue #19369: Optimized the usage of __length_hint__(). -- Issue #11678: Support Arch linux in the platform module. +- Issue #18603: Ensure that PyOS_mystricmp and PyOS_mystrnicmp are in the + Python executable and not removed by the linker's optimizer. -- Issue #15118: Change return value of os.uname() and os.times() from - plain tuples to immutable iterable objects with named attributes - (structseq objects). +- Issue #19306: Add extra hints to the faulthandler module's stack + dumps that these are "upside down". -- Speed up _decimal by another 10-15% by caching the thread local context - that was last accessed. In the pi benchmark (64-bit platform, prec=9), - _decimal is now only 1.5x slower than float. +Library +------- -- Remove the packaging module, which is not ready for prime time. +- Issue #3158: doctest can now find doctests in functions and methods + written in C. -- Issue #15154: Add "dir_fd" parameter to os.rmdir, remove "rmdir" - parameter from os.remove / os.unlink. +- Issue #13477: Added command line interface to the tarfile module. + Original patch by Berker Peksag. -- Issue #4489: Add a shutil.rmtree that isn't susceptible to symlink attacks. - It is used automatically on platforms supporting the necessary os.openat() - and os.unlinkat() functions. Main code by Martin von Löwis. +- Issue #19674: inspect.signature() now produces a correct signature + for some builtins. -- Issue #15156: HTMLParser now uses the new "html.entities.html5" dictionary. +- Issue #19722: Added opcode.stack_effect(), which + computes the stack effect of bytecode instructions. -- Issue #11113: add a new "html5" dictionary containing the named character - references defined by the HTML5 standard and the equivalent Unicode - character(s) to the html.entities module. +- Issue #19735: Implement private function ssl._create_stdlib_context() to + create SSLContext objects in Python's stdlib module. It provides a single + configuration point and makes use of SSLContext.load_default_certs(). -- Issue #15114: the strict mode of HTMLParser and the HTMLParseError exception - are deprecated now that the parser is able to parse invalid markup. +- Issue #16203: Add re.fullmatch() function and regex.fullmatch() method, + which anchor the pattern at both ends of the string to match. + Original patch by Matthew Barnett. -- Issue #3665: \u and \U escapes are now supported in unicode regular - expressions. Patch by Serhiy Storchaka. +- Issue #13592: Improved the repr for regular expression pattern objects. + Based on patch by Hugo Lopes Tavares. -- Issue #15153: Added inspect.getgeneratorlocals to simplify white box - testing of generator state updates +- Issue #19641: Added the audioop.byteswap() function to convert big-endian + samples to little-endian and vice versa. -- Issue #13062: Added inspect.getclosurevars to simplify testing stateful - closures +- Issue #15204: Deprecated the 'U' mode in file-like objects. -- Issue #11024: Fixes and additional tests for Time2Internaldate. +- Issue #17810: Implement PEP 3154, pickle protocol 4. -- Issue #14626: Large refactoring of functions / parameters in the os module. - Many functions now support "dir_fd" and "follow_symlinks" parameters; - some also support accepting an open file descriptor in place of a path - string. Added os.support_* collections as LBYL helpers. Removed many - functions only previously seen in 3.3 alpha releases (often starting with - "f" or "l", or ending with "at"). Originally suggested by Serhiy Storchaka; - implemented by Larry Hastings. +- Issue #19668: Added support for the cp1125 encoding. -- Issue #15008: Implement PEP 362 "Signature Objects". - Patch by Yury Selivanov. +- Issue #19689: Add ssl.create_default_context() factory function. It creates + a new SSLContext object with secure default settings. -- Issue: #15138: base64.urlsafe_{en,de}code() are now 3-4x faster. +- Issue #19727: os.utime(..., None) is now potentially more precise + under Windows. -- Issue #444582: Add shutil.which, for finding programs on the system path. - Original patch by Erik Demaine, with later iterations by Jan Killian - and Brian Curtin. +- Issue #17201: ZIP64 extensions now are enabled by default. Patch by + William Mallard. -- Issue #14837: SSL errors now have ``library`` and ``reason`` attributes - describing precisely what happened and in which OpenSSL submodule. The - str() of a SSLError is also enhanced accordingly. +- Issue #19292: Add SSLContext.load_default_certs() to load default root CA + certificates from default stores or system stores. By default the method + loads CA certs for authentication of server certs. -- Issue #9527: datetime.astimezone() method will now supply a class - timezone instance corresponding to the system local timezone when - called with no arguments. +- Issue #19673: Add pathlib to the stdlib as a provisional module (PEP 428). -- Issue #14653: email.utils.mktime_tz() no longer relies on system - mktime() when timezone offest is supplied. +- Issue #16596: pdb in a generator now properly skips over yield and + yield from rather than stepping out of the generator into its + caller. (This is essential for stepping through asyncio coroutines.) -- Issue #14684: zlib.compressobj() and zlib.decompressobj() now support the use - of predefined compression dictionaries. Original patch by Sam Rushing. +- Issue #17916: Added dis.Bytecode.from_traceback() and + dis.Bytecode.current_offset to easily display "current instruction" + markers in the new disassembly API (Patch by Claudiu Popa). -- Fix GzipFile's handling of filenames given as bytes objects. +- Issue #19552: venv now supports bootstrapping pip into virtual environments -- Issue #14772: Return destination values from some shutil functions. +- Issue #17134: Finalize interface to Windows' certificate store. Cert and + CRL enumeration are now two functions. enum_certificates() also returns + purpose flags as set of OIDs. -- Issue #15064: Implement context manager protocol for multiprocessing types +- Issue #19555: Restore sysconfig.get_config_var('SO'), (and the distutils + equivalent) with a DeprecationWarning pointing people at $EXT_SUFFIX. -- Issue #15101: Make pool finalizer avoid joining current thread. +- Issue #8813: Add SSLContext.verify_flags to change the verification flags + of the context in order to enable certification revocation list (CRL) + checks or strict X509 rules. -- Issue #14657: The frozen instance of importlib used for bootstrap is now - also the module imported as importlib._bootstrap. +- Issue #18294: Fix the zlib module to make it 64-bit safe. -- Issue #14055: Add __sizeof__ support to _elementtree. +- Issue #19682: Fix compatibility issue with old version of OpenSSL that + was introduced by Issue #18379. -- Issue #15054: A bug in tokenize.tokenize that caused string literals - with 'b' prefixes to be incorrectly tokenized has been fixed. - Patch by Serhiy Storchaka. +- Issue #14455: plistlib now supports binary plists and has an updated API. -- Issue #15006: Allow equality comparison between naive and aware - time or datetime objects. +- Issue #19633: Fixed writing not compressed 16- and 32-bit wave files on + big-endian platforms. -- Issue #15036: Mailbox no longer throws an error if a flush is done - between operations when removing or changing multiple items in mbox, - MMDF, or Babyl mailboxes. +- Issue #18379: SSLSocket.getpeercert() returns CA issuer AIA fields, OCSP + and CRL distribution points. -- Issue #14059: Implement multiprocessing.Barrier. +- Issue #18138: Implement cadata argument of SSLContext.load_verify_location() + to load CA certificates and CRL from memory. It supports PEM and DER + encoded strings. -- Issue #15061: The inappropriately named hmac.secure_compare has been - renamed to hmac.compare_digest, restricted to operating on bytes inputs - only and had its documentation updated to more accurately reflect both its - intent and its limitations +- Issue #18775: Add name and block_size attribute to HMAC object. They now + provide the same API elements as non-keyed cryptographic hash functions. -- Issue #13841: Make child processes exit using sys.exit() on Windows. +- Issue #17276: MD5 as default digestmod for HMAC is deprecated. The HMAC + module supports digestmod names, e.g. hmac.HMAC('sha1'). -- Issue #14936: curses_panel was converted to PEP 3121 and PEP 384 API. - Patch by Robin Schreiber. +- Issue #19449: in csv's writerow, handle non-string keys when generating the + error message that certain keys are not in the 'fieldnames' list. -- Issue #1667546: On platforms supporting tm_zone and tm_gmtoff fields - in struct tm, time.struct_time objects returned by time.gmtime(), - time.localtime() and time.strptime() functions now have tm_zone and - tm_gmtoff attributes. Original patch by Paul Boddie. +- Issue #13633: Added a new convert_charrefs keyword arg to HTMLParser that, + when True, automatically converts all character references. -- Rename adjusted attribute to adjustable in time.get_clock_info() result. +- Issue #2927: Added the unescape() function to the html module. -- Issue #3518: Remove references to non-existent BaseManager.from_address() - method. +- Issue #8402: Added the escape() function to the glob module. -- Issue #13857: Added textwrap.indent() function (initial patch by Ezra - Berch) +- Issue #17618: Add Base85 and Ascii85 encoding/decoding to the base64 module. -- Issue #2736: Added datetime.timestamp() method. +- Issue #19634: time.strftime("%y") now raises a ValueError on AIX when given a + year before 1900. -- Issue #13854: Make multiprocessing properly handle non-integer - non-string argument to SystemExit. +- Fix test.support.bind_port() to not cause an error when Python was compiled + on a system with SO_REUSEPORT defined in the headers but run on a system + with an OS kernel that does not support that reasonably new socket option. -- Issue #12157: Make pool.map() empty iterables correctly. Initial - patch by mouad. +- Fix compilation error under gcc of the ctypes module bundled libffi for arm. -- Issue #11823: disassembly now shows argument counts on calls with keyword args. +- Issue #19448: Add private API to SSL module to lookup ASN.1 objects by OID, + NID, short name and long name. -- Issue #14711: os.stat_float_times() has been deprecated. +- Issue #19282: dbm.open now supports the context management protocol. (Inital + patch by Claudiu Popa) -- LZMAFile now accepts the modes "rb"/"wb"/"ab" as synonyms of "r"/"w"/"a". +- Issue #8311: Added support for writing any bytes-like objects in the aifc, + sunau, and wave modules. -- The bz2 and lzma modules now each contain an open() function, allowing - compressed files to readily be opened in text mode as well as binary mode. +- Issue #5202: Added support for unseekable files in the wave module. -- BZ2File.__init__() and LZMAFile.__init__() now accept a file object as their - first argument, rather than requiring a separate "fileobj" argument. +- Issue #19544 and Issue #1180: Restore global option to ignore + ~/.pydistutils.cfg in Distutils, accidentally removed in backout of + distutils2 changes. -- gzip.open() now accepts file objects as well as filenames. +- Issue #19523: Closed FileHandler leak which occurred when delay was set. -- Issue #14992: os.makedirs(path, exist_ok=True) would raise an OSError - when the path existed and had the S_ISGID mode bit set when it was - not explicitly asked for. This is no longer an exception as mkdir - cannot control if the OS sets that bit for it or not. +- Issue #19544 and Issue #6516: Restore support for --user and --group + parameters to sdist command accidentally rolled back as part of the + distutils2 rollback. -- Issue #14989: Make the CGI enable option to http.server available via command - line. +- Issue #13674: Prevented time.strftime from crashing on Windows when given + a year before 1900 and a format of %y. -- Issue #14987: Add a missing import statement to inspect. +- Issue #19406: implementation of the ensurepip module (part of PEP 453). + Patch by Donald Stufft and Nick Coghlan. -- Issue #1079: email.header.decode_header now correctly parses all the examples - in RFC2047. There is a necessary visible behavior change: the leading and/or - trailing whitespace on ASCII parts is now preserved. +- Issue #19544 and Issue #6286: Restore use of urllib over http allowing use + of http_proxy for Distutils upload command, a feature accidentally lost + in the rollback of distutils2. -- Issue #14969: Better handling of exception chaining in contextlib.ExitStack +- Issue #19544 and Issue #7457: Restore the read_pkg_file method to + distutils.dist.DistributionMetadata accidentally removed in the undo of + distutils2. -- Issue #14963: Convert contextlib.ExitStack.__exit__ to use an iterative - algorithm (Patch by Alon Horev) +- Issue #16685: Added support for any bytes-like objects in the audioop module. + Removed support for strings. -- Issue #14785: Add sys._debugmallocstats() to help debug low-level memory - allocation issues +- Issue #7171: Add Windows implementation of ``inet_ntop`` and ``inet_pton`` + to socket module. Patch by Atsuo Ishimoto. -- Issue #14443: Ensure that .py files are byte-compiled with the correct Python - executable within bdist_rpm even on older versions of RPM +- Issue #19261: Added support for writing 24-bit samples in the sunau module. -C-API ------ +- Issue #1097797: Added CP273 encoding, used on IBM mainframes in + Germany and Austria. Mapping provided by Michael Bierenfeld. -- Issue #15146: Add PyType_FromSpecWithBases. Patch by Robin Schreiber. +- Issue #1575020: Fixed support of 24-bit wave files on big-endian platforms. -- Issue #15042: Add PyState_AddModule and PyState_RemoveModule. Add version - guard for Py_LIMITED_API additions. Patch by Robin Schreiber. +- Issue #19378: Fixed a number of cases in the dis module where the new + "file" parameter was not being honoured correctly -- Issue #13783: Inadvertent additions to the public C API in the PEP 380 - implementation have either been removed or marked as private interfaces. +- Issue #19378: Removed the "dis.Bytecode.show_info" method -Extension Modules ------------------ +- Issue #19378: Renamed the "dis.Bytecode.display_code" method to + "dis.Bytecode.dis" and converted it to returning a string rather than + printing output. -- Issue #15000: Support the "unique" x32 architecture in _posixsubprocess.c. +- Issue #19378: the "line_offset" parameter in the new "dis.get_instructions" + API has been renamed to "first_line" (and the default value and usage + changed accordingly). This should reduce confusion with the more common use + of "offset" in the dis docs to refer to bytecode offsets. -IDLE ----- +- Issue #18678: Corrected spwd struct member names in spwd module: + sp_nam->sp_namp, and sp_pwd->sp_pwdp. The old names are kept as extra + structseq members, for backward compatibility. -- Issue #9803: Don't close IDLE on saving if breakpoint is open. - Patch by Roger Serwy. +- Issue #6157: Fixed tkinter.Text.debug(). tkinter.Text.bbox() now raises + TypeError instead of TclError on wrong number of arguments. Original patch + by Guilherme Polo. -- Issue #14962: Update text coloring in IDLE shell window after changing - options. Patch by Roger Serwy. +- Issue #10197: Rework subprocess.get[status]output to use subprocess + functionality and thus to work on Windows. Patch by Nick Coghlan -Documentation -------------- +- Issue #6160: The bbox() method of tkinter.Spinbox now returns a tuple of + integers instead of a string. Based on patch by Guilherme Polo. -- Issue #15176: Clarified behavior, documentation, and implementation - of os.listdir(). +- Issue #19403: contextlib.redirect_stdout is now reentrant -- Issue #14982: Document that pkgutil's iteration functions require the - non-standard iter_modules() method to be defined by an importer (something - the importlib importers do not define). +- Issue #19286: Directories in ``package_data`` are no longer added to + the filelist, preventing failure outlined in the ticket. -- Issue #15081: Document PyState_FindModule. - Patch by Robin Schreiber. +- Issue #19480: HTMLParser now accepts all valid start-tag names as defined + by the HTML5 standard. -- Issue #14814: Added first draft of ipaddress module API reference +- Issue #15114: The html.parser module now raises a DeprecationWarning when the + strict argument of HTMLParser or the HTMLParser.error method are used. -Tests ------ +- Issue #19410: Undo the special-casing removal of '' for + importlib.machinery.FileFinder. -- Issue #15187: Bugfix: remove temporary directories test_shutil was leaving - behind. +- Issue #19424: Fix the warnings module to accept filename containing surrogate + characters. -- Issue #14769: test_capi now has SkipitemTest, which cleverly checks - for "parity" between PyArg_ParseTuple() and the Python/getargs.c static - function skipitem() for all possible "format units". +- Issue #19435: Fix directory traversal attack on CGIHttpRequestHandler. -- test_nntplib now tolerates being run from behind NNTP gateways that add - "X-Antivirus" headers to articles +- Issue #19227: Remove pthread_atfork() handler. The handler was added to + solve #18747 but has caused issues. -- Issue #15043: test_gdb is now skipped entirely if gdb security settings - block loading of the gdb hooks +- Issue #19420: Fix reference leak in module initalization code of + _hashopenssl.c -- Issue #14963: Add test cases for exception handling behaviour - in contextlib.ExitStack (Initial patch by Alon Horev) +- Issue #19329: Optimized compiling charsets in regular expressions. -Build ------ +- Issue #19227: Try to fix deadlocks caused by re-seeding then OpenSSL + pseudo-random number generator on fork(). -- Issue #13590: Improve support for OS X Xcode 4: - * Try to avoid building Python or extension modules with problematic - llvm-gcc compiler. - * Since Xcode 4 removes ppc support, extension module builds now - check for ppc compiler support and automatically remove ppc and - ppc64 archs when not available. - * Since Xcode 4 no longer install SDKs in default locations, - extension module builds now revert to using installed headers - and libs if the SDK used to build the interpreter is not - available. - * Update ./configure to use better defaults for universal builds; - in particular, --enable-universalsdk=yes uses the Xcode default - SDK and --with-universal-archs now defaults to "intel" if ppc - not available. +- Issue #16037: HTTPMessage.readheaders() raises an HTTPException when more than + 100 headers are read. Adapted from patch by Jyrki Pulliainen. -- Issue #14225: Fix Unicode support for curses (#12567) on OS X +- Issue #16040: CVE-2013-1752: nntplib: Limit maximum line lengths to 2048 to + prevent readline() calls from consuming too much memory. Patch by Jyrki + Pulliainen. -- Issue #14928: Fix importlib bootstrap issues by using a custom executable - (Modules/_freeze_importlib) to build Python/importlib.h. +- Issue #16041: CVE-2013-1752: poplib: Limit maximum line lengths to 2048 to + prevent readline() calls from consuming too much memory. Patch by Jyrki + Pulliainen. +- Issue #17997: Change behavior of ``ssl.match_hostname()`` to follow RFC 6125, + for security reasons. It now doesn't match multiple wildcards nor wildcards + inside IDN fragments. -What's New in Python 3.3.0 Alpha 4? -=================================== +- Issue #16039: CVE-2013-1752: Change use of readline in imaplib module to limit + line length. Patch by Emil Lind. -*Release date: 31-May-2012* +- Issue #19330: the unnecessary wrapper functions have been removed from the + implementations of the new contextlib.redirect_stdout and + contextlib.suppress context managers, which also ensures they provide + reasonable help() output on instances -Core and Builtins ------------------ +- Issue #19393: Fix symtable.symtable function to not be confused when there are + functions or classes named "top". -- Issue #14835: Make plistlib output empty arrays & dicts like OS X. - Patch by Sidney San Martín. +- Issue #18685: Restore re performance to pre-PEP 393 levels. -- Issue #14744: Use the new _PyUnicodeWriter internal API to speed up - str%args and str.format(args). +- Issue #19339: telnetlib module is now using time.monotonic() when available + to compute timeout. -- Issue #14930: Make memoryview objects weakrefable. +- Issue #19399: fix sporadic test_subprocess failure. -- Issue #14775: Fix a potential quadratic dict build-up due to the garbage - collector repeatedly trying to untrack dicts. +- Issue #13234: Fix os.listdir to work with extended paths on Windows. + Patch by Santoso Wijaya. -- Issue #14857: fix regression in references to PEP 3135 implicit __class__ - closure variable (Reopens issue #12370) +- Issue #19375: The site module adding a "site-python" directory to sys.path, + if it exists, is now deprecated. -- Issue #14712 (PEP 405): Virtual environments. Implemented by Vinay Sajip. +- Issue #19379: Lazily import linecache in the warnings module, to make + startup with warnings faster until a warning gets printed. -- Issue #14660 (PEP 420): Namespace packages. Implemented by Eric Smith. +- Issue #19288: Fixed the "in" operator of dbm.gnu databases for string + argument. Original patch by Arfrever Frehtes Taifersar Arahesis. -- Issue #14494: Fix __future__.py and its documentation to note that - absolute imports are the default behavior in 3.0 instead of 2.7. - Patch by Sven Marnach. +- Issue #19287: Fixed the "in" operator of dbm.ndbm databases for string + argument. Original patch by Arfrever Frehtes Taifersar Arahesis. -- Issue #9260: A finer-grained import lock. Most of the import sequence - now uses per-module locks rather than the global import lock, eliminating - well-known issues with threads and imports. +- Issue #19327: Fixed the working of regular expressions with too big charset. -- Issue #14624: UTF-16 decoding is now 3x to 4x faster on various inputs. - Patch by Serhiy Storchaka. +- Issue #17400: New 'is_global' attribute for ipaddress to tell if an address + is allocated by IANA for global or private networks. -- asdl_seq and asdl_int_seq are now Py_ssize_t sized. +- Issue #19350: Increasing the test coverage of macurl2path. Patch by Colin + Williams. -- Issue #14133 (PEP 415): Implement suppression of __context__ display with an - attribute on BaseException. This replaces the original mechanism of PEP 409. +- Issue #19365: Optimized the parsing of long replacement string in re.sub*() + functions. -- Issue #14417: Mutating a dict during lookup now restarts the lookup instead - of raising a RuntimeError (undoes issue #14205). +- Issue #19352: Fix unittest discovery when a module can be reached + through several paths (e.g. under Debian/Ubuntu with virtualenv). -- Issue #14738: Speed-up UTF-8 decoding on non-ASCII data. Patch by Serhiy - Storchaka. +- Issue #15207: Fix mimetypes to read from correct part of Windows registry + Original patch by Dave Chambers -- Issue #14700: Fix two broken and undefined-behaviour-inducing overflow checks - in old-style string formatting. +- Issue #16595: Add prlimit() to resource module. -Library -------- +- Issue #19324: Expose Linux-specific constants in resource module. -- Issue #14690: Use monotonic clock instead of system clock in the sched, - subprocess and trace modules. +- Load SSL's error strings in hashlib. -- Issue #14443: Tell rpmbuild to use the correct version of Python in - bdist_rpm. Initial patch by Ross Lagerwall. +- Issue #18527: Upgrade internal copy of zlib to 1.2.8. -- Issue #12515: email now registers a defect if it gets to EOF while parsing - a MIME part without seeing the closing MIME boundary. +- Issue #19274: Add a filterfunc parameter to PyZipFile.writepy. -- Issue #1672568: email now always decodes base64 payloads, adding padding and - ignoring non-base64-alphabet characters if needed, and registering defects - for any such problems. +- Issue #8964: fix platform._sys_version to handle IronPython 2.6+. + Patch by Martin Matusiak. -- Issue #14925: email now registers a defect when the parser decides that there - is a missing header/body separator line. MalformedHeaderDefect, which the - existing code would never actually generate, is deprecated. +- Issue #19413: Restore pre-3.3 reload() semantics of re-finding modules. -- Issue #10365: File open dialog now works instead of crashing even when - the parent window is closed before the dialog. Patch by Roger Serwy. +- Issue #18958: Improve error message for json.load(s) while passing a string + that starts with a UTF-8 BOM. -- Issue #8739: Updated smtpd to support RFC 5321, and added support for the - RFC 1870 SIZE extension. +- Issue #19307: Improve error message for json.load(s) while passing objects + of the wrong type. -- Issue #665194: Added a localtime function to email.utils to provide an - aware local datetime for use in setting Date headers. +- Issue #16038: CVE-2013-1752: ftplib: Limit amount of data read by + limiting the call to readline(). Original patch by Michał + Jastrzębski and Giampaolo Rodola. -- Issue #12586: Added new provisional policies that implement convenient - unicode support for email headers. See What's New for details. +- Issue #17087: Improved the repr for regular expression match objects. -- Issue #14731: Refactored email Policy framework to support full backward - compatibility with Python 3.2 by default yet allow for the introduction of - new features through new policies. Note that Policy.must_be_7bit is renamed - to cte_type. +Tests +----- -- Issue #14876: Use user-selected font for highlight configuration. +- Issue #19664: test_userdict's repr test no longer depends on the order + of dict elements. -- Issue #14920: Fix the help(urllib.parse) failure on locale C on terminals. - Have ascii characters in help. +- Issue #19440: Clean up test_capi by removing an unnecessary __future__ + import, converting from test_main to unittest.main, and running the + _testcapi module tests as subTests of a unittest TestCase method. -- Issue #14548: Make multiprocessing finalizers check pid before - running to cope with possibility of gc running just after fork. +- Issue #19378: the main dis module tests are now run with both stdout + redirection *and* passing an explicit file parameter -- Issue #14036: Add an additional check to validate that port in urlparse does - not go in illegal range and returns None. +- Issue #19378: removed the not-actually-helpful assertInstructionMatches + and assertBytecodeExactlyMatches helpers from bytecode_helper -- Issue #14862: Add missing names to os.__all__ +- Issue #18702: All skipped tests now reported as skipped. -- Issue #14875: Use float('inf') instead of float('1e66666') in the json module. +- Issue #19439: interpreter embedding tests are now executed on Windows + (Patch by Zachary Ware) -- Issue #13585: Added contextlib.ExitStack +- Issue #19085: Added basic tests for all tkinter widget options. -- PEP 3144, Issue #14814: Added the ipaddress module +- Issue #19384: Fix test_py_compile for root user, patch by Claudiu Popa. -- Issue #14426: Correct the Date format in Expires attribute of Set-Cookie - Header in Cookie.py. +Documentation +------------- -- Issue #14588: The types module now provide new_class() and prepare_class() - functions to support PEP 3115 compliant dynamic class creation. Patch by - Daniel Urban and Nick Coghlan. +- Issue #18326: Clarify that list.sort's arguments are keyword-only. Also, + attempt to reduce confusion in the glossary by not saying there are + different "types" of arguments and parameters. -- Issue #13152: Allow to specify a custom tabsize for expanding tabs in - textwrap. Patch by John Feuerstein. +Build +----- -- Issue #14721: Send the correct 'Content-length: 0' header when the body is an - empty string ''. Initial Patch contributed by Arve Knudsen. +- Issue #19358: "make clinic" now runs the Argument Clinic preprocessor + over all CPython source files. -- Issue #14072: Fix parsing of 'tel' URIs in urlparse by making the check for - ports stricter. +- Update SQLite to 3.8.1, xz to 5.0.5, and Tcl/Tk to 8.6.1 on Windows. -- Issue #9374: Generic parsing of query and fragment portions of url for any - scheme. Supported both by RFC3986 and RFC2396. +- Issue #16632: Enable DEP and ASLR on Windows. -- Issue #14798: Fix the functions in pyclbr to raise an ImportError - when the first part of a dotted name is not a package. Patch by - Xavier de Gaye. +- Issue #17791: Drop PREFIX and EXEC_PREFIX definitions from PC/pyconfig.h -- Issue #12098: multiprocessing on Windows now starts child processes - using the same sys.flags as the current process. Initial patch by - Sergey Mezentsev. +- Add workaround for VS 2010 nmake clean issue. VS 2010 doesn't set up PATH + for nmake.exe correctly. -- Issue #13031: Small speed-up for tarfile when unzipping tarfiles. - Patch by Justin Peel. +- Issue #19550: Implement Windows installer changes of PEP 453 (ensurepip). -- Issue #14780: urllib.request.urlopen() now has a ``cadefault`` argument - to use the default certificate store. Initial patch by James Oakley. +- Issue #19520: Fix compiler warning in the _sha3 module on 32bit Windows. -- Issue #14829: Fix bisect and range() indexing with large indices - (>= 2 ** 32) under 64-bit Windows. +- Issue #19356: Avoid using a C variabled named "_self", it's a reserved + word in some C compilers. -- Issue #14732: The _csv module now uses PEP 3121 module initialization. - Patch by Robin Schreiber. +- Issue #15792: Correct build options on Win64. Patch by Jeremy Kloth. -- Issue #14809: Add HTTP status codes introduced by RFC 6585 to http.server - and http.client. Patch by EungJun Yi. +- Issue #19373: Apply upstream change to Tk 8.5.15 fixing OS X 10.9 + screen refresh problem for OS X installer build. -- Issue #14777: tkinter may return undecoded UTF-8 bytes as a string when - accessing the Tk clipboard. Modify clipboad_get() to first request type - UTF8_STRING when no specific type is requested in an X11 windowing - environment, falling back to the current default type STRING if that fails. - Original patch by Thomas Kluyver. +- Issue #19649: On OS X, the same set of file names are now installed + in bin directories for all configurations: non-framework vs framework, + and single arch vs universal builds. pythonx.y-32 is now always + installed for 64-bit/32-bit universal builds. The obsolete and + undocumented pythonw* symlinks are no longer installed anywhere. -- Issue #14773: Fix os.fwalk() failing on dangling symlinks. +- Issue #19553: PEP 453 - "make install" and "make altinstall" now install or + upgrade pip by default, using the bundled pip provided by the new ensurepip + module. A new configure option, --with-ensurepip[=upgrade|install|no], is + available to override the default ensurepip "--upgrade" option. The option + can also be set with "make [alt]install ENSUREPIP=[upgrade|install\no]". -- Issue #12541: Be lenient with quotes around Realm field of HTTP Basic - Authentation in urllib2. +- Issue #19551: PEP 453 - the OS X installer now installs pip by default. -- Issue #14807: move undocumented tarfile.filemode() to stat.filemode() and add - doc entry. Add tarfile.filemode alias with deprecation warning. +- Update third-party libraries for OS X installers: xz 5.0.3 -> 5.0.5, + SQLite 3.7.13 -> 3.8.1 -- Issue #13815: TarFile.extractfile() now returns io.BufferedReader objects. +- Issue #15663: Revert OS X installer built-in Tcl/Tk support for 3.4.0b1. + Some third-party projects, such as Matplotlib and PIL/Pillow, + depended on being able to build with Tcl and Tk frameworks in + /Library/Frameworks. -- Issue #14532: Add a secure_compare() helper to the hmac module, to mitigate - timing attacks. Patch by Jon Oberheide. +Tools/Demos +----------- -- Add importlib.util.resolve_name(). +- Issue #19730: Argument Clinic now supports all the existing PyArg + "format units" as legacy converters, as well as two new features: + "self converters" and the "version" directive. -- Issue #14366: Support lzma compression in zip files. - Patch by Serhiy Storchaka. +- Issue #19552: pyvenv now bootstraps pip into virtual environments by + default (pass --without-pip to request the old behaviour) -- Issue #13959: Introduce importlib.find_loader() and document - imp.find_module/load_module as deprecated. +- Issue #19390: Argument Clinic no longer accepts malformed Python + and C ids. -- Issue #14082: shutil.copy2() now copies extended attributes, if possible. - Patch by Hynek Schlawack. + -- Issue #13959: Make importlib.abc.FileLoader.load_module()/get_filename() and - importlib.machinery.ExtensionFileLoader.load_module() have their single - argument be optional. Allows for the replacement (and thus deprecation) of - imp.load_source()/load_package()/load_compiled(). +What's New in Python 3.4.0 Alpha 4? +=================================== -- Issue #13959: imp.get_suffixes() has been deprecated in favour of the new - attributes on importlib.machinery: SOURCE_SUFFIXES, DEBUG_BYTECODE_SUFFIXES, - OPTIMIZED_BYTECODE_SUFFIXES, BYTECODE_SUFFIXES, and EXTENSION_SUFFIXES. This - led to an indirect deprecation of inspect.getmoduleinfo(). +Release date: 2013-10-20 -- Issue #14662: Prevent shutil failures on OS X when destination does not - support chflag operations. Patch by Hynek Schlawack. +Core and Builtins +----------------- -- Issue #14157: Fix time.strptime failing without a year on February 29th. - Patch by Hynek Schlawack. +- Issue #19301: Give classes and functions that are explicitly marked global a + global qualname. -- Issue #14753: Make multiprocessing's handling of negative timeouts - the same as it was in Python 3.2. +- Issue #19279: UTF-7 decoder no longer produces illegal strings. -- Issue #14583: Fix importlib bug when a package's __init__.py would first - import one of its modules then raise an error. +- Issue #16612: Add "Argument Clinic", a compile-time preprocessor for + C files to generate argument parsing code. (See PEP 436.) -- Issue #14741: Fix missing support for Ellipsis ('...') in parser module. +- Issue #18810: Shift stat calls in importlib.machinery.FileFinder such that + the code is optimistic that if something exists in a directory named exactly + like the possible package being searched for that it's in actuality a + directory. -- Issue #14697: Fix missing support for set displays and set comprehensions in - parser module. +- Issue #18416: importlib.machinery.PathFinder now treats '' as the cwd and + importlib.machinery.FileFinder no longer special-cases '' to '.'. This leads + to modules imported from cwd to now possess an absolute file path for + __file__ (this does not affect modules specified by path on the CLI but it + does affect -m/runpy). It also allows FileFinder to be more consistent by not + having an edge case. -- Issue #14701: Fix missing support for 'raise ... from' in parser module. +- Issue #4555: All exported C symbols are now prefixed with either + "Py" or "_Py". -- Add support for timeouts to the acquire() methods of - multiprocessing's lock/semaphore/condition proxies. +- Issue #19219: Speed up marshal.loads(), and make pyc files slightly + (5% to 10%) smaller. -- Issue #13989: Add support for text mode to gzip.open(). +- Issue #19221: Upgrade Unicode database to version 6.3.0. -- Issue #14127: The os.stat() result object now provides three additional - fields: st_ctime_ns, st_mtime_ns, and st_atime_ns, providing those times as an - integer with nanosecond resolution. The functions os.utime(), os.lutimes(), - and os.futimes() now accept a new parameter, ns, which accepts mtime and atime - as integers with nanosecond resolution. +- Issue #16742: The result of the C callback PyOS_ReadlineFunctionPointer must + now be a string allocated by PyMem_RawMalloc() or PyMem_RawRealloc() (or NULL + if an error occurred), instead of a string allocated by PyMem_Malloc() or + PyMem_Realloc(). -- Issue #14127 and #10148: shutil.copystat now preserves exact mtime and atime - on filesystems providing nanosecond resolution. +- Issue #19199: Remove ``PyThreadState.tick_counter`` field -IDLE ----- +- Fix macro expansion of _PyErr_OCCURRED(), and make sure to use it in at + least one place so as to avoid regressions. -- Issue #14958: Change IDLE systax highlighting to recognize all string and - byte literals supported in Python 3.3. +- Issue #19087: Improve bytearray allocation in order to allow cheap popping + of data at the front (slice deletion). -- Issue #10997: Prevent a duplicate entry in IDLE's "Recent Files" menu. +- Issue #19014: memoryview.cast() is now allowed on zero-length views. -- Issue #14929: Stop IDLE 3.x from closing on Unicode decode errors when - grepping. Patch by Roger Serwy. +- Issue #18690: memoryview is now automatically registered with + collections.abc.Sequence -- Issue #12510: Attempting to get invalid tooltip no longer closes IDLE. - Other tooltipss have been corrected or improved and the number of tests - has been tripled. Original patch by Roger Serwy. +- Issue #19078: memoryview now correctly supports the reversed builtin + (Patch by Claudiu Popa) -Tools/Demos ------------ +Library +------- -- Issue #14695: Bring Tools/parser/unparse.py support up to date with - the Python 3.3 Grammar. +- Issue #17457: unittest test discovery now works with namespace packages. + Patch by Claudiu Popa. -Build ------ +- Issue #18235: Fix the sysconfig variables LDSHARED and BLDSHARED under AIX. + Patch by David Edelsohn. -- Issue #14472: Update .gitignore. Patch by Matej Cepl. +- Issue #18606: Add the new "statistics" module (PEP 450). Contributed + by Steven D'Aprano. -- Upgrade Windows library versions: bzip 1.0.6, OpenSSL 1.0.1c. +- Issue #12866: The audioop module now supports 24-bit samples. -- Issue #14693: Under non-Windows platforms, hashlib's fallback modules are - always compiled, even if OpenSSL is present at build time. +- Issue #19254: Provide an optimized Python implementation of pbkdf2_hmac. -- Issue #13210: Windows build now uses VS2010, ported from VS2008. +- Issues #19201, Issue #19222, Issue #19223: Add "x" mode (exclusive creation) + in opening file to bz2, gzip and lzma modules. Patches by Tim Heaney and + Vajrasky Kok. -C-API ------ +- Fix a reference count leak in _sre. -- Issue #14705: The PyArg_Parse() family of functions now support the 'p' format - unit, which accepts a "boolean predicate" argument. It converts any Python - value into an integer--0 if it is "false", and 1 otherwise. +- Issue #19262: Initial check in of the 'asyncio' package (a.k.a. Tulip, + a.k.a. PEP 3156). There are no docs yet, and the PEP is slightly + out of date with the code. This module will have *provisional* status + in Python 3.4. -Documentation -------------- +- Issue #19276: Fixed the wave module on 64-bit big-endian platforms. -- Issue #14863: Update the documentation of os.fdopen() to reflect the - fact that it's only a thin wrapper around open() anymore. +- Issue #19266: Rename the new-in-3.4 ``contextlib.ignore`` context manager + to ``contextlib.suppress`` in order to be more consistent with existing + descriptions of that operation elsewhere in the language and standard + library documentation (Patch by Zero Piraeus). -- Issue #14588: The language reference now accurately documents the Python 3 - class definition process. Patch by Nick Coghlan. +- Issue #18891: Completed the new email package (provisional) API additions + by adding new classes EmailMessage, MIMEPart, and ContentManager. -- Issue #14943: Correct a default argument value for winreg.OpenKey - and correctly list the argument names in the function's explanation. +- Issue #18281: Unused stat constants removed from `tarfile`. +- Issue #18999: Multiprocessing now supports 'contexts' with the same API + as the module, but bound to specified start methods. -What's New in Python 3.3.0 Alpha 3? -=================================== +- Issue #18468: The re.split, re.findall, and re.sub functions and the group() + and groups() methods of match object now always return a string or a bytes + object. -*Release date: 01-May-2012* +- Issue #18725: The textwrap module now supports truncating multiline text. -Core and Builtins ------------------ +- Issue #18776: atexit callbacks now display their full traceback when they + raise an exception. -- Issue #14699: Fix calling the classmethod descriptor directly. +- Issue #17827: Add the missing documentation for ``codecs.encode`` and + ``codecs.decode``. -- Issue #14433: Prevent msvcrt crash in interactive prompt when stdin is closed. +- Issue #19218: Rename collections.abc to _collections_abc in order to + speed up interpreter start. -- Issue #14521: Make result of float('nan') and float('-nan') more consistent - across platforms. +- Issue #18582: Add 'pbkdf2_hmac' to the hashlib module. It implements PKCS#5 + password-based key derivation functions with HMAC as pseudorandom function. -- Issue #14646: __import__() sets __loader__ if the loader did not. +- Issue #19131: The aifc module now correctly reads and writes sampwidth of + compressed streams. -- Issue #14605: No longer have implicit entries in sys.meta_path. If - sys.meta_path is found to be empty, raise ImportWarning. +- Issue #19209: Remove import of copyreg from the os module to speed up + interpreter startup. stat_result and statvfs_result are now hard-coded to + reside in the os module. -- Issue #14605: No longer have implicit entries in sys.path_hooks. If - sys.path_hooks is found to be empty, a warning will be raised. None is now - inserted into sys.path_importer_cache if no finder was discovered. This also - means imp.NullImporter is no longer implicitly used. +- Issue #19205: Don't import the 're' module in site and sysconfig module to + speed up interpreter start. -- Issue #13903: Implement PEP 412. Individual dictionary instances can now share - their keys with other dictionaries. Classes take advantage of this to share - their instance dictionary keys for improved memory and performance. +- Issue #9548: Add a minimal "_bootlocale" module that is imported by the + _io module instead of the full locale module. -- Issue #11603 (again): Setting __repr__ to __str__ now raises a RuntimeError - when repr() or str() is called on such an object. +- Issue #18764: remove the 'print' alias for the PDB 'p' command so that it no + longer shadows the print function. -- Issue #14658: Fix binding a special method to a builtin implementation of a - special method with a different name. +- Issue #19158: a rare race in BoundedSemaphore could allow .release() too + often. -- Issue #14630: Fix a memory access bug for instances of a subclass of int - with value 0. +- Issue #15805: Add contextlib.redirect_stdout(). -- Issue #14339: Speed improvements to bin, oct and hex functions. Patch by - Serhiy Storchaka. +- Issue #18716: Deprecate the formatter module. -- Issue #14385: It is now possible to use a custom type for the __builtins__ - namespace, instead of a dict. It can be used for sandboxing for example. - Raise also a NameError instead of ImportError if __build_class__ name if not - found in __builtins__. +- Issue #10712: 2to3 has a new "asserts" fixer that replaces deprecated names + of unittest methods (e.g. failUnlessEqual -> assertEqual). -- Issue #12599: Be more strict in accepting None compared to a false-like - object for importlib.util.module_for_loader and - importlib.machinery.PathFinder. +- Issue #18037: 2to3 now escapes '\u' and '\U' in native strings. -- Issue #14612: Fix jumping around with blocks by setting f_lineno. +- Issue #17839: base64.decodebytes and base64.encodebytes now accept any + object that exports a 1 dimensional array of bytes (this means the same + is now also true for base64_codec) -- Issue #14592: Attempting a relative import w/o __package__ or __name__ set in - globals raises a KeyError. +- Issue #19132: The pprint module now supports compact mode. -- Issue #14607: Fix keyword-only arguments which started with ``__``. +- Issue #19137: The pprint module now correctly formats instances of set and + frozenset subclasses. -- Issue #10854: The ImportError raised when an extension module on Windows - fails to import now uses the new path and name attributes from - Issue #1559549. +- Issue #10042: functools.total_ordering now correctly handles + NotImplemented being returned by the underlying comparison function (Patch + by Katie Miller) -- Issue #13889: Check and (if necessary) set FPU control word before calling - any of the dtoa.c string <-> float conversion functions, on MSVC builds of - Python. This fixes issues when embedding Python in a Delphi app. +- Issue #19092: contextlib.ExitStack now correctly reraises exceptions + from the __exit__ callbacks of inner context managers (Patch by Hrvoje + Nikšić) -- __import__() now matches PEP 328 and documentation by defaulting 'index' to 0 - instead of -1 and removing support for negative values. +- Issue #12641: Avoid passing "-mno-cygwin" to the mingw32 compiler, except + when necessary. Patch by Oscar Benjamin. -- Issue #2377: Make importlib the implementation of __import__(). +- Issue #5845: In site.py, only load readline history from ~/.python_history + if no history has been read already. This avoids double writes to the + history file at shutdown. -- Issue #1559549: ImportError now has 'name' and 'path' attributes that are set - using keyword arguments to its constructor. They are currently not set by - import as they are meant for use by importlib. +- Properly initialize all fields of a SSL object after allocation. -- Issue #14474: Save and restore exception state in thread.start_new_thread() - while writing error message if the thread leaves a unhandled exception. +- Issue #19095: SSLSocket.getpeercert() now raises ValueError when the + SSL handshake hasn't been done. -- Issue #13019: Fix potential reference leaks in bytearray.extend(). Patch - by Suman Saha. +- Issue #4366: Fix building extensions on all platforms when --enable-shared + is used. -Library -------- +- Issue #19030: Fixed `inspect.getmembers` and `inspect.classify_class_attrs` + to attempt activating descriptors before falling back to a __dict__ search + for faulty descriptors. `inspect.classify_class_attrs` no longer returns + Attributes whose home class is None. -- Issue #14768: os.path.expanduser('~/a') doesn't works correctly when HOME is '/'. +C API +----- -- Issue #14371: Support bzip2 in zipfile module. Patch by Serhiy Storchaka. +- Issue #1772673: The type of `char*` arguments now changed to `const char*`. -- Issue #13183: Fix pdb skipping frames after hitting a breakpoint and running - step. Patch by Xavier de Gaye. +- Issue #16129: Added a `Py_SetStandardStreamEncoding` pre-initialization API + to allow embedding applications like Blender to force a particular + encoding and error handler for the standard IO streams (initial patch by + Bastien Montagne) -- Issue #14696: Fix parser module to understand 'nonlocal' declarations. +Tests +----- -- Issue #10941: Fix imaplib.Internaldate2tuple to produce correct result near - the DST transition. Patch by Joe Peterson. +- Issue #19275: Fix test_site on AMD64 Snow Leopard -- Issue #9154: Fix parser module to understand function annotations. +- Issue #14407: Fix unittest test discovery in test_concurrent_futures. -- Issue #6085: In http.server.py SimpleHTTPServer.address_string returns the - client ip address instead client hostname. Patch by Charles-François Natali. +- Issue #18919: Unified and extended tests for audio modules: aifc, sunau and + wave. -- Issue #14309: Deprecate time.clock(), use time.perf_counter() or - time.process_time() instead. +- Issue #18714: Added tests for ``pdb.find_function()``. -- Issue #14428: Implement the PEP 418. Add time.get_clock_info(), - time.perf_counter() and time.process_time() functions, and rename - time.steady() to time.monotonic(). +Documentation +------------- -- Issue #14646: importlib.util.module_for_loader() now sets __loader__ and - __package__ (when possible). +- Issue #18758: Fixed and improved cross-references. -- Issue #14664: It is now possible to use @unittest.skip{If,Unless} on a - test class that doesn't inherit from TestCase (i.e. a mixin). +- Issue #18972: Modernize email examples and use the argparse module in them. -- Issue #4892: multiprocessing Connections can now be transferred over - multiprocessing Connections. Patch by Richard Oudkerk (sbt). +Build +----- -- Issue #14160: TarFile.extractfile() failed to resolve symbolic links when - the links were not located in an archive subdirectory. +- Issue #19130: Correct PCbuild/readme.txt, Python 3.3 and 3.4 require VS 2010. -- Issue #14638: pydoc now treats non-string __name__ values as if they - were missing, instead of raising an error. +- Issue #15663: Update OS X 10.6+ installer to use Tcl/Tk 8.5.15. -- Issue #13684: Fix httplib tunnel issue of infinite loops for certain sites - which send EOF without trailing \r\n. +- Issue #14499: Fix several problems with OS X universal build support: + 1. ppc arch detection for extension module builds broke with Xcode 5 + 2. ppc arch detection in configure did not work on OS X 10.4 + 3. -sysroot and -arch flags were unnecessarily duplicated + 4. there was no obvious way to configure an intel-32 only build. -- Issue #14605: Add importlib.abc.FileLoader, importlib.machinery.(FileFinder, - SourceFileLoader, SourcelessFileLoader, ExtensionFileLoader). +- Issue #19019: Change the OS X installer build script to use CFLAGS instead + of OPT for special build options. By setting OPT, some compiler-specific + options like -fwrapv were overridden and thus not used, which could result + in broken interpreters when building with clang. -- Issue #13959: imp.cache_from_source()/source_from_cache() now follow - os.path.join()/split() semantics for path manipulation instead of its prior, - custom semantics of caring the right-most path separator forward in path - joining. + -- Issue #2193: Allow ":" character in Cookie NAME values. +What's New in Python 3.4.0 Alpha 3? +=================================== -- Issue #14629: tokenizer.detect_encoding will specify the filename in the - SyntaxError exception if found at readline.__self__.name. +Release date: 2013-09-29 -- Issue #14629: Raise SyntaxError in tokenizer.detect_encoding if the - first two lines have non-UTF-8 characters without an encoding declaration. +Core and Builtins +----------------- -- Issue #14308: Fix an exception when a "dummy" thread is in the threading - module's active list after a fork(). +- Issue #18818: The "encodingname" part of PYTHONIOENCODING is now optional. -- Issue #11750: The Windows API functions scattered in the _subprocess and - _multiprocessing.win32 modules now live in a single module "_winapi". - Patch by sbt. +- Issue #19098: Prevent overflow in the compiler when the recursion limit is set + absurdly high. -- Issue #14087: multiprocessing: add Condition.wait_for(). Patch by sbt. +Library +------- -- Issue #14538: HTMLParser can now parse correctly start tags that contain - a bare '/'. +- Issue #18929: `inspect.classify_class_attrs()` now correctly finds class + attributes returned by `dir()` that are located in the metaclass. -- Issue #14452: SysLogHandler no longer inserts a UTF-8 BOM into the message. +- Issue #18950: Fix miscellaneous bugs in the sunau module. + Au_read.readframes() now updates current file position and reads correct + number of frames from multichannel stream. Au_write.writeframesraw() now + correctly updates current file position. Au_read.getnframes() now returns an + integer (as in Python 2). Au_read and Au_write now correctly works with file + object if start file position is not a zero. -- Issue #14386: Expose the dict_proxy internal type as types.MappingProxyType. +- Issue #18594: The fast path for collections.Counter() was never taken + due to an over-restrictive type check. -- Issue #13959: Make imp.reload() always use a module's __loader__ to perform - the reload. +- Issue #19053: ZipExtFile.read1() with non-zero argument no more returns empty + bytes until end of data. -- Issue #13959: Add imp.py and rename the built-in module to _imp, allowing for - re-implementing parts of the module in pure Python. +- logging: added support for Unix domain sockets to SocketHandler and + DatagramHandler. -- Issue #13496: Fix potential overflow in bisect.bisect algorithm when applied - to a collection of size > sys.maxsize / 2. +- Issue #18996: TestCase.assertEqual() now more cleverly shorten differing + strings in error report. -- Have importlib take advantage of ImportError's new 'name' and 'path' - attributes. +- Issue #19034: repr() for tkinter.Tcl_Obj now exposes string reperesentation. -- Issue #14399: zipfile now recognizes that the archive has been modified even - if only the comment is changed. In addition, the TypeError that results from - trying to set a non-binary value as a comment is now raised at the time - the comment is set rather than at the time the zipfile is written. +- Issue #18978: ``urllib.request.Request`` now allows the method to be + indicated on the class and no longer sets it to None in ``__init__``. -- trace.CoverageResults.is_ignored_filename() now ignores any name that starts - with "<" and ends with ">" instead of special-casing "" and - ". - -- Issue #14295: Add unittest.mock - -- Issue #7652: Add --with-system-libmpdec option to configure for linking - the _decimal module against an installed libmpdec. - -- Issue #14380: MIMEText now defaults to utf-8 when passed non-ASCII unicode - with no charset specified. +- Issue #18942: sys._debugmallocstats() output was damaged on Windows. -- Issue #10340: asyncore - properly handle EINVAL in dispatcher constructor on - OSX; avoid to call handle_connect in case of a disconnected socket which - was not meant to connect. +- Issue #18571: Implementation of the PEP 446: file descriptors and file + handles are now created non-inheritable; add functions + os.get/set_inheritable(), os.get/set_handle_inheritable() and + socket.socket.get/set_inheritable(). -- Issue #14204: The ssl module now has support for the Next Protocol - Negotiation extension, if available in the underlying OpenSSL library. - Patch by Colin Marc. +- Issue #11619: The parser and the import machinery do not encode Unicode + filenames anymore on Windows. -- Issue #3035: Unused functions from tkinter are marked as pending deprecated. +- Issue #18808: Non-daemon threads are now automatically joined when + a sub-interpreter is shutdown (it would previously dump a fatal error). -- Issue #12757: Fix the skipping of doctests when python is run with -OO so - that it works in unittest's verbose mode as well as non-verbose mode. +- Remove support for compiling on systems without getcwd(). -- Issue #7652: Integrate the decimal floating point libmpdec library to speed - up the decimal module. Performance gains of the new C implementation are - between 10x and 100x, depending on the application. +- Issue #18774: Remove last bits of GNU PTH thread code and thread_pth.h. -- Issue #14269: SMTPD now conforms to the RFC and requires a HELO command - before MAIL, RCPT, or DATA. +- Issue #18771: Add optimization to set object lookups to reduce the cost + of hash collisions. The core idea is to inspect a second key/hash pair + for each cache line retrieved. -- Issue #13694: asynchronous connect in asyncore.dispatcher does not set addr - attribute. +- Issue #16105: When a signal handler fails to write to the file descriptor + registered with ``signal.set_wakeup_fd()``, report an exception instead + of ignoring the error. -- Issue #14344: fixed the repr of email.policy objects. +- Issue #18722: Remove uses of the "register" keyword in C code. -- Issue #11686: Added missing entries to email package __all__ lists - (mostly the new Bytes classes). +- Issue #18667: Add missing "HAVE_FCHOWNAT" symbol to posix._have_functions. -- Issue #14335: multiprocessing's custom Pickler subclass now inherits from - the C-accelerated implementation. Patch by sbt. +- Issue #16499: Add command line option for isolated mode. -- Issue #10484: Fix the CGIHTTPServer's PATH_INFO handling problem. +- Issue #15301: Parsing fd, uid, and gid parameters for builtins + in Modules/posixmodule.c is now far more robust. -- Issue #11199: Fix the with urllib which hangs on particular ftp urls. +- Issue #18368: PyOS_StdioReadline() no longer leaks memory when realloc() + fail. -- Improve the memory utilization and speed of functools.lru_cache. +- Issue #17934: Add a clear() method to frame objects, to help clean up + expensive details (local variables) and break reference cycles. -- Issue #14222: Use the new time.steady() function instead of time.time() for - timeout in queue and threading modules to not be affected of system time - update. +- Issue #18780: %-formatting codes %d, %i, and %u now treat int-subclasses + as int (displays value of int-subclass instead of str(int-subclass) ). -- Issue #13248: Remove lib2to3.pytree.Base.get_prefix/set_prefix. +Library +------- -- Issue #14234: CVE-2012-0876: Randomize hashes of xml attributes in the hash - table internal to the pyexpat module's copy of the expat library to avoid a - denial of service due to hash collisions. Patch by David Malcolm with some - modifications by the expat project. +- Issue #18808: Thread.join() now waits for the underlying thread state to + be destroyed before returning. This prevents unpredictable aborts in + Py_EndInterpreter() when some non-daemon threads are still running. -- Issue #12818: format address no longer needlessly \ escapes ()s in names when - the name ends up being quoted. +- Issue #18458: Prevent crashes with newer versions of libedit. Its readline + emulation has changed from 0-based indexing to 1-based like gnu readline. -- Issue #14062: BytesGenerator now correctly folds Header objects, - including using linesep when folding. +- Issue #18852: Handle case of ``readline.__doc__`` being ``None`` in the new + readline activation code in ``site.py``. -- Issue #13839: When invoked on the command-line, the pstats module now - accepts several filenames of profile stat files and merges them all. - Patch by Matt Joiner. +- Issue #18672: Fixed format specifiers for Py_ssize_t in debugging output in + the _sre module. -- Issue #14291: Email now defaults to utf-8 for non-ASCII unicode headers - instead of raising an error. This fixes a regression relative to 2.7. +- Issue #18830: inspect.getclasstree() no longer produces duplicate entries even + when input list contains duplicates. -- Issue #989712: Support using Tk without a mainloop. +- Issue #18878: sunau.open now supports the context management protocol. Based on + patches by Claudiu Popa and R. David Murray. -- Issue #3835: Refuse to use unthreaded Tcl in threaded Python. +- Issue #18909: Fix _tkinter.tkapp.interpaddr() on Windows 64-bit, don't cast + 64-bit pointer to long (32 bits). -- Issue #2843: Add new Tk API to Tkinter. +- Issue #18876: The FileIO.mode attribute now better reflects the actual mode + under which the file was opened. Patch by Erik Bray. -- Issue #14184: Increase the default stack size for secondary threads on - Mac OS X to avoid interpreter crashes when using threads on 10.7. +- Issue #16853: Add new selectors module. -- Issue #14180: datetime.date.fromtimestamp(), - datetime.datetime.fromtimestamp() and datetime.datetime.utcfromtimestamp() - now raise an OSError instead of ValueError if localtime() or gmtime() failed. +- Issue #18882: Add threading.main_thread() function. -- Issue #14180: time.ctime(), gmtime(), time.localtime(), - datetime.date.fromtimestamp(), datetime.datetime.fromtimestamp() and - datetime.datetime.utcfromtimestamp() now raises an OverflowError, instead of - a ValueError, if the timestamp does not fit in time_t. +- Issue #18901: The sunau getparams method now returns a namedtuple rather than + a plain tuple. Patch by Claudiu Popa. -- Issue #14180: datetime.datetime.fromtimestamp() and - datetime.datetime.utcfromtimestamp() now round microseconds towards zero - instead of rounding to nearest with ties going away from zero. +- Issue #17487: The result of the wave getparams method now is pickleable again. + Patch by Claudiu Popa. -- Issue #10543: Fix unittest test discovery with Jython bytecode files. +- Issue #18756: os.urandom() now uses a lazily-opened persistent file + descriptor, so as to avoid using many file descriptors when run in + parallel from multiple threads. -- Issue #1178863: Separate initialisation from setting when initializing - Tkinter.Variables; harmonize exceptions to ValueError; only delete variables - that have not been deleted; assert that variable names are strings. +- Issue #18418: After fork(), reinit all threads states, not only active ones. + Patch by A. Jesse Jiryu Davis. -- Issue #14104: Implement time.monotonic() on Mac OS X, patch written by - Nicholas Riley. +- Issue #17974: Switch unittest from using getopt to using argparse. -- Issue #13394: the aifc module now uses warnings.warn() to signal warnings. +- Issue #11798: TestSuite now drops references to own tests after execution. -- Issue #14252: Fix subprocess.Popen.terminate() to not raise an error under - Windows when the child process has already exited. +- Issue #16611: http.cookie now correctly parses the 'secure' and 'httponly' + cookie flags. -- Issue #14223: curses.addch() is no more limited to the range 0-255 when the - Python curses is not linked to libncursesw. It was a regression introduced - in Python 3.3a1. +- Issue #11973: Fix a problem in kevent. The flags and fflags fields are now + properly handled as unsigned. -- Issue #14168: Check for presence of Element._attrs in minidom before - accessing it. +- Issue #18807: ``pyvenv`` now takes a --copies argument allowing copies + instead of symlinks even where symlinks are available and the default. -- Issue #12328: Fix multiprocessing's use of overlapped I/O on Windows. - Also, add a multiprocessing.connection.wait(rlist, timeout=None) function - for polling multiple objects at once. Patch by sbt. +- Issue #18538: ``python -m dis`` now uses argparse for argument processing. + Patch by Michele Orrù. -- Issue #14007: Accept incomplete TreeBuilder objects (missing start, end, - data or close method) for the Python implementation as well. - Drop the no-op TreeBuilder().xml() method from the C implementation. +- Issue #18394: Close cgi.FieldStorage's optional file. -- Issue #14210: pdb now has tab-completion not only for command names, but - also for their arguments, wherever possible. +- Issue #17702: On error, os.environb now suppresses the exception context + when raising a new KeyError with the original key. -- Issue #14310: Sockets can now be with other processes on Windows using - the api socket.socket.share() and socket.fromshare(). +- Issue #16809: Fixed some tkinter incompabilities with Tcl/Tk 8.6. -- Issue #10576: The gc module now has a 'callbacks' member that will get - called when garbage collection takes place. +- Issue #16809: Tkinter's splitlist() and split() methods now accept Tcl_Obj + argument. -Build ------ +- Issue #18324: set_payload now correctly handles binary input. This also + supersedes the previous fixes for #14360, #1717, and #16564. -- Issue #14557: Fix extensions build on HP-UX. Patch by Adi Roiban. +- Issue #18794: Add a fileno() method and a closed attribute to select.devpoll + objects. -- Issue #14387: Do not include accu.h from Python.h. +- Issue #17119: Fixed integer overflows when processing large strings and tuples + in the tkinter module. -- Issue #14359: Only use O_CLOEXEC in _posixmodule.c if it is defined. - Based on patch from Hervé Coatanhay. +- Issue #18747: Re-seed OpenSSL's pseudo-random number generator after fork. + A pthread_atfork() parent handler is used to seed the PRNG with pid, time + and some stack data. -- Issue #14321: Do not run pgen during the build if files are up to date. +- Issue #8865: Concurrent invocation of select.poll.poll() now raises a + RuntimeError exception. Patch by Christian Schubert. -Documentation -------------- +- Issue #18777: The ssl module now uses the new CRYPTO_THREADID API of + OpenSSL 1.0.0+ instead of the deprecated CRYPTO id callback function. -- Issue #14034: added the argparse tutorial. +- Issue #18768: Correct doc string of RAND_edg(). Patch by Vajrasky Kok. -- Issue #14324: Fix configure tests for cross builds. +- Issue #18178: Fix ctypes on BSD. dlmalloc.c was compiled twice which broke + malloc weak symbols. -- Issue #14327: Call AC_CANONICAL_HOST in configure.ac and check in - config.{guess,sub}. Don't use uname calls for cross builds. +- Issue #18709: Fix CVE-2013-4238. The SSL module now handles NULL bytes + inside subjectAltName correctly. Formerly the module has used OpenSSL's + GENERAL_NAME_print() function to get the string represention of ASN.1 + strings for ``rfc822Name`` (email), ``dNSName`` (DNS) and + ``uniformResourceIdentifier`` (URI). -Extension Modules ------------------ +- Issue #18701: Remove support of old CPython versions (<3.0) from C code. -- Issue #9041: An issue in ctypes.c_longdouble, ctypes.c_double, and - ctypes.c_float that caused an incorrect exception to be returned in the - case of overflow has been fixed. +- Issue #18756: Improve error reporting in os.urandom() when the failure + is due to something else than /dev/urandom not existing (for example, + exhausting the file descriptor limit). -- Issue #14212: The re module didn't retain a reference to buffers it was - scanning, resulting in segfaults. +- Issue #18673: Add O_TMPFILE to os module. O_TMPFILE requires Linux kernel + 3.11 or newer. It's only defined on system with 3.11 uapi headers, too. -- Issue #14259: The finditer() method of re objects did not take any - keyword arguments, contrary to the documentation. +- Issue #18532: Change the builtin hash algorithms' names to lower case names + as promised by hashlib's documentation. -- Issue #10142: Support for SEEK_HOLE/SEEK_DATA (for example, under ZFS). +- Issue #8713: add new spwan and forkserver start methods, and new functions + get_all_start_methods, get_start_method, and set_start_method, to + multiprocessing. -Tests ------ +- Issue #18405: Improve the entropy of crypt.mksalt(). -- Issue #14442: Add missing errno import in test_smtplib. +- Issue #12015: The tempfile module now uses a suffix of 8 random characters + instead of 6, to reduce the risk of filename collision. The entropy was + reduced when uppercase letters were removed from the charset used to generate + random characters. -- Issue #8315: (partial fix) python -m unittest test.test_email now works. +- Issue #18585: Add :func:`textwrap.shorten` to collapse and truncate a + piece of text to a given length. +- Issue #18598: Tweak exception message for importlib.import_module() to + include the module name when a key argument is missing. -What's New in Python 3.3.0 Alpha 1? -=================================== +- Issue #19151: Fix docstring and use of _get_supported_file_loaders() to + reflect 2-tuples. -*Release date: 05-Mar-2012* +- Issue #19152: Add ExtensionFileLoader.get_filename(). -Core and Builtins ------------------ +- Issue #18676: Change 'positive' to 'non-negative' in queue.py put and get + docstrings and ValueError messages. Patch by Zhongyue Luo -- Issue #14172: Fix reference leak when marshalling a buffer-like object - (other than a bytes object). +- Fix refcounting issue with extension types in tkinter. -- Issue #13521: dict.setdefault() now does only one lookup for the given key, - making it "atomic" for many purposes. Patch by Filip Gruszczyński. +- Issue #8112: xlmrpc.server's DocXMLRPCServer server no longer raises an error + if methods have annotations; it now correctly displays the annotations. -- PEP 409, Issue #6210: "raise X from None" is now supported as a means of - suppressing the display of the chained exception context. The chained - context still remains available as the __context__ attribute. +- Issue #18600: Added policy argument to email.message.Message.as_string, + and as_bytes and __bytes__ methods to Message. -- Issue #10181: New memoryview implementation fixes multiple ownership - and lifetime issues of dynamically allocated Py_buffer members (#9990) - as well as crashes (#8305, #7433). Many new features have been added - (See whatsnew/3.3), and the documentation has been updated extensively. - The ndarray test object from _testbuffer.c implements all aspects of - PEP-3118, so further development towards the complete implementation - of the PEP can proceed in a test-driven manner. +- Issue #18671: Output more information when logging exceptions occur. - Thanks to Nick Coghlan, Antoine Pitrou and Pauli Virtanen for review - and many ideas. +- Issue #18621: Prevent the site module's patched builtins from keeping + too many references alive for too long. -- Issue #12834: Fix incorrect results of memoryview.tobytes() for - non-contiguous arrays. +- Issue #4885: Add weakref support to mmap objects. Patch by Valerie Lambert. -- Issue #5231: Introduce memoryview.cast() method that allows changing - format and shape without making a copy of the underlying memory. +- Issue #8860: Fixed rounding in timedelta constructor. -- Issue #14084: Fix a file descriptor leak when importing a module with a - bad encoding. +- Issue #18849: Fixed a Windows-specific tempfile bug where collision with an + existing directory caused mkstemp and related APIs to fail instead of + retrying. Report and fix by Vlad Shcherbina. -- Upgrade Unicode data to Unicode 6.1. +- Issue #18920: argparse's default destination for the version action (-v, + --version) has also been changed to stdout, to match the Python executable. -- Issue #14040: Remove rarely used file name suffixes for C extensions - (under POSIX mainly). +Tests +----- -- Issue #14051: Allow arbitrary attributes to be set of classmethod and - staticmethod. +- Issue #18623: Factor out the _SuppressCoreFiles context manager into + test.support. Patch by Valerie Lambert. -- Issue #13703: oCERT-2011-003: Randomize hashes of str and bytes to protect - against denial of service attacks due to hash collisions within the dict and - set types. Patch by David Malcolm, based on work by Victor Stinner. +- Issue #12037: Fix test_email for desktop Windows. -- Issue #13020: Fix a reference leak when allocating a structsequence object - fails. Patch by Suman Saha. +- Issue #15507: test_subprocess's test_send_signal could fail if the test + runner were run in an environment where the process inherited an ignore + setting for SIGINT. Restore the SIGINT handler to the desired + KeyboardInterrupt raising one during that test. -- Issue #13908: Ready types returned from PyType_FromSpec. +- Issue #16799: Switched from getopt to argparse style in regrtest's argument + parsing. Added more tests for regrtest's argument parsing. -- Issue #11235: Fix OverflowError when trying to import a source file whose - modification time doesn't fit in a 32-bit timestamp. +- Issue #18792: Use "127.0.0.1" or "::1" instead of "localhost" as much as + possible, since "localhost" goes through a DNS lookup under recent Windows + versions. -- Issue #12705: A SyntaxError exception is now raised when attempting to - compile multiple statements as a single interactive statement. +IDLE +---- -- Fix the builtin module initialization code to store the init function for - future reinitialization. +- Issue #18489: Add tests for SearchEngine. Original patch by Phil Webster. -- Issue #8052: The posix subprocess module would take a long time closing - all possible file descriptors in the child process rather than just open - file descriptors. It now closes only the open fds if possible for the - default close_fds=True behavior. +Documentation +------------- -- Issue #13629: Renumber the tokens in token.h so that they match the indexes - into _PyParser_TokenNames. +- Issue #18743: Fix references to non-existant "StringIO" module. -- Issue #13752: Add a casefold() method to str. +- Issue #18783: Removed existing mentions of Python long type in docstrings, + error messages and comments. -- Issue #13761: Add a "flush" keyword argument to the print() function, - used to ensure flushing the output stream. +Build +----- -- Issue #13645: pyc files now contain the size of the corresponding source - code, to avoid timestamp collisions (especially on filesystems with a low - timestamp resolution) when checking for freshness of the bytecode. +- Issue #1584: Provide configure options to override default search paths for + Tcl and Tk when building _tkinter. -- PEP 380, Issue #11682: Add "yield from " to support easy delegation to - subgenerators (initial patch by Greg Ewing, integration into 3.3 by - Renaud Blanch, Ryan Kelly, Zbigniew Jędrzejewski-Szmek and Nick Coghlan) +- Issue #15663: Tcl/Tk 8.5.14 is now included with the OS X 10.6+ 64-/32-bit + installer. It is no longer necessary to install a third-party version of + Tcl/Tk 8.5 to work around the problems in the Apple-supplied Tcl/Tk 8.5 + shipped in OS X 10.6 and later releases. -- Issue #13748: Raw bytes literals can now be written with the ``rb`` prefix - as well as ``br``. +Tools/Demos +----------- -- Issue #12736: Use full unicode case mappings for upper, lower, and title case. +- Issue #18922: Now The Lib/smtpd.py and Tools/i18n/msgfmt.py scripts write + their version strings to stdout, and not to sderr. -- Issue #12760: Add a create mode to open(). Patch by David Townshend. + -- Issue #13738: Simplify implementation of bytes.lower() and bytes.upper(). +What's New in Python 3.4.0 Alpha 1? +=================================== -- Issue #13577: Built-in methods and functions now have a __qualname__. - Patch by sbt. +Release date: 2013-08-03 -- Issue #6695: Full garbage collection runs now clear the freelist of set - objects. Initial patch by Matthias Troffaes. +Core and Builtins +----------------- -- Fix OSError.__init__ and OSError.__new__ so that each of them can be - overriden and take additional arguments (followup to issue #12555). +- Issue #16741: Fix an error reporting in int(). -- Fix the fix for issue #12149: it was incorrect, although it had the side - effect of appearing to resolve the issue. Thanks to Mark Shannon for - noticing. +- Issue #17899: Fix rare file descriptor leak in os.listdir(). -- Issue #13505: Pickle bytes objects in a way that is compatible with - Python 2 when using protocols <= 2. +- Issue #10241: Clear extension module dict copies at interpreter shutdown. + Patch by Neil Schemenauer, minimally modified. -- Issue #11147: Fix an unused argument in _Py_ANNOTATE_MEMORY_ORDER. (Fix - given by Campbell Barton). +- Issue #9035: ismount now recognises volumes mounted below a drive root + on Windows. Original patch by Atsuo Ishimoto. -- Issue #13503: Use a more efficient reduction format for bytearrays with - pickle protocol >= 3. The old reduction format is kept with older protocols - in order to allow unpickling under Python 2. Patch by Irmen de Jong. +- Issue #18214: Improve finalization of Python modules to avoid setting + their globals to None, in most cases. -- Issue #7111: Python can now be run without a stdin, stdout or stderr - stream. It was already the case with Python 2. However, the corresponding - sys module entries are now set to None (instead of an unusable file object). +- Issue #18112: PEP 442 implementation (safe object finalization). -- Issue #11849: Ensure that free()d memory arenas are really released - on POSIX systems supporting anonymous memory mappings. Patch by - Charles-François Natali. +- Issue #18552: Check return value of PyArena_AddPyObject() in + obj2ast_object(). -- PEP 3155 / issue #13448: Qualified name for classes and functions. +- Issue #18560: Fix potential NULL pointer dereference in sum(). -- Issue #13436: Fix a bogus error message when an AST object was passed - an invalid integer value. +- Issue #18520: Add a new PyStructSequence_InitType2() function, same than + PyStructSequence_InitType() except that it has a return value (0 on success, + -1 on error). -- Issue #13411: memoryview objects are now hashable when the underlying - object is hashable. +- Issue #15905: Fix theoretical buffer overflow in handling of sys.argv[0], + prefix and exec_prefix if the operation system does not obey MAXPATHLEN. -- Issue #13338: Handle all enumerations in _Py_ANNOTATE_MEMORY_ORDER - to allow compiling extension modules with -Wswitch-enum on gcc. - Initial patch by Floris Bruynooghe. +- Issue #18408: Fix many various bugs in code handling errors, especially + on memory allocation failure (MemoryError). -- Issue #10227: Add an allocation cache for a single slice object. Patch by - Stefan Behnel. +- Issue #18344: Fix potential ref-leaks in _bufferedreader_read_all(). -- Issue #13393: BufferedReader.read1() now asks the full requested size to - the raw stream instead of limiting itself to the buffer size. +- Issue #18342: Use the repr of a module name when an import fails when using + ``from ... import ...``. -- Issue #13392: Writing a pyc file should now be atomic under Windows as well. +- Issue #17872: Fix a segfault in marshal.load() when input stream returns + more bytes than requested. -- Issue #13333: The UTF-7 decoder now accepts lone surrogates (the encoder - already accepts them). +- Issue #18338: `python --version` now prints version string to stdout, and + not to stderr. Patch by Berker Peksag and Michael Dickens. -- Issue #13389: Full garbage collection passes now clear the freelists for - list and dict objects. They already cleared other freelists in the - interpreter. +- Issue #18426: Fix NULL pointer dereference in C extension import when + PyModule_GetDef() returns an error. -- Issue #13327: Remove the need for an explicit None as the second argument - to os.utime, os.lutimes, os.futimes, os.futimens, os.futimesat, in - order to update to the current time. Also added keyword argument - handling to os.utimensat in order to remove the need for explicit None. +- Issue #17206: On Windows, increase the stack size from 2 MB to 4.2 MB to fix + a stack overflow in the marshal module (fix a crash in test_marshal). + Patch written by Jeremy Kloth. -- Issue #13350: Simplify some C code by replacing most usages of - PyUnicode_Format by PyUnicode_FromFormat. +- Issue #3329: Implement the PEP 445: Add new APIs to customize Python memory + allocators. -- Issue #13342: input() used to ignore sys.stdin's and sys.stdout's unicode - error handler in interactive mode (when calling into PyOS_Readline()). +- Issue #18328: Reorder ops in PyThreadState_Delete*() functions. Now the + tstate is first removed from TLS and then deallocated. -- Issue #9896: Add start, stop, and step attributes to range objects. +- Issue #13483: Use VirtualAlloc in obmalloc on Windows. -- Issue #13343: Fix a SystemError when a lambda expression uses a global - variable in the default value of a keyword-only argument: ``lambda *, - arg=GLOBAL_NAME: None`` +- Issue #18184: PyUnicode_FromFormat() and PyUnicode_FromFormatV() now raise + OverflowError when an argument of %c format is out of range. -- Issue #12797: Added custom opener parameter to builtin open() and - FileIO.open(). +- Issue #18111: The min() and max() functions now support a default argument + to be returned instead of raising a ValueError on an empty sequence. + (Contributed by Julian Berman.) -- Issue #10519: Avoid unnecessary recursive function calls in - setobject.c. +- Issue #18137: Detect integer overflow on precision in float.__format__() + and complex.__format__(). -- Issue #10363: Deallocate global locks in Py_Finalize(). +- Issue #18183: Fix various unicode operations on strings with large unicode + codepoints. -- Issue #13018: Fix reference leaks in error paths in dictobject.c. - Patch by Suman Saha. +- Issue #18180: Fix ref leak in _PyImport_GetDynLoadWindows(). -- Issue #13201: Define '==' and '!=' to compare range objects based on - the sequence of values they define (instead of comparing based on - object identity). +- Issue #18038: SyntaxError raised during compilation sources with illegal + encoding now always contains an encoding name. -- Issue #1294232: In a few cases involving metaclass inheritance, the - interpreter would sometimes invoke the wrong metaclass when building a new - class object. These cases now behave correctly. Patch by Daniel Urban. +- Issue #17931: Resolve confusion on Windows between pids and process + handles. -- Issue #12753: Add support for Unicode name aliases and named sequences. - Both ``unicodedata.lookup()`` and '\N{...}' now resolve aliases, - and ``unicodedata.lookup()`` resolves named sequences too. +- Tweak the exception message when the magic number or size value in a bytecode + file is truncated. -- Issue #12170: The count(), find(), rfind(), index() and rindex() methods - of bytes and bytearray objects now accept an integer between 0 and 255 - as their first argument. Patch by Petri Lehtinen. +- Issue #17932: Fix an integer overflow issue on Windows 64-bit in iterators: + change the C type of seqiterobject.it_index from long to Py_ssize_t. -- Issue #12604: VTRACE macro expanded to no-op in _sre.c to avoid compiler - warnings. Patch by Josh Triplett and Petri Lehtinen. +- Issue #18065: Don't set __path__ to the package name for frozen packages. -- Issue #12281: Rewrite the MBCS codec to handle correctly replace and ignore - error handlers on all Windows versions. The MBCS codec is now supporting all - error handlers, instead of only replace to encode and ignore to decode. +- Issue #18088: When reloading a module, unconditionally reset all relevant + attributes on the module (e.g. __name__, __loader__, __package__, __file__, + __cached__). -- Issue #13188: When called without an explicit traceback argument, - generator.throw() now gets the traceback from the passed exception's - ``__traceback__`` attribute. Patch by Petri Lehtinen. +- Issue #17937: Try harder to collect cyclic garbage at shutdown. -- Issue #13146: Writing a pyc file is now atomic under POSIX. +- Issue #12370: Prevent class bodies from interfering with the __class__ + closure. -- Issue #7833: Extension modules built using distutils on Windows will no - longer include a "manifest" to prevent them failing at import time in some - embedded situations. +- Issue #17644: Fix a crash in str.format when curly braces are used in square + brackets. -- PEP 3151 / issue #12555: reworking the OS and IO exception hierarchy. +- Issue #17237: Fix crash in the ASCII decoder on m68k. -- Add internal API for static strings (_Py_identifier et al.). +- Issue #17927: Frame objects kept arguments alive if they had been + copied into a cell, even if the cell was cleared. -- Issue #13063: the Windows error ERROR_NO_DATA (numbered 232 and described - as "The pipe is being closed") is now mapped to POSIX errno EPIPE - (previously EINVAL). +- Issue #1545463: At shutdown, defer finalization of codec modules so + that stderr remains usable. -- Issue #12911: Fix memory consumption when calculating the repr() of huge - tuples or lists. +- Issue #7330: Implement width and precision (ex: "%5.3s") for the format + string of PyUnicode_FromFormat() function, original patch written by Ysj Ray. -- PEP 393: flexible string representation. Thanks to Torsten Becker for the - initial implementation, and Victor Stinner for various bug fixes. +- Issue #1545463: Global variables caught in reference cycles are now + garbage-collected at shutdown. -- Issue #14081: The 'sep' and 'maxsplit' parameter to str.split, bytes.split, - and bytearray.split may now be passed as keyword arguments. +- Issue #17094: Clear stale thread states after fork(). Note that this + is a potentially disruptive change since it may release some system + resources which would otherwise remain perpetually alive (e.g. database + connections kept in thread-local storage). -- Issue #13012: The 'keepends' parameter to str.splitlines may now be passed - as a keyword argument: "my_string.splitlines(keepends=True)". The same - change also applies to bytes.splitlines and bytearray.splitlines. +- Issue #17408: Avoid using an obsolete instance of the copyreg module when + the interpreter is shutdown and then started again. -- Issue #7732: Don't open a directory as a file anymore while importing a - module. Ignore the direcotry if its name matchs the module name (e.g. - "__init__.py") and raise a ImportError instead. +- Issue #5845: Enable tab-completion in the interactive interpreter by + default, thanks to a new sys.__interactivehook__. -- Issue #13021: Missing decref on an error path. Thanks to Suman Saha for - finding the bug and providing a patch. +- Issue #17115,17116: Module initialization now includes setting __package__ and + __loader__ attributes to None. -- Issue #12973: Fix overflow checks that relied on undefined behaviour in - list_repeat (listobject.c) and islice_next (itertoolsmodule.c). These bugs - caused test failures with recent versions of Clang. +- Issue #17853: Ensure locals of a class that shadow free variables always win + over the closures. -- Issue #12904: os.utime, os.futimes, os.lutimes, and os.futimesat now write - atime and mtime with nanosecond precision on modern POSIX platforms. +- Issue #17863: In the interactive console, don't loop forever if the encoding + can't be fetched from stdin. -- Issue #12802: the Windows error ERROR_DIRECTORY (numbered 267) is now - mapped to POSIX errno ENOTDIR (previously EINVAL). +- Issue #17867: Raise an ImportError if __import__ is not found in __builtins__. -- Issue #9200: The str.is* methods now work with strings that contain non-BMP - characters even in narrow Unicode builds. +- Issue #18698: Ensure importlib.reload() returns the module out of sys.modules. -- Issue #12791: Break reference cycles early when a generator exits with - an exception. +- Issue #17857: Prevent build failures with pre-3.5.0 versions of sqlite3, + such as was shipped with Centos 5 and Mac OS X 10.4. -- Issue #12773: Make __doc__ mutable on user-defined classes. +- Issue #17413: sys.settrace callbacks were being passed a string instead of an + exception instance for the 'value' element of the arg tuple if the exception + originated from C code; now an exception instance is always provided. -- Issue #12766: Raise a ValueError when creating a class with a class variable - that conflicts with a name in __slots__. +- Issue #17782: Fix undefined behaviour on platforms where + ``struct timespec``'s "tv_nsec" member is not a C long. -- Issue #12266: Fix str.capitalize() to correctly uppercase/lowercase - titlecased and cased non-letter characters. +- Issue #17722: When looking up __round__, resolve descriptors. -- Issue #12732: In narrow unicode builds, allow Unicode identifiers which fall - outside the BMP. +- Issue #16061: Speed up str.replace() for replacing 1-character strings. -- Issue #12575: Validate user-generated AST before it is compiled. +- Issue #17715: Fix segmentation fault from raising an exception in a __trunc__ + method. -- Make type(None), type(Ellipsis), and type(NotImplemented) callable. They - return the respective singleton instances. +- Issue #17643: Add __callback__ attribute to weakref.ref. -- Forbid summing bytes with sum(). +- Issue #16447: Fixed potential segmentation fault when setting __name__ on a + class. -- Verify the types of AST strings and identifiers provided by the user before - compiling them. +- Issue #17669: Fix crash involving finalization of generators using yield from. -- Issue #12647: The None object now has a __bool__() method that returns False. - Formerly, bool(None) returned False only because of special case logic - in PyObject_IsTrue(). +- Issue #14439: Python now prints the traceback on runpy failure at startup. -- Issue #12579: str.format_map() now raises a ValueError if used on a - format string that contains positional fields. Initial patch by - Julian Berman. +- Issue #17469: Fix _Py_GetAllocatedBlocks() and sys.getallocatedblocks() + when running on valgrind. -- Issue #10271: Allow warnings.showwarning() be any callable. +- Issue #17619: Make input() check for Ctrl-C correctly on Windows. -- Issue #11627: Fix segfault when __new__ on a exception returns a - non-exception class. +- Issue #17357: Add missing verbosity messages for -v/-vv that were lost during + the importlib transition. -- Issue #12149: Update the method cache after a type's dictionary gets - cleared by the garbage collector. This fixes a segfault when an instance - and its type get caught in a reference cycle, and the instance's - deallocator calls one of the methods on the type (e.g. when subclassing - IOBase). Diagnosis and patch by Davide Rizzo. +- Issue #17610: Don't rely on non-standard behavior of the C qsort() function. -- Issue #9611, Issue #9015: FileIO.read() clamps the length to INT_MAX on Windows. +- Issue #17323: The "[X refs, Y blocks]" printed by debug builds has been + disabled by default. It can be re-enabled with the `-X showrefcount` option. -- Issue #9642: Uniformize the tests on the availability of the mbcs codec, add - a new HAVE_MBCS define. +- Issue #17328: Fix possible refleak in dict.setdefault. -- Issue #9642: Fix filesystem encoding initialization: use the ANSI code page - on Windows if the mbcs codec is not available, and fail with a fatal error if - we cannot get the locale encoding (if nl_langinfo(CODESET) is not available) - instead of using UTF-8. +- Issue #17275: Corrected class name in init error messages of the C version of + BufferedWriter and BufferedRandom. -- When a generator yields, do not retain the caller's exception state on the - generator. +- Issue #7963: Fixed misleading error message that issued when object is + called without arguments. -- Issue #12475: Prevent generators from leaking their exception state into the - caller's frame as they return for the last time. +- Issue #8745: Small speed up zipimport on Windows. Patch by Catalin Iacob. -- Issue #12291: You can now load multiple marshalled objects from a stream, - with other data interleaved between marshalled objects. +- Issue #5308: Raise ValueError when marshalling too large object (a sequence + with size >= 2**31), instead of producing illegal marshal data. -- Issue #12356: When required positional or keyword-only arguments are not - given, produce a informative error message which includes the name(s) of the - missing arguments. +- Issue #12983: Bytes literals with invalid \x escape now raise a SyntaxError + and a full traceback including line number. -- Issue #12370: Fix super with no arguments when __class__ is overriden in the - class body. +- Issue #16967: In function definition, evaluate positional defaults before + keyword-only defaults. -- Issue #12084: os.stat on Windows now works properly with relative symbolic - links when called from any directory. +- Issue #17173: Remove uses of locale-dependent C functions (isalpha() etc.) + in the interpreter. -- Loosen type restrictions on the __dir__ method. __dir__ can now return any - sequence, which will be converted to a list and sorted by dir(). +- Issue #17137: When an Unicode string is resized, the internal wide character + string (wstr) format is now cleared. -- Issue #12265: Make error messages produced by passing an invalid set of - arguments to a function more informative. +- Issue #17043: The unicode-internal decoder no longer read past the end of + input buffer. -- Issue #12225: Still allow Python to build if Python is not in its hg repo or - mercurial is not installed. +- Issue #17098: All modules now have __loader__ set even if they pre-exist the + bootstrapping of importlib. -- Issue #1195: my_fgets() now always clears errors before calling fgets(). Fix - the following case: sys.stdin.read() stopped with CTRL+d (end of file), - raw_input() interrupted by CTRL+c. +- Issue #16979: Fix error handling bugs in the unicode-escape-decode decoder. -- Issue #12216: Allow unexpected EOF errors to happen on any line of the file. +- Issue #16772: The base argument to the int constructor no longer accepts + floats, or other non-integer objects with an __int__ method. Objects + with an __index__ method are now accepted. -- Issue #12199: The TryExcept and TryFinally and AST nodes have been unified - into a Try node. +- Issue #10156: In the interpreter's initialization phase, unicode globals + are now initialized dynamically as needed. -- Issue #9670: Increase the default stack size for secondary threads on - Mac OS X and FreeBSD to reduce the chances of a crash instead of a - "maximum recursion depth" RuntimeError exception. - (patch by Ronald Oussoren) +- Issue #16980: Fix processing of escaped non-ascii bytes in the + unicode-escape-decode decoder. -- Issue #12106: The use of the multiple-with shorthand syntax is now reflected - in the AST. +- Issue #16975: Fix error handling bug in the escape-decode bytes decoder. -- Issue #12190: Try to use the same filename object when compiling unmarshalling - a code objects in the same file. +- Issue #14850: Now a charmap decoder treats U+FFFE as "undefined mapping" + in any mapping, not only in a string. -- Issue #12166: Move implementations of dir() specialized for various types into - the __dir__() methods of those types. +- Issue #16613: Add *m* argument to ``collections.Chainmap.new_child`` to + allow the new child map to be specified explicitly. -- Issue #5715: In socketserver, close the server socket in the child process. +- Issue #16730: importlib.machinery.FileFinder now no longers raises an + exception when trying to populate its cache and it finds out the directory is + unreadable or has turned into a file. Reported and diagnosed by + David Pritchard. -- Correct lookup of __dir__ on objects. Among other things, this causes errors - besides AttributeError found on lookup to be propagated. +- Issue #16906: Fix a logic error that prevented most static strings from being + cleared. -- Issue #12060: Use sig_atomic_t type and volatile keyword in the signal - module. Patch written by Charles-François Natali. +- Issue #11461: Fix the incremental UTF-16 decoder. Original patch by + Amaury Forgeot d'Arc. -- Issue #1746656: Added the if_nameindex, if_indextoname, if_nametoindex - methods to the socket module. +- Issue #16856: Fix a segmentation fault from calling repr() on a dict with + a key whose repr raise an exception. -- Issue #12044: Fixed subprocess.Popen when used as a context manager to - wait for the process to end when exiting the context to avoid unintentionally - leaving zombie processes around. +- Issue #16367: Fix FileIO.readall() on Windows for files larger than 2 GB. -- Issue #1195: Fix input() if it is interrupted by CTRL+d and then CTRL+c, - clear the end-of-file indicator after CTRL+d. +- Issue #16761: Calling int() with base argument only now raises TypeError. -- Issue #1856: Avoid crashes and lockups when daemon threads run while the - interpreter is shutting down; instead, these threads are now killed when - they try to take the GIL. +- Issue #16759: Support the full DWORD (unsigned long) range in Reg2Py + when retrieving a REG_DWORD value. This corrects functions like + winreg.QueryValueEx that may have been returning truncated values. -- Issue #9756: When calling a method descriptor or a slot wrapper descriptor, - the check of the object type doesn't read the __class__ attribute anymore. - Fix a crash if a class override its __class__ attribute (e.g. a proxy of the - str type). Patch written by Andreas Stührk. +- Issue #14420: Support the full DWORD (unsigned long) range in Py2Reg + when passed a REG_DWORD value. Fixes OverflowError in winreg.SetValueEx. -- Issue #10517: After fork(), reinitialize the TLS used by the PyGILState_* - APIs, to avoid a crash with the pthread implementation in RHEL 5. Patch - by Charles-François Natali. +- Issue #11939: Set the st_dev attribute of stat_result to allow Windows to + take advantage of the os.path.samefile/sameopenfile/samestat implementations + used by other platforms. -- Issue #10914: Initialize correctly the filesystem codec when creating a new - subinterpreter to fix a bootstrap issue with codecs implemented in Python, as - the ISO-8859-15 codec. +- Issue #16772: The int() constructor's second argument (base) no longer + accepts non integer values. Consistent with the behavior in Python 2. -- Issue #11918: OS/2 and VMS are no more supported because of the lack of - maintainer. +- Issue #14470: Remove w9xpopen support per PEP 11. -- Issue #6780: fix starts/endswith error message to mention that tuples are - accepted too. +- Issue #9856: Replace deprecation warning with raising TypeError + in object.__format__. Patch by Florent Xicluna. -- Issue #5057: fix a bug in the peepholer that led to non-portable pyc files - between narrow and wide builds while optimizing BINARY_SUBSCR on non-BMP - chars (e.g. "\U00012345"[0]). +- Issue #16597: In buffered and text IO, call close() on the underlying stream + if invoking flush() fails. -- Issue #11845: Fix typo in rangeobject.c that caused a crash in - compute_slice_indices. Patch by Daniel Urban. +- Issue #16722: In the bytes() constructor, try to call __bytes__ on the + argument before __index__. -- Issue #5673: Added a `timeout` keyword argument to subprocess.Popen.wait, - subprocess.Popen.communicated, subprocess.call, subprocess.check_call, and - subprocess.check_output. If the blocking operation takes more than `timeout` - seconds, the `subprocess.TimeoutExpired` exception is raised. +- Issue #16421: loading multiple modules from one shared object is now + handled correctly (previously, the first module loaded from that file + was silently returned). Patch by Václav Šmilauer. -- Issue #11650: PyOS_StdioReadline() retries fgets() if it was interrupted - (EINTR), for example if the program is stopped with CTRL+z on Mac OS X. Patch - written by Charles-Francois Natali. +- Issue #16602: When a weakref's target was part of a long deallocation + chain, the object could remain reachable through its weakref even though + its refcount had dropped to zero. -- Issue #9319: Include the filename in "Non-UTF8 code ..." syntax error. +- Issue #16495: Remove extraneous NULL encoding check from bytes_decode(). -- Issue #10785: Store the filename as Unicode in the Python parser. +- Issue #16619: Create NameConstant AST class to represent None, True, and False + literals. As a result, these constants are never loaded at runtime from + builtins. -- Issue #11619: _PyImport_LoadDynamicModule() doesn't encode the path to bytes - on Windows. +- Issue #16455: On FreeBSD and Solaris, if the locale is C, the + ASCII/surrogateescape codec is now used (instead of the locale encoding) to + decode the command line arguments. This change fixes inconsistencies with + os.fsencode() and os.fsdecode(), because these operating systems announce an + ASCII locale encoding, but actually use the ISO-8859-1 encoding in practice. -- Issue #10998: Remove mentions of -Q, sys.flags.division_warning and - Py_DivisionWarningFlag left over from Python 2. +- Issue #16562: Optimize dict equality testing. Patch by Serhiy Storchaka. -- Issue #11244: Remove an unnecessary peepholer check that was preventing - negative zeros from being constant-folded properly. +- Issue #16588: Silence unused-but-set warnings in Python/thread_pthread -- Issue #11395: io.FileIO().write() clamps the data length to 32,767 bytes on - Windows if the file is a TTY to workaround a Windows bug. The Windows console - returns an error (12: not enough space error) on writing into stdout if - stdout mode is binary and the length is greater than 66,000 bytes (or less, - depending on heap usage). +- Issue #16592: stringlib_bytes_join doesn't raise MemoryError on allocation + failure. -- Issue #11320: fix bogus memory management in Modules/getpath.c, leading to - a possible crash when calling Py_SetPath(). +- Issue #16546: Fix: ast.YieldFrom argument is now mandatory. -- Issue #11432: A bug was introduced in subprocess.Popen on posix systems with - 3.2.0 where the stdout or stderr file descriptor being the same as the stdin - file descriptor would raise an exception. webbrowser.open would fail. fixed. +- Issue #16514: Fix regression causing a traceback when sys.path[0] is None + (actually, any non-string or non-bytes type). -- Issue #9856: Change object.__format__ with a non-empty format string - to be a DeprecationWarning. In 3.2 it was a PendingDeprecationWarning. - In 3.4 it will be a TypeError. +- Issue #16306: Fix multiple error messages when unknown command line + parameters where passed to the interpreter. Patch by Hieu Nguyen. -- Issue #11244: The peephole optimizer is now able to constant-fold - arbitrarily complex expressions. This also fixes a 3.2 regression where - operations involving negative numbers were not constant-folded. +- Issue #16215: Fix potential double memory free in str.replace(). Patch + by Serhiy Storchaka. -- Issue #11450: Don't truncate hg version info in Py_GetBuildInfo() when - there are many tags (e.g. when using mq). Patch by Nadeem Vawda. +- Issue #16290: A float return value from the __complex__ special method is no + longer accepted in the complex() constructor. -- Issue #11335: Fixed a memory leak in list.sort when the key function - throws an exception. +- Issue #16416: On Mac OS X, operating system data are now always + encoded/decoded to/from UTF-8/surrogateescape, instead of the locale encoding + (which may be ASCII if no locale environment variable is set), to avoid + inconsistencies with os.fsencode() and os.fsdecode() functions which are + already using UTF-8/surrogateescape. -- Issue #8923: When a string is encoded to UTF-8 in strict mode, the result is - cached into the object. Examples: str.encode(), str.encode('utf-8'), - PyUnicode_AsUTF8String() and PyUnicode_AsEncodedString(unicode, "utf-8", - NULL). +- Issue #16453: Fix equality testing of dead weakref objects. -- Issue #10829: Refactor PyUnicode_FromFormat(), use the same function to parse - the format string in the 3 steps, fix crashs on invalid format strings. +- Issue #9535: Fix pending signals that have been received but not yet + handled by Python to not persist after os.fork() in the child process. -- Issue #13007: whichdb should recognize gdbm 1.9 magic numbers. +- Issue #14794: Fix slice.indices to return correct results for huge values, + rather than raising OverflowError. -- Issue #11286: Raise a ValueError from calling PyMemoryView_FromBuffer with - a buffer struct having a NULL data pointer. +- Issue #15001: fix segfault on "del sys.modules['__main__']". Patch by Victor + Stinner. -- Issue #11272: On Windows, input() strips '\r' (and not only '\n'), and - sys.stdin uses universal newline (replace '\r\n' by '\n'). +- Issue #8271: the utf-8 decoder now outputs the correct number of U+FFFD + characters when used with the 'replace' error handler on invalid utf-8 + sequences. Patch by Serhiy Storchaka, tests by Ezio Melotti. -- Issue #11828: startswith and endswith now accept None as slice index. - Patch by Torsten Becker. +- Issue #5765: Apply a hard recursion limit in the compiler instead of + blowing the stack and segfaulting. Initial patch by Andrea Griffini. -- Issue #11168: Remove filename debug variable from PyEval_EvalFrameEx(). - It encoded the Unicode filename to UTF-8, but the encoding fails on - undecodable filename (on surrogate characters) which raises an unexpected - UnicodeEncodeError on recursion limit. +- Issue #16402: When slicing a range, fix shadowing of exceptions from + __index__. -- Issue #11187: Remove bootstrap code (use ASCII) of - PyUnicode_AsEncodedString(), it was replaced by a better fallback (use the - locale encoding) in PyUnicode_EncodeFSDefault(). +- Issue #16336: fix input checking in the surrogatepass error handler. + Patch by Serhiy Storchaka. -- Check for NULL result in PyType_FromSpec. +- Issue #8401: assigning an int to a bytearray slice (e.g. b[3:4] = 5) now + raises an error. -- Issue #10516: New copy() and clear() methods for lists and bytearrays. +- Issue #7317: Display full tracebacks when an error occurs asynchronously. + Patch by Alon Horev with update by Alexey Kachayev. -- Issue #11386: bytearray.pop() now throws IndexError when the bytearray is - empty, instead of OverflowError. +- Issue #16309: Make PYTHONPATH="" behavior the same as if PYTHONPATH + not set at all. -- Issue #12380: The rjust, ljust and center methods of bytes and bytearray - now accept a bytearray argument. +- Issue #10189: Improve the error reporting of SyntaxErrors related to global + and nonlocal statements. -Library -------- +- Fix segfaults on setting __qualname__ on builtin types and attempting to + delete it on any type. -- Issue #14195: An issue that caused weakref.WeakSet instances to incorrectly - return True for a WeakSet instance 'a' in both 'a < a' and 'a > a' has been - fixed. +- Issue #14625: Rewrite the UTF-32 decoder. It is now 3x to 4x faster. Patch + written by Serhiy Storchaka. -- Issue #14166: Pickler objects now have an optional ``dispatch_table`` - attribute which allows to set custom per-pickler reduction functions. - Patch by sbt. +- Issue #16345: Fix an infinite loop when ``fromkeys`` on a dict subclass + received a nonempty dict from the constructor. -- Issue #14177: marshal.loads() now raises TypeError when given an unicode - string. Patch by Guilherme Gonçalves. +- Issue #16271: Fix strange bugs that resulted from __qualname__ appearing in a + class's __dict__ and on type. -- Issue #13550: Remove the debug machinery from the threading module: remove - verbose arguments from all threading classes and functions. +- Issue #12805: Make bytes.join and bytearray.join faster when the separator + is empty. Patch by Serhiy Storchaka. -- Issue #14159: Fix the len() of weak containers (WeakSet, WeakKeyDictionary, - WeakValueDictionary) to return a better approximation when some objects - are dead or dying. Moreover, the implementation is now O(1) rather than - O(n). +- Issue #6074: Ensure cached bytecode files can always be updated by the + user that created them, even when the source file is read-only. -- Issue #11841: Fix comparison bug with 'rc' versions in packaging.version. - Patch by Filip Gruszczyński. +- Issue #15958: bytes.join and bytearray.join now accept arbitrary buffer + objects. -- Issue #6884: Fix long-standing bugs with MANIFEST.in parsing in distutils - on Windows. Also fixed in packaging. +- Issue #14783: Improve int() docstring and switch docstrings for str(), + range(), and slice() to use multi-line signatures. -- Issue #8033: sqlite3: Fix 64-bit integer handling in user functions - on 32-bit architectures. Initial patch by Philippe Devalkeneer. +- Issue #16160: Subclass support now works for types.SimpleNamespace. -- HTMLParser is now able to handle slashes in the start tag. +- Issue #16148: Implement PEP 424, adding operator.length_hint and + PyObject_LengthHint. -- Issue #13641: Decoding functions in the base64 module now accept ASCII-only - unicode strings. Patch by Catalin Iacob. +- Upgrade Unicode data (UCD) to version 6.2. -- Issue #14043: Speed up importlib's _FileFinder by at least 8x, and add a - new importlib.invalidate_caches() function. +- Issue #15379: Fix passing of non-BMP characters as integers for the charmap + decoder (already working as unicode strings). Patch by Serhiy Storchaka. -- Issue #14001: CVE-2012-0845: xmlrpc: Fix an endless loop in - SimpleXMLRPCServer upon malformed POST request. +- Issue #15144: Fix possible integer overflow when handling pointers as integer + values, by using `Py_uintptr_t` instead of `size_t`. Patch by Serhiy + Storchaka. -- Issue #13961: Move importlib over to using os.replace() for atomic renaming. +- Issue #15965: Explicitly cast `AT_FDCWD` as (int). Required on Solaris 10 + (which defines `AT_FDCWD` as ``0xffd19553``), harmless on other platforms. -- Do away with ambiguous level values (as suggested by PEP 328) in - importlib.__import__() by raising ValueError when level < 0. +- Issue #15839: Convert SystemErrors in `super()` to RuntimeErrors. -- Issue #2489: pty.spawn could consume 100% cpu when it encountered an EOF. +- Issue #15448: Buffered IO now frees the buffer when closed, instead + of when deallocating. -- Issue #13014: Fix a possible reference leak in SSLSocket.getpeercert(). +- Issue #15846: Fix SystemError which happened when using `ast.parse()` in an + exception handler on code with syntax errors. -- Issue #13777: Add PF_SYSTEM sockets on OS X. - Patch by Michael Goderbauer. +- Issue #15897: zipimport.c doesn't check return value of fseek(). + Patch by Felipe Cruz. -- Issue #13015: Fix a possible reference leak in defaultdict.__repr__. - Patch by Suman Saha. +- Issue #15801: Make sure mappings passed to '%' formatting are actually + subscriptable. -- Issue #1326113: distutils' and packaging's build_ext commands option now - correctly parses multiple values (separated by whitespace or commas) given - to their --libraries option. +- Issue #15111: __import__ should propagate ImportError when raised as a + side-effect of a module triggered from using fromlist. -- Issue #10287: nntplib now queries the server's CAPABILITIES first before - sending MODE READER, and only sends it if not already in READER mode. - Patch by Hynek Schlawack. +- Issue #15022: Add pickle and comparison support to types.SimpleNamespace. -- Issue #13993: HTMLParser is now able to handle broken end tags when - strict=False. +Library +------- -- Issue #13930: lib2to3 now supports writing converted output files to another - directory tree as well as copying unchanged files and altering the file - suffix. +- Issue #4331: Added functools.partialmethod (Initial patch by Alon Horev) -- Issue #9750: Fix sqlite3.Connection.iterdump on tables and fields - with a name that is a keyword or contains quotes. Patch by Marko - Kohtala. +- Issue #13461: Fix a crash in the TextIOWrapper.tell method on 64-bit + platforms. Patch by Yogesh Chaudhari. -- Issue #10287: nntplib now queries the server's CAPABILITIES again after - authenticating (since the result may change, according to RFC 4643). - Patch by Hynek Schlawack. +- Issue #18681: Fix a NameError in importlib.reload() (noticed by Weizhao Li). -- Issue #13590: On OS X 10.7 and 10.6 with Xcode 4.2, building - Distutils-based packages with C extension modules may fail because - Apple has removed gcc-4.2, the version used to build python.org - 64-bit/32-bit Pythons. If the user does not explicitly override - the default C compiler by setting the CC environment variable, - Distutils will now attempt to compile extension modules with clang - if gcc-4.2 is required but not found. Also as a convenience, if - the user does explicitly set CC, substitute its value as the default - compiler in the Distutils LDSHARED configuration variable for OS X. - (Note, the python.org 32-bit-only Pythons use gcc-4.0 and the 10.4u - SDK, neither of which are available in Xcode 4. This change does not - attempt to override settings to support their use with Xcode 4.) +- Issue #14323: Expanded the number of digits in the coefficients for the + RGB -- YIQ conversions so that they match the FCC NTSC versions. -- Issue #13960: HTMLParser is now able to handle broken comments when - strict=False. +- Issue #17998: Fix an internal error in regular expression engine. -- When '' is a path (e.g. in sys.path), make sure __file__ uses the current - working directory instead of '' in importlib. +- Issue #17557: Fix os.getgroups() to work with the modified behavior of + getgroups(2) on OS X 10.8. Original patch by Mateusz Lenik. -- Issue #13609: Add two functions to query the terminal size: - os.get_terminal_size (low level) and shutil.get_terminal_size (high level). - Patch by Zbigniew Jędrzejewski-Szmek. +- Issue #18608: Avoid keeping a strong reference to the locale module + inside the _io module. -- Issue #13845: On Windows, time.time() now uses GetSystemTimeAsFileTime() - instead of ftime() to have a resolution of 100 ns instead of 1 ms (the clock - accuracy is between 0.5 ms and 15 ms). +- Issue #18619: Fix atexit leaking callbacks registered from sub-interpreters, + and make it GC-aware. -- Issue #13846: Add time.monotonic(), monotonic clock. +- Issue #15699: The readline module now uses PEP 3121-style module + initialization, so as to reclaim allocated resources (Python callbacks) + at shutdown. Original patch by Robin Schreiber. -- Issue #8184: multiprocessing: On Windows, don't set SO_REUSEADDR on - Connection sockets, and set FILE_FLAG_FIRST_PIPE_INSTANCE on named pipes, to - make sure two listeners can't bind to the same socket/pipe (or any existing - socket/pipe). +- Issue #17616: wave.open now supports the context management protocol. -- Issue #10811: Fix recursive usage of cursors. Instead of crashing, - raise a ProgrammingError now. +- Issue #18599: Fix name attribute of _sha1.sha1() object. It now returns + 'SHA1' instead of 'SHA'. -- Issue #13734: Add os.fwalk(), a directory walking function yielding file - descriptors. +- Issue #13266: Added inspect.unwrap to easily unravel __wrapped__ chains + (initial patch by Daniel Urban and Aaron Iles) -- Issue #2945: Make the distutils upload command aware of bdist_rpm products. +- Issue #18561: Skip name in ctypes' _build_callargs() if name is NULL. -- Issue #13712: pysetup create should not convert package_data to extra_files. +- Issue #18559: Fix NULL pointer dereference error in _pickle module -- Issue #11805: package_data in setup.cfg should allow more than one value. +- Issue #18556: Check the return type of PyUnicode_AsWideChar() in ctype's + U_set(). -- Issue #13676: Handle strings with embedded zeros correctly in sqlite3. +- Issue #17818: aifc.getparams now returns a namedtuple. -- Issue #8828: Add new function os.replace(), for cross-platform renaming - with overwriting. +- Issue #18549: Eliminate dead code in socket_ntohl() -- Issue #13848: open() and the FileIO constructor now check for NUL - characters in the file name. Patch by Hynek Schlawack. +- Issue #18530: Remove additional stat call from posixpath.ismount. + Patch by Alex Gaynor. -- Issue #13806: The size check in audioop decompression functions was too - strict and could reject valid compressed data. Patch by Oleg Plakhotnyuk. +- Issue #18514: Fix unreachable Py_DECREF() call in PyCData_FromBaseObj() -- Issue #13812: When a multiprocessing Process child raises an exception, - flush stderr after printing the exception traceback. +- Issue #9177: Calling read() or write() now raises ValueError, not + AttributeError, on a closed SSL socket. Patch by Senko Rasic. -- Issue #13885: CVE-2011-3389: the _ssl module would always disable the CBC - IV attack countermeasure. +- Issue #18513: Fix behaviour of cmath.rect w.r.t. signed zeros on OS X 10.8 + + gcc. -- Issue #13847: time.localtime() and time.gmtime() now raise an OSError instead - of ValueError on failure. time.ctime() and time.asctime() now raises an - OSError if localtime() failed. time.clock() now raises a RuntimeError if the - processor time used is not available or its value cannot be represented +- Issue #18479: Changed venv Activate.ps1 to make deactivate a function, and + removed Deactivate.ps1. -- Issue #13772: In os.symlink() under Windows, do not try to guess the link - target's type (file or directory). The detection was buggy and made the - call non-atomic (therefore prone to race conditions). +- Issue #18480: Add missing call to PyType_Ready to the _elementtree extension. -- Issue #6631: Disallow relative file paths in urllib urlopen methods. +- Issue #17778: Fix test discovery for test_multiprocessing. (Patch by + Zachary Ware.) -- Issue #13722: Avoid silencing ImportErrors when initializing the codecs - registry. +- Issue #18393: The private module _gestalt and private functions + platform._mac_ver_gestalt, platform._mac_ver_lookup and + platform._bcd2str have been removed. This does not affect the public + interface of the platform module. -- Issue #13781: Fix GzipFile bug that caused an exception to be raised when - opening for writing using a fileobj returned by os.fdopen(). +- Issue #17482: functools.update_wrapper (and functools.wraps) now set the + __wrapped__ attribute correctly even if the underlying function has a + __wrapped__ attribute set. -- Issue #13803: Under Solaris, distutils doesn't include bitness - in the directory name. +- Issue #18431: The new email header parser now decodes RFC2047 encoded words + in structured headers. -- Issue #10278: Add time.wallclock() function, monotonic clock. +- Issue #18432: The sched module's queue method was incorrectly returning + an iterator instead of a list. -- Issue #13809: Fix regression where bz2 module wouldn't work when threads are - disabled. Original patch by Amaury Forgeot d'Arc. +- Issue #18044: The new email header parser was mis-parsing encoded words where + an encoded character immediately followed the '?' that follows the CTE + character, resulting in a decoding failure. They are now decoded correctly. -- Issue #13589: Fix some serialization primitives in the aifc module. - Patch by Oleg Plakhotnyuk. +- Issue #18101: Tcl.split() now process strings nested in a tuple as it + do with byte strings. -- Issue #13642: Unquote before b64encoding user:password during Basic - Authentication. Patch contributed by Joonas Kuorilehto. +- Issue #18116: getpass was always getting an error when testing /dev/tty, + and thus was always falling back to stdin, and would then raise an exception + if stdin could not be used (such as /dev/null). It also leaked an open file. + All of these issues are now fixed. -- Issue #12364: Fix a hang in concurrent.futures.ProcessPoolExecutor. - The hang would occur when retrieving the result of a scheduled future after - the executor had been shut down. +- Issue #17198: Fix a NameError in the dbm module. Patch by Valentina + Mukhamedzhanova. -- Issue #13502: threading: Fix a race condition in Event.wait() that made it - return False when the event was set and cleared right after. +- Issue #18013: Fix cgi.FieldStorage to parse the W3C sample form. -- Issue #9993: When the source and destination are on different filesystems, - and the source is a symlink, shutil.move() now recreates a symlink on the - destination instead of copying the file contents. Patch by Jonathan Niehof - and Hynek Schlawack. +- Issue #18020: improve html.escape speed by an order of magnitude. + Patch by Matt Bryant. -- Issue #12926: Fix a bug in tarfile's link extraction. +- Issue #18347: ElementTree's html serializer now preserves the case of + closing tags. -- Issue #13696: Fix the 302 Relative URL Redirection problem. +- Issue #17261: Ensure multiprocessing's proxies use proper address. -- Issue #13636: Weak ciphers are now disabled by default in the ssl module - (except when SSLv2 is explicitly asked for). +- Issue #18343: faulthandler.register() now keeps the previous signal handler + when the function is called twice, so faulthandler.unregister() restores + correctly the original signal handler. -- Issue #12715: Add an optional symlinks argument to shutil functions - (copyfile, copymode, copystat, copy, copy2). When that parameter is - true, symlinks aren't dereferenced and the operation instead acts on the - symlink itself (or creates one, if relevant). Patch by Hynek Schlawack. +- Issue #17097: Make multiprocessing ignore EINTR. -- Add a flags parameter to select.epoll. +- Issue #18339: Negative ints keys in unpickler.memo dict no longer cause a + segfault inside the _pickle C extension. -- Issue #13626: Add support for SSL Diffie-Hellman key exchange, through the - SSLContext.load_dh_params() method and the ssl.OP_SINGLE_DH_USE option. +- Issue #18240: The HMAC module is no longer restricted to bytes and accepts + any bytes-like object, e.g. memoryview. Original patch by Jonas Borgström. -- Issue #11006: Don't issue low level warning in subprocess when pipe2() fails. +- Issue #18224: Removed pydoc script from created venv, as it causes problems + on Windows and adds no value over and above python -m pydoc ... -- Issue #13620: Support for Chrome browser in webbrowser. Patch contributed - by Arnaud Calmettes. +- Issue #18155: The csv module now correctly handles csv files that use + a delimter character that has a special meaning in regexes, instead of + throwing an exception. -- Issue #11829: Fix code execution holes in inspect.getattr_static for - metaclasses with metaclasses. Patch by Andreas Stührk. +- Issue #14360: encode_quopri can now be successfully used as an encoder + when constructing a MIMEApplication object. -- Issue #12708: Add starmap() and starmap_async() methods (similar to - itertools.starmap()) to multiprocessing.Pool. Patch by Hynek Schlawack. +- Issue #11390: Add -o and -f command line options to the doctest CLI to + specify doctest options (and convert it to using argparse). -- Issue #1785: Fix inspect and pydoc with misbehaving descriptors. +- Issue #18135: ssl.SSLSocket.write() now raises an OverflowError if the input + string in longer than 2 gigabytes, and ssl.SSLContext.load_cert_chain() + raises a ValueError if the password is longer than 2 gigabytes. The ssl + module does not support partial write. -- Issue #13637: "a2b" functions in the binascii module now accept ASCII-only - unicode strings. +- Issue #11016: Add C implementation of the stat module as _stat. -- Issue #13634: Add support for querying and disabling SSL compression. +- Issue #18248: Fix libffi build on AIX. -- Issue #13627: Add support for SSL Elliptic Curve-based Diffie-Hellman - key exchange, through the SSLContext.set_ecdh_curve() method and the - ssl.OP_SINGLE_ECDH_USE option. +- Issue #18259: Declare sethostname in socketmodule.c for AIX -- Issue #13635: Add ssl.OP_CIPHER_SERVER_PREFERENCE, so that SSL servers - choose the cipher based on their own preferences, rather than on the - client's. +- Issue #18147: Add diagnostic functions to ssl.SSLContext(). get_ca_list() + lists all loaded CA certificates and cert_store_stats() returns amount of + loaded X.509 certs, X.509 CA certs and CRLs. -- Issue #11813: Fix inspect.getattr_static for modules. Patch by Andreas - Stührk. +- Issue #18167: cgi.FieldStorage no longer fails to handle multipart/form-data + when \r\n appears at end of 65535 bytes without other newlines. -- Issue #7502: Fix equality comparison for DocTestCase instances. Patch by - Cédric Krier. +- Issue #18076: Introduce importlib.util.decode_source(). + -- Issue #11870: threading: Properly reinitialize threads internal locks and - condition variables to avoid deadlocks in child processes. +- Issue #18357: add tests for dictview set difference. + Patch by Fraser Tweedale. -- Issue #8035: urllib: Fix a bug where the client could remain stuck after a - redirection or an error. +- importlib.abc.SourceLoader.get_source() no longer changes SyntaxError or + UnicodeDecodeError into ImportError. -- Issue #13560: os.strerror() now uses the current locale encoding instead of - UTF-8. +- Issue #18058, 18057: Make the namespace package loader meet the + importlib.abc.InspectLoader ABC, allowing for namespace packages to work with + runpy. -- Issue #8373: The filesystem path of AF_UNIX sockets now uses the filesystem - encoding and the surrogateescape error handler, rather than UTF-8. Patch - by David Watson. +- Issue #17177: The imp module is pending deprecation. -- Issue #10350: Read and save errno before calling a function which might - overwrite it. Original patch by Hallvard B Furuseth. +- subprocess: Prevent a possible double close of parent pipe fds when the + subprocess exec runs into an error. Prevent a regular multi-close of the + /dev/null fd when any of stdin, stdout and stderr was set to DEVNULL. -- Issue #11610: Introduce a more general way to declare abstract properties. +- Issue #18194: Introduce importlib.util.cache_from_source() and + source_from_cache() while documenting the equivalent functions in imp as + deprecated. -- Issue #13591: A bug in importlib has been fixed that caused import_module - to load a module twice. +- Issue #17907: Document imp.new_module() as deprecated in favour of + types.ModuleType. -- Issue #13449 sched.scheduler.run() method has a new "blocking" parameter which - when set to False makes run() execute the scheduled events due to expire - soonest (if any) and then return. Patch by Giampaolo Rodolà. +- Issue #18192: Introduce importlib.util.MAGIC_NUMBER and document as deprecated + imp.get_magic(). -- Issue #8684 sched.scheduler class can be safely used in multi-threaded - environments. Patch by Josiah Carlson and Giampaolo Rodolà. +- Issue #18149: Add filecmp.clear_cache() to manually clear the filecmp cache. + Patch by Mark Levitt -- Alias resource.error to OSError ala PEP 3151. +- Issue #18193: Add importlib.reload(). -- Issue #5689: Add support for lzma compression to the tarfile module. +- Issue #18157: Stop using imp.load_module() in pydoc. -- Issue #13248: Turn 3.2's PendingDeprecationWarning into 3.3's - DeprecationWarning. It covers 'cgi.escape', 'importlib.abc.PyLoader', - 'importlib.abc.PyPycLoader', 'nntplib.NNTP.xgtitle', 'nntplib.NNTP.xpath', - and private attributes of 'smtpd.SMTPChannel'. +- Issue #16102: Make uuid._netbios_getnode() work again on Python 3. -- Issue #5905, Issue #13560: time.strftime() is now using the current locale - encoding, instead of UTF-8, if the wcsftime() function is not available. +- Issue #17134: Add ssl.enum_cert_store() as interface to Windows' cert store. -- Issue #13464: Add a readinto() method to http.client.HTTPResponse. Patch - by Jon Kuhn. +- Issue #18143: Implement ssl.get_default_verify_paths() in order to debug + the default locations for cafile and capath. -- tarfile.py: Correctly detect bzip2 compressed streams with blocksizes - other than 900k. +- Issue #17314: Move multiprocessing.forking over to importlib. -- Issue #13439: Fix many errors in turtle docstrings. +- Issue #11959: SMTPServer and SMTPChannel now take an optional map, use of + which avoids affecting global state. -- Issue #6715: Add a module 'lzma' for compression using the LZMA algorithm. - Thanks to Per Øyvind Karlsen for the initial implementation. +- Issue #18109: os.uname() now decodes fields from the locale encoding, and + socket.gethostname() now decodes the hostname from the locale encoding, + instead of using the UTF-8 encoding in strict mode. -- Issue #13487: Make inspect.getmodule robust against changes done to - sys.modules while it is iterating over it. +- Issue #18089: Implement importlib.abc.InspectLoader.load_module. -- Issue #12618: Fix a bug that prevented py_compile from creating byte - compiled files in the current directory. Initial patch by Sjoerd de Vries. +- Issue #18088: Introduce importlib.abc.Loader.init_module_attrs for setting + module attributes. Leads to the pending deprecation of + importlib.util.module_for_loader. -- Issue #13444: When stdout has been closed explicitly, we should not attempt - to flush it at shutdown and print an error. +- Issue #17403: urllib.parse.robotparser normalizes the urls before adding to + ruleline. This helps in handling certain types invalid urls in a conservative + manner. Patch contributed by Mher Movsisyan. -- Issue #12567: The curses module uses Unicode functions for Unicode arguments - when it is linked to the ncurses library. It encodes also Unicode strings to - the locale encoding instead of UTF-8. +- Issue #18070: Have importlib.util.module_for_loader() set attributes + unconditionally in order to properly support reloading. -- Issue #12856: Ensure child processes do not inherit the parent's random - seed for filename generation in the tempfile module. Patch by Brian - Harring. +- Added importlib.util.module_to_load to return a context manager to provide the + proper module object to load. -- Issue #9957: SpooledTemporaryFile.truncate() now accepts an optional size - parameter, as other file-like objects. Patch by Ryan Kelly. +- Issue #18025: Fixed a segfault in io.BufferedIOBase.readinto() when raw + stream's read() returns more bytes than requested. -- Issue #13458: Fix a memory leak in the ssl module when decoding a - certificate with a subjectAltName. Patch by Robert Xiao. +- Issue #18011: As was originally intended, base64.b32decode() now raises a + binascii.Error if there are non-b32-alphabet characters present in the input + string, instead of a TypeError. -- Issue #13415: os.unsetenv() doesn't ignore errors anymore. +- Issue #18072: Implement importlib.abc.InspectLoader.get_code() and + importlib.abc.ExecutionLoader.get_code(). -- Issue #13245: sched.scheduler class constructor's timefunc and - delayfunct parameters are now optional. - scheduler.enter and scheduler.enterabs methods gained a new kwargs parameter. - Patch contributed by Chris Clark. +- Issue #8240: Set the SSL_MODE_ACCEPT_MOVING_WRITE_BUFFER flag on SSL + sockets. -- Issue #12328: Under Windows, refactor handling of Ctrl-C events and - make _multiprocessing.win32.WaitForMultipleObjects interruptible when - the wait_flag parameter is false. Patch by sbt. +- Issue #17269: Workaround for socket.getaddrinfo crash on MacOS X + with port None or "0" and flags AI_NUMERICSERV. -- Issue #13322: Fix BufferedWriter.write() to ensure that BlockingIOError is - raised when the wrapped raw file is non-blocking and the write would block. - Previous code assumed that the raw write() would raise BlockingIOError, but - RawIOBase.write() is defined to returned None when the call would block. - Patch by sbt. +- Issue #16986: ElementTree now correctly works with string input when the + internal XML encoding is not UTF-8 or US-ASCII. -- Issue #13358: HTMLParser now calls handle_data only once for each CDATA. +- Issue #17996: socket module now exposes AF_LINK constant on BSD and OSX. -- Issue #4147: minidom's toprettyxml no longer adds whitespace around a text - node when it is the only child of an element. Initial patch by Dan - Kenigsberg. +- Issue #17900: Allowed pickling of recursive OrderedDicts. Decreased pickled + size and pickling time. -- Issue #13374: The Windows bytes API has been deprecated in the os module. Use - Unicode filenames instead of bytes filenames to not depend on the ANSI code - page anymore and to support any filename. +- Issue #17914: Add os.cpu_count(). Patch by Yogesh Chaudhari, based on an + initial patch by Trent Nelson. -- Issue #13297: Use bytes type to send and receive binary data through XMLRPC. +- Issue #17812: Fixed quadratic complexity of base64.b32encode(). + Optimize base64.b32encode() and base64.b32decode() (speed up to 3x). -- Issue #6397: Support "/dev/poll" polling objects in select module, - under Solaris & derivatives. +- Issue #17980: Fix possible abuse of ssl.match_hostname() for denial of + service using certificates with many wildcards (CVE-2013-2099). -- Issues #1745761, #755670, #13357, #12629, #1200313: HTMLParser now correctly - handles non-valid attributes, including adjacent and unquoted attributes. +- Issue #15758: Fix FileIO.readall() so it no longer has O(n**2) complexity. -- Issue #13193: Fix distutils.filelist.FileList and packaging.manifest.Manifest - under Windows. +- Issue #14596: The struct.Struct() objects now use a more compact + implementation. -- Issue #13384: Remove unnecessary __future__ import in Lib/random.py +- Issue #17981: logging's SysLogHandler now closes the socket when it catches + socket OSErrors. -- Issue #13149: Speed up append-only StringIO objects. +- Issue #17964: Fix os.sysconf(): the return type of the C sysconf() function + is long, not int. -- Issue #13373: multiprocessing.Queue.get() could sometimes block indefinitely - when called with a timeout. Patch by Arnaud Ysmal. +- Fix typos in the multiprocessing module. -- Issue #13254: Fix Maildir initialization so that maildir contents - are read correctly. +- Issue #17754: Make ctypes.util.find_library() independent of the locale. -- Issue #3067: locale.setlocale() now raises TypeError if the second - argument is an invalid iterable. Its documentation and docstring - were also updated. Initial patch by Jyrki Pulliainen. +- Issue #17968: Fix memory leak in os.listxattr(). -- Issue #13140: Fix the daemon_threads attribute of ThreadingMixIn. +- Issue #17606: Fixed support of encoded byte strings in the XMLGenerator + characters() and ignorableWhitespace() methods. Original patch by Sebastian + Ortiz Vasquez. -- Issue #13339: Fix compile error in posixmodule.c due to missing semicolon. - Thanks to Robert Xiao. +- Issue #17732: Ignore distutils.cfg options pertaining to install paths if a + virtual environment is active. -- Byte compilation in packaging is now isolated from the calling Python -B or - -O options, instead of being disallowed under -B or buggy under -O. +- Issue #17915: Fix interoperability of xml.sax with file objects returned by + codecs.open(). -- Issue #10570: curses.putp() and curses.tparm() are now expecting a byte - string, instead of a Unicode string. +- Issue #16601: Restarting iteration over tarfile really restarts rather + than continuing from where it left off. Patch by Michael Birtwell. -- Issue #13295: http.server now produces valid HTML 4.01 strict. +- Issue #17289: The readline module now plays nicer with external modules + or applications changing the rl_completer_word_break_characters global + variable. Initial patch by Bradley Froehle. -- Issue #2892: preserve iterparse events in case of SyntaxError. +- Issue #12181: select module: Fix struct kevent definition on OpenBSD 64-bit + platforms. Patch by Federico Schwindt. -- Issue #13287: urllib.request and urllib.error now contains an __all__ - attribute to expose only relevant classes and functions. Patch by Florent - Xicluna. +- Issue #11816: multiple improvements to the dis module: get_instructions + generator, ability to redirect output to a file, Bytecode and Instruction + abstractions. Patch by Nick Coghlan, Ryan Kelly and Thomas Kluyver. -- Issue #670664: Fix HTMLParser to correctly handle the content of - ```` and ````. +- Issue #13831: Embed stringification of remote traceback in local + traceback raised when pool task raises an exception. -- Issue #10817: Fix urlretrieve function to raise ContentTooShortError even - when reporthook is None. Patch by Jyrki Pulliainen. +- Issue #15528: Add weakref.finalize to support finalization using + weakref callbacks. -- Fix the xmlrpc.client user agent to return something similar to - urllib.request user agent: "Python-xmlrpc/3.3". +- Issue #14173: Avoid crashing when reading a signal handler during + interpreter shutdown. -- Issue #13293: Better error message when trying to marshal bytes using - xmlrpc.client. +- Issue #15902: Fix imp.load_module() accepting None as a file when loading an + extension module. -- Issue #13291: NameError in xmlrpc package. +- Issue #13721: SSLSocket.getpeercert() and SSLSocket.do_handshake() now + raise an OSError with ENOTCONN, instead of an AttributeError, when the + SSLSocket is not connected. -- Issue #13258: Use callable() built-in in the standard library. +- Issue #14679: add an __all__ (that contains only HTMLParser) to html.parser. -- Issue #13273: fix a bug that prevented HTMLParser to properly detect some - tags when strict=False. +- Issue #17802: Fix an UnboundLocalError in html.parser. Initial tests by + Thomas Barlow. -- Issue #11183: Add finer-grained exceptions to the ssl module, so that - you don't have to inspect the exception's attributes in the common case. +- Issue #17358: Modules loaded by imp.load_source() and load_compiled() (and by + extention load_module()) now have a better chance of working when reloaded. -- Issue #13216: Add cp65001 codec, the Windows UTF-8 (CP_UTF8). +- Issue #17804: New function ``struct.iter_unpack`` allows for streaming + struct unpacking. -- Issue #13226: Add RTLD_xxx constants to the os module. These constants can be - used with sys.setdlopenflags(). +- Issue #17830: When keyword.py is used to update a keyword file, it now + preserves the line endings of the original file. -- Issue #10278: Add clock_getres(), clock_gettime() and CLOCK_xxx constants to - the time module. time.clock_gettime(time.CLOCK_MONOTONIC) provides a - monotonic clock +- Issue #17272: Making the urllib.request's Request.full_url a descriptor. + Fixes bugs with assignment to full_url. Patch by Demian Brecht. -- Issue #10332: multiprocessing: fix a race condition when a Pool is closed - before all tasks have completed. +- Issue #17353: Plistlib emitted empty data tags with deeply nested datastructures -- Issue #13255: wrong docstrings in array module. +- Issue #11714: Use 'with' statements to assure a Semaphore releases a + condition variable. Original patch by Thomas Rachel. -- Issue #8540: Remove deprecated Context._clamp attribute in Decimal module. +- Issue #16624: `subprocess.check_output` now accepts an `input` argument, + allowing the subprocess's stdin to be provided as a (byte) string. + Patch by Zack Weinberg. -- Issue #13235: Added DeprecationWarning to logging.warn() method and function. +- Issue #17795: Reverted backwards-incompatible change in SysLogHandler with + Unix domain sockets. -- Issue #9168: now smtpd is able to bind privileged port. +- Issue #16694: Add a pure Python implementation of the operator module. + Patch by Zachary Ware. -- Issue #12529: fix cgi.parse_header issue on strings with double-quotes and - semicolons together. Patch by Ben Darnell and Petri Lehtinen. +- Issue #11182: remove the unused and undocumented pydoc.Scanner class. + Patch by Martin Morrison. -- Issue #13227: functools.lru_cache() now has a option to distinguish - calls with different argument types. +- Issue #17741: Add ElementTree.XMLPullParser, an event-driven parser for + non-blocking applications. -- Issue #6090: zipfile raises a ValueError when a document with a timestamp - earlier than 1980 is provided. Patch contributed by Petri Lehtinen. +- Issue #17555: Fix ForkAwareThreadLock so that size of after fork + registry does not grow exponentially with generation of process. -- Issue #13150: sysconfig no longer parses the Makefile and config.h files - when imported, instead doing it at build time. This makes importing - sysconfig faster and reduces Python startup time by 20%. +- Issue #17707: fix regression in multiprocessing.Queue's get() method where + it did not block for short timeouts. -- Issue #12448: smtplib now flushes stdout while running ``python -m smtplib`` - in order to display the prompt correctly. +- Issue #17720: Fix the Python implementation of pickle.Unpickler to correctly + process the APPENDS opcode when it is used on non-list objects. -- Issue #12454: The mailbox module is now using ASCII, instead of the locale - encoding, to read and write .mh_sequences files. +- Issue #17012: shutil.which() no longer falls back to the PATH environment + variable if an empty path argument is specified. Patch by Serhiy Storchaka. -- Issue #13194: zlib.compressobj().copy() and zlib.decompressobj().copy() are - now available on Windows. +- Issue #17710: Fix pickle raising a SystemError on bogus input. -- Issue #1673007: urllib.request now supports HEAD request via new method argument. - Patch contributions by David Stanek, Patrick Westerhoff and Ezio Melotti. +- Issue #17341: Include the invalid name in the error messages from re about + invalid group names. -- Issue #12386: packaging does not fail anymore when writing the RESOURCES - file. +- Issue #17702: os.environ now raises KeyError with the original environment + variable name (str on UNIX), instead of using the encoded name (bytes on + UNIX). -- Issue #13158: Fix decoding and encoding of GNU tar specific base-256 number - fields in tarfile. +- Issue #16163: Make the importlib based version of pkgutil.iter_importers + work for submodules. Initial patch by Berker Peksag. -- Issue #13025: mimetypes is now reading MIME types using the UTF-8 encoding, - instead of the locale encoding. +- Issue #16804: Fix a bug in the 'site' module that caused running + 'python -S -m site' to incorrectly throw an exception. -- Issue #10653: On Windows, use strftime() instead of wcsftime() because - wcsftime() doesn't format time zone correctly. +- Issue #15480: Remove the deprecated and unused TYPE_INT64 code from marshal. + Initial patch by Daniel Riti. -- Issue #13150: The tokenize module doesn't compile large regular expressions - at startup anymore. +- Issue #2118: SMTPException is now a subclass of OSError. -- Issue #11171: Fix distutils.sysconfig.get_makefile_filename when Python was - configured with different prefix and exec-prefix. +- Issue #17016: Get rid of possible pointer wraparounds and integer overflows + in the re module. Patch by Nickolai Zeldovich. -- Issue #11254: Teach distutils and packaging to compile .pyc and .pyo files in - PEP 3147-compliant __pycache__ directories. +- Issue #16658: add missing return to HTTPConnection.send() + Patch by Jeff Knupp. -- Issue #7367: Fix pkgutil.walk_paths to skip directories whose - contents cannot be read. +- Issue #9556: the logging package now allows specifying a time-of-day for a + TimedRotatingFileHandler to rotate. -- Issue #3163: The struct module gets new format characters 'n' and 'N' - supporting C integer types ``ssize_t`` and ``size_t``, respectively. +- Issue #14971: unittest test discovery no longer gets confused when a function + has a different __name__ than its name in the TestCase class dictionary. -- Issue #13099: Fix sqlite3.Cursor.lastrowid under a Turkish locale. - Reported and diagnosed by Thomas Kluyver. +- Issue #17487: The wave getparams method now returns a namedtuple rather than + a plain tuple. -- Issue #13087: BufferedReader.seek() now always raises UnsupportedOperation - if the underlying raw stream is unseekable, even if the seek could be - satisfied using the internal buffer. Patch by John O'Connor. +- Issue #17675: socket repr() provides local and remote addresses (if any). + Patch by Giampaolo Rodola' -- Issue #7689: Allow pickling of dynamically created classes when their - metaclass is registered with copyreg. Patch by Nicolas M. Thiéry and Craig - Citro. +- Issue #17093: Make the ABCs in importlib.abc provide default values or raise + reasonable exceptions for their methods to make them more amenable to super() + calls. -- Issue #13034: When decoding some SSL certificates, the subjectAltName - extension could be unreported. +- Issue #17566: Make importlib.abc.Loader.module_repr() optional instead of an + abstractmethod; now it raises NotImplementedError so as to be ignored by default. -- Issue #12306: Expose the runtime version of the zlib C library as a constant, - ZLIB_RUNTIME_VERSION, in the zlib module. Patch by Torsten Landschoff. +- Issue #17678: Remove the use of deprecated method in http/cookiejar.py by + changing the call to get_origin_req_host() to origin_req_host. -- Issue #12959: Add collections.ChainMap to collections.__all__. +- Issue #17666: Fix reading gzip files with an extra field. -- Issue #8933: distutils' PKG-INFO files and packaging's METADATA files will - now correctly report Metadata-Version: 1.1 instead of 1.0 if a Classifier or - Download-URL field is present. +- Issue #16475: Support object instancing, recursion and interned strings + in marshal -- Issue #12567: Add curses.unget_wch() function. Push a character so the next - get_wch() will return it. +- Issue #17502: Process DEFAULT values in mock side_effect that returns iterator. -- Issue #9561: distutils and packaging now writes egg-info files using UTF-8, - instead of the locale encoding. +- Issue #16795: On the ast.arguments object, unify vararg with varargannotation + and kwarg and kwargannotation. Change the column offset of ast.Attribute to be + at the attribute name. -- Issue #8286: The distutils command sdist will print a warning message instead - of crashing when an invalid path is given in the manifest template. +- Issue #17434: Properly raise a SyntaxError when a string occurs between future + imports. -- Issue #12841: tarfile unnecessarily checked the existence of numerical user - and group ids on extraction. If one of them did not exist the respective id - of the current user (i.e. root) was used for the file and ownership - information was lost. +- Issue #17117: Import and @importlib.util.set_loader now set __loader__ when + it has a value of None or the attribute doesn't exist. -- Issue #12888: Fix a bug in HTMLParser.unescape that prevented it to escape - more than 128 entities. Patch by Peter Otten. +- Issue #17032: The "global" in the "NameError: global name 'x' is not defined" + error message has been removed. Patch by Ram Rachum. -- Issue #12878: Expose a __dict__ attribute on io.IOBase and its subclasses. +- Issue #18080: When building a C extension module on OS X, if the compiler + is overriden with the CC environment variable, use the new compiler as + the default for linking if LDSHARED is not also overriden. This restores + Distutils behavior introduced in 3.2.3 and inadvertently dropped in 3.3.0. -- Issue #12494: On error, call(), check_call(), check_output() and - getstatusoutput() functions of the subprocess module now kill the process, - read its status (to avoid zombis) and close pipes. +- Issue #18113: Fixed a refcount leak in the curses.panel module's + set_userptr() method. Reported by Atsuo Ishimoto. -- Issue #12720: Expose low-level Linux extended file attribute functions in os. +- Implement PEP 443 "Single-dispatch generic functions". -- Issue #10946: The distutils commands bdist_dumb, bdist_wininst and bdist_msi - now respect a --skip-build option given to bdist. The packaging commands - were fixed too. +- Implement PEP 435 "Adding an Enum type to the Python standard library". -- Issue #12847: Fix a crash with negative PUT and LONG_BINPUT arguments in - the C pickle implementation. +- Issue #15596: Faster pickling of unicode strings. -- Issue #11564: Avoid crashes when trying to pickle huge objects or containers - (more than 2**31 items). Instead, in most cases, an OverflowError is raised. +- Issue #17572: Avoid chained exceptions when passing bad directives to + time.strptime(). Initial patch by Claudiu Popa. -- Issue #12287: Fix a stack corruption in ossaudiodev module when the FD is - greater than FD_SETSIZE. +- Issue #17435: threading.Timer's __init__ method no longer uses mutable + default values for the args and kwargs parameters. -- Issue #12839: Fix crash in zlib module due to version mismatch. - Fix by Richard M. Tew. +- Issue #17526: fix an IndexError raised while passing code without filename to + inspect.findsource(). Initial patch by Tyler Doyle. -- Issue #9923: The mailcap module now correctly uses the platform path - separator for the MAILCAP environment variable on non-POSIX platforms. +- Issue #17540: Added style parameter to logging formatter configuration by dict. -- Issue #12835: Follow up to #6560 that unconditionally prevents use of the - unencrypted sendmsg/recvmsg APIs on SSL wrapped sockets. Patch by David - Watson. +- Issue #16692: The ssl module now supports TLS 1.1 and TLS 1.2. Initial + patch by Michele Orrù. -- Issue #12803: SSLContext.load_cert_chain() now accepts a password argument - to be used if the private key is encrypted. Patch by Adam Simpkins. +- Issue #17025: multiprocessing: Reduce Queue and SimpleQueue contention. -- Issue #11657: Fix sending file descriptors over 255 over a multiprocessing - Pipe. +- Issue #17536: Add to webbrowser's browser list: www-browser, x-www-browser, + iceweasel, iceape. -- Issue #12811: tabnanny.check() now promptly closes checked files. Patch by - Anthony Briggs. +- Issue #17150: pprint now uses line continuations to wrap long string + literals. -- Issue #6560: The sendmsg/recvmsg API is now exposed by the socket module - when provided by the underlying platform, supporting processing of - ancillary data in pure Python code. Patch by David Watson and Heiko Wundram. +- Issue #17488: Change the subprocess.Popen bufsize parameter default value + from unbuffered (0) to buffering (-1) to match the behavior existing code + expects and match the behavior of the subprocess module in Python 2 to avoid + introducing hard to track down bugs. -- Issue #12326: On Linux, sys.platform doesn't contain the major version - anymore. It is now always 'linux', instead of 'linux2' or 'linux3' depending - on the Linux version used to build Python. +- Issue #17521: Corrected non-enabling of logger following two calls to + fileConfig(). -- Issue #12213: Fix a buffering bug with interleaved reads and writes that - could appear on BufferedRandom streams. +- Issue #17508: Corrected logging MemoryHandler configuration in dictConfig() + where the target handler wasn't configured first. -- Issue #12778: Reduce memory consumption when JSON-encoding a large - container of many small objects. +- Issue #17209: curses.window.get_wch() now correctly handles KeyboardInterrupt + (CTRL+c). -- Issue #12650: Fix a race condition where a subprocess.Popen could leak - resources (FD/zombie) when killed at the wrong time. +- Issue #5713: smtplib now handles 421 (closing connection) error codes when + sending mail by closing the socket and reporting the 421 error code via the + exception appropriate to the command that received the error response. -- Issue #12744: Fix inefficient representation of integers between 2**31 and - 2**63 on systems with a 64-bit C "long". +- Issue #16997: unittest.TestCase now provides a subTest() context manager + to procedurally generate, in an easy way, small test instances. -- Issue #12646: Add an 'eof' attribute to zlib.Decompress, to make it easier to - detect truncated input streams. +- Issue #17485: Also delete the Request Content-Length header if the data + attribute is deleted. (Follow on to issue Issue #16464). -- Issue #11513: Fix exception handling ``tarfile.TarFile.gzopen()`` when - the file cannot be opened. +- Issue #15927: CVS now correctly parses escaped newlines and carriage + when parsing with quoting turned off. -- Issue #12687: Fix a possible buffering bug when unpickling text mode - (protocol 0, mostly) pickles. +- Issue #17467: add readline and readlines support to mock_open in + unittest.mock. -- Issue #10087: Fix the html output format of the calendar module. +- Issue #13248: removed deprecated and undocumented difflib.isbjunk, + isbpopular. -- Issue #13121: add support for inplace math operators to collections.Counter. +- Issue #17192: Update the ctypes module's libffi to v3.0.13. This + specifically addresses a stack misalignment issue on x86 and issues on + some more recent platforms. -- Add support for unary plus and unary minus to collections.Counter. +- Issue #8862: Fixed curses cleanup when getkey is interrputed by a signal. -- Issue #12683: urlparse updated to include svn as schemes that uses relative - paths. (svn from 1.5 onwards support relative path). +- Issue #17443: imaplib.IMAP4_stream was using the default unbuffered IO + in subprocess, but the imap code assumes buffered IO. In Python2 this + worked by accident. IMAP4_stream now explicitly uses buffered IO. -- Issue #12655: Expose functions from sched.h in the os module: sched_yield(), - sched_setscheduler(), sched_getscheduler(), sched_setparam(), - sched_get_min_priority(), sched_get_max_priority(), sched_rr_get_interval(), - sched_getaffinity(), sched_setaffinity(). +- Issue #17476: Fixed regression relative to Python2 in undocumented pydoc + 'allmethods'; it was missing unbound methods on the class. -- Add ThreadError to threading.__all__. +- Issue #17474: Remove the deprecated methods of Request class. -- Issues #11104, #8688: Fix the behavior of distutils' sdist command with - manually-maintained MANIFEST files. +- Issue #16709: unittest discover order is no-longer filesystem specific. Patch + by Jeff Ramnani. -- Issue #11281: smtplib.STMP gets source_address parameter, which adds the - ability to bind to specific source address on a machine with multiple - interfaces. Patch by Paulo Scardine. +- Use the HTTPS PyPI url for upload, overriding any plain HTTP URL in pypirc. -- Issue #12464: tempfile.TemporaryDirectory.cleanup() should not follow - symlinks: fix it. Patch by Petri Lehtinen. +- Issue #5024: sndhdr.whichhdr now returns the frame count for WAV files + rather than -1. -- Issue #8887: "pydoc somebuiltin.somemethod" (or help('somebuiltin.somemethod') - in Python code) now finds the doc of the method. +- Issue #17460: Remove the strict argument of HTTPConnection and removing the + DeprecationWarning being issued from 3.2 onwards. -- Issue #10968: Remove indirection in threading. The public names (Event, - Condition, etc.) used to be factory functions returning instances of hidden - classes (_Event, _Condition, etc.), because (if Guido recalls correctly) this - code pre-dates the ability to subclass extension types. It is now possible - to inherit from these classes, without having to import the private - underscored names like multiprocessing did. +- Issue #16880: Do not assume _imp.load_dynamic() is defined in the imp module. -- Issue #9723: Add shlex.quote functions, to escape filenames and command - lines. +- Issue #16389: Fixed a performance regression relative to Python 3.1 in the + caching of compiled regular expressions. -- Issue #12603: Fix pydoc.synopsis() on files with non-negative st_mtime. +- Added missing FeedParser and BytesFeedParser to email.parser.__all__. -- Issue #12514: Use try/finally to assure the timeit module restores garbage - collections when it is done. +- Issue #17431: Fix missing import of BytesFeedParser in email.parser. -- Issue #12607: In subprocess, fix issue where if stdin, stdout or stderr is - given as a low fd, it gets overwritten. +- Issue #12921: http.server's send_error takes an explain argument to send more + information in response. Patch contributed by Karl. -- Issue #12576: Fix urlopen behavior on sites which do not send (or obfuscates) - ``Connection: close`` header. +- Issue #17414: Add timeit, repeat, and default_timer to timeit.__all__. -- Issue #12560: Build libpython.so on OpenBSD. Patch by Stefan Sperling. +- Issue #1285086: Get rid of the refcounting hack and speed up + urllib.parse.unquote() and urllib.parse.unquote_to_bytes(). -- Issue #1813: Fix codec lookup under Turkish locales. +- Issue #17099: Have importlib.find_loader() raise ValueError when __loader__ + is not set, harmonizing with what happens when the attribute is set to None. -- Issue #12591: Improve support of "universal newlines" in the subprocess - module: the piped streams can now be properly read from or written to. +- Expose the O_PATH constant in the os module if it is available. -- Issue #12591: Allow io.TextIOWrapper to work with raw IO objects (without - a read1() method), and add a *write_through* parameter to mandate - unbuffered writes. +- Issue #17368: Fix an off-by-one error in the Python JSON decoder that caused + a failure while decoding empty object literals when object_pairs_hook was + specified. -- Issue #10883: Fix socket leaks in urllib.request when using FTP. +- Issue #17385: Fix quadratic behavior in threading.Condition. The FIFO + queue now uses a deque instead of a list. -- Issue #12592: Make Python build on OpenBSD 5 (and future major releases). +- Issue #15806: Add contextlib.ignore(). This creates a context manager to + ignore specified exceptions, replacing the "except SomeException: pass" idiom. -- Issue #12372: POSIX semaphores are broken on AIX: don't use them. +- Issue #14645: The email generator classes now produce output using the + specified linesep throughout. Previously if the prolog, epilog, or + body were stored with a different linesep, that linesep was used. This + fix corrects an RFC non-compliance issue with smtplib.send_message. -- Issue #12551: Provide a get_channel_binding() method on SSL sockets so as - to get channel binding data for the current SSL session (only the - "tls-unique" channel binding is implemented). This allows the implementation - of certain authentication mechanisms such as SCRAM-SHA-1-PLUS. Patch by - Jacek Konieczny. +- Issue #17278: Fix a crash in heapq.heappush() and heapq.heappop() when + the list is being resized concurrently. -- Issue #665194: email.utils now has format_datetime and parsedate_to_datetime - functions, allowing for round tripping of RFC2822 format dates. +- Issue #16962: Use getdents64 instead of the obsolete getdents syscall + in the subprocess module on Linux. -- Issue #12571: Add a plat-linux3 directory mirroring the plat-linux2 - directory, so that "import DLFCN" and other similar imports work on - Linux 3.0. +- Issue #16935: unittest now counts the module as skipped if it raises SkipTest, + instead of counting it as an error. Patch by Zachary Ware. -- Issue #7484: smtplib no longer puts <> around addresses in VRFY and EXPN - commands; they aren't required and in fact postfix doesn't support that form. +- Issue #17018: Make Process.join() retry if os.waitpid() fails with EINTR. -- Issue #12273: Remove ast.__version__. AST changes can be accounted for by - checking sys.version_info or sys._mercurial. +- Issue #17223: array module: Fix a crasher when converting an array containing + invalid characters (outside range [U+0000; U+10ffff]) to Unicode: + repr(array), str(array) and array.tounicode(). Patch written by Manuel Jacob. -- Silence spurious "broken pipe" tracebacks when shutting down a - ProcessPoolExecutor. +- Issue #17197: profile/cProfile modules refactored so that code of run() and + runctx() utility functions is not duplicated in both modules. -- Fix potential resource leaks in concurrent.futures.ProcessPoolExecutor - by joining all queues and processes when shutdown() is called. +- Issue #14720: sqlite3: Convert datetime microseconds correctly. + Patch by Lowe Thiderman. -- Issue #11603: Fix a crash when __str__ is rebound as __repr__. Patch by - Andreas Stührk. +- Issue #15132: Allow a list for the defaultTest argument of + unittest.TestProgram. Patch by Jyrki Pulliainen. -- Issue #11321: Fix a crash with multiple imports of the _pickle module when - embedding Python. Patch by Andreas Stührk. +- Issue #17225: JSON decoder now counts columns in the first line starting + with 1, as in other lines. -- Issue #6755: Add get_wch() method to curses.window class. Patch by Iñigo - Serna. +- Issue #6623: Added explicit DeprecationWarning for ftplib.netrc, which has + been deprecated and undocumented for a long time. -- Add cgi.closelog() function to close the log file. +- Issue #13700: Fix byte/string handling in imaplib authentication when an + authobject is specified. -- Issue #12502: asyncore: fix polling loop with AF_UNIX sockets. +- Issue #13153: Tkinter functions now raise TclError instead of ValueError when + a string argument contains non-BMP character. -- Issue #4376: ctypes now supports nested structures in a endian different than - the parent structure. Patch by Vlad Riscutia. +- Issue #9669: Protect re against infinite loops on zero-width matching in + non-greedy repeat. Patch by Matthew Barnett. -- Raise ValueError when attempting to set the _CHUNK_SIZE attribute of a - TextIOWrapper to a huge value, not TypeError. +- Issue #13169: The maximal repetition number in a regular expression has been + increased from 65534 to 2147483647 (on 32-bit platform) or 4294967294 (on + 64-bit). -- Issue #12504: Close file handles in a timely manner in packaging.database. - This fixes a bug with the remove (uninstall) feature on Windows. +- Issue #17143: Fix a missing import in the trace module. Initial patch by + Berker Peksag. -- Issues #12169 and #10510: Factor out code used by various packaging commands - to make HTTP POST requests, and make sure it uses CRLF. +- Issue #15220: email.feedparser's line splitting algorithm is now simpler and + faster. -- Issue #12016: Multibyte CJK decoders now resynchronize faster. They only - ignore the first byte of an invalid byte sequence. For example, - b'\xff\n'.decode('gb2312', 'replace') gives '\ufffd\n' instead of '\ufffd'. +- Issue #16743: Fix mmap overflow check on 32 bit Windows. -- Issue #12459: time.sleep() now raises a ValueError if the sleep length is - negative, instead of an infinite sleep on Windows or raising an IOError on - Linux for example, to have the same behaviour on all platforms. +- Issue #16996: webbrowser module now uses shutil.which() to find a + web-browser on the executable search path. -- Issue #12451: pydoc: html_getfile() now uses tokenize.open() to support - Python scripts using a encoding different than UTF-8 (read the coding cookie - of the script). +- Issue #16800: tempfile.gettempdir() no longer left temporary files when + the disk is full. Original patch by Amir Szekely. -- Issue #12493: subprocess: Popen.communicate() now also handles EINTR errors - if the process has only one pipe. +- Issue #17192: Import libffi-3.0.12. -- Issue #12467: warnings: fix a race condition if a warning is emitted at - shutdown, if globals()['__file__'] is None. +- Issue #16564: Fixed regression relative to Python2 in the operation of + email.encoders.encode_7or8bit when used with binary data. -- Issue #12451: pydoc: importfile() now opens the Python script in binary mode, - instead of text mode using the locale encoding, to avoid encoding issues. +- Issue #17052: unittest discovery should use self.testLoader. -- Issue #12451: runpy: run_path() now opens the Python script in binary mode, - instead of text mode using the locale encoding, to support other encodings - than UTF-8 (scripts using the coding cookie). +- Issue #4591: Uid and gid values larger than 2**31 are supported now. -- Issue #12451: xml.dom.pulldom: parse() now opens files in binary mode instead - of the text mode (using the locale encoding) to avoid encoding issues. +- Issue #17141: random.vonmisesvariate() no longer hangs for large kappas. -- Issue #12147: Adjust the new-in-3.2 smtplib.send_message method for better - conformance to the RFCs: correctly handle Sender and Resent- headers. +- Issue #17149: Fix random.vonmisesvariate to always return results in + [0, 2*math.pi]. -- Issue #12352: Fix a deadlock in multiprocessing.Heap when a block is freed by - the garbage collector while the Heap lock is held. +- Issue #1470548: XMLGenerator now works with binary output streams. -- Issue #12462: time.sleep() now immediately calls the (Python) signal handler - if it is interrupted by a signal, instead of having to wait until the next - instruction. +- Issue #6975: os.path.realpath() now correctly resolves multiple nested + symlinks on POSIX platforms. -- Issue #12442: new shutil.disk_usage function, providing total, used and free - disk space statistics. +- Issue #13773: sqlite3.connect() gets a new `uri` parameter to pass the + filename as a URI, allowing to pass custom options. -- Issue #12451: The XInclude default loader of xml.etree now decodes files from - UTF-8 instead of the locale encoding if the encoding is not specified. It now - also opens XML files for the parser in binary mode instead of the text mode - to avoid encoding issues. +- Issue #16564: Fixed regression relative to Python2 in the operation of + email.encoders.encode_noop when used with binary data. -- Issue #12451: doctest.debug_script() doesn't create a temporary file - anymore to avoid encoding issues. +- Issue #10355: The mode, name, encoding and newlines properties now work on + SpooledTemporaryFile objects even when they have not yet rolled over. + Obsolete method xreadline (which has never worked in Python 3) has been + removed. -- Issue #12451: pydoc.synopsis() now reads the encoding cookie if available, - to read the Python script from the right encoding. +- Issue #16686: Fixed a lot of bugs in audioop module. Fixed crashes in + avgpp(), maxpp() and ratecv(). Fixed an integer overflow in add(), bias(), + and ratecv(). reverse(), lin2lin() and ratecv() no more lose precision for + 32-bit samples. max() and rms() no more returns a negative result and + various other functions now work correctly with 32-bit sample -0x80000000. -- Issue #12451: distutils now opens the setup script in binary mode to read the - encoding cookie, instead of opening it in UTF-8. +- Issue #17073: Fix some integer overflows in sqlite3 module. -- Issue #9516: On Mac OS X, change Distutils to no longer globally attempt to - check or set the MACOSX_DEPLOYMENT_TARGET environment variable for the - interpreter process. This could cause failures in non-Distutils subprocesses - and was unreliable since tests or user programs could modify the interpreter - environment after Distutils set it. Instead, have Distutils set the - deployment target only in the environment of each build subprocess. It is - still possible to globally override the default by setting - MACOSX_DEPLOYMENT_TARGET before launching the interpreter; its value must be - greater or equal to the default value, the value with which the interpreter - was built. Also, implement the same handling in packaging. +- Issue #16723: httplib.HTTPResponse no longer marked closed when the connection + is automatically closed. -- Issue #12422: In the copy module, don't store objects that are their own copy - in the memo dict. +- Issue #15359: Add CAN_BCM protocol support to the socket module. Patch by + Brian Thorne. -- Issue #12303: Add sigwaitinfo() and sigtimedwait() to the signal module. +- Issue #16948: Fix quoted printable body encoding for non-latin1 character + sets in the email package. -- Issue #12404: Remove C89 incompatible code from mmap module. Patch by Akira - Kitada. +- Issue #16811: Fix folding of headers with no value in the provisional email + policies. -- Issue #1874: email now detects and reports as a defect the presence of - any CTE other than 7bit, 8bit, or binary on a multipart. +- Issue #17132: Update symbol for "yield from" grammar changes. -- Issue #12383: Fix subprocess module with env={}: don't copy the environment - variables, start with an empty environment. +- Issue #17076: Make copying of xattrs more tolerant of missing FS support. + Patch by Thomas Wouters. -- Issue #11637: Fix support for importing packaging setup hooks from the - project directory. +- Issue #17089: Expat parser now correctly works with string input when the + internal XML encoding is not UTF-8 or US-ASCII. It also now accepts bytes + and strings larger than 2 GiB. -- Issue #6771: Moved the curses.wrapper function from the single-function - wrapper module into __init__, eliminating the module. Since __init__ was - already importing the function to curses.wrapper, there is no API change. +- Issue #6083: Fix multiple segmentation faults occured when PyArg_ParseTuple + parses nested mutating sequence. -- Issue #11584: email.header.decode_header no longer fails if the header - passed to it is a Header object, and Header/make_header no longer fail - if given binary unknown-8bit input. +- Issue #5289: Fix ctypes.util.find_library on Solaris. -- Issue #11700: mailbox proxy object close methods can now be called multiple - times without error. +- Issue #17106: Fix a segmentation fault in io.TextIOWrapper when an underlying + stream or a decoder produces data of an unexpected type (i.e. when + io.TextIOWrapper initialized with text stream or use bytes-to-bytes codec). -- Issue #11767: Correct file descriptor leak in mailbox's __getitem__ method. +- Issue #17015: When it has a spec, a Mock object now inspects its signature + when matching calls, so that arguments can be matched positionally or + by name. -- Issue #12133: AbstractHTTPHandler.do_open() of urllib.request closes the HTTP - connection if its getresponse() method fails with a socket error. Patch - written by Ezio Melotti. +- Issue #15633: httplib.HTTPResponse is now mark closed when the server + sends less than the advertised Content-Length. -- Issue #12240: Allow multiple setup hooks in packaging's setup.cfg files. - Original patch by Erik Bray. +- Issue #12268: The io module file object write methods no longer abort early + when one of its write system calls is interrupted (EINTR). -- Issue #9284: Allow inspect.findsource() to find the source of doctest - functions. +- Issue #6972: The zipfile module no longer overwrites files outside of + its destination path when extracting malicious zip files. -- Issue #11595: Fix assorted bugs in packaging.util.cfg_to_args, a - compatibility helper for the distutils-packaging transition. Original patch - by Erik Bray. +- Issue #4844: ZipFile now raises BadZipFile when opens a ZIP file with an + incomplete "End of Central Directory" record. Original patch by Guilherme + Polo and Alan McIntyre. -- Issue #12287: In ossaudiodev, check that the device isn't closed in several - methods. +- Issue #17071: Signature.bind() now works when one of the keyword arguments + is named ``self``. -- Issue #12009: Fixed regression in netrc file comment handling. +- Issue #12004: Fix an internal error in PyZipFile when writing an invalid + Python file. Patch by Ben Morgan. -- Issue #12246: Warn and fail when trying to install a third-party project from - an uninstalled Python (built in a source checkout). Original patch by - Tshepang Lekhonkhobe. +- Have py_compile use importlib as much as possible to avoid code duplication. + Code now raises FileExistsError if the file path to be used for the + byte-compiled file is a symlink or non-regular file as a warning that import + will not keep the file path type if it writes to that path. -- Issue #10694: zipfile now ignores garbage at the end of a zipfile. +- Issue #16972: Have site.addpackage() consider already known paths even when + none are explicitly passed in. Bug report and fix by Kirill. -- Issue #12283: Fixed regression in smtplib quoting of leading dots in DATA. +- Issue #1602133: on Mac OS X a shared library build (``--enable-shared``) + now fills the ``os.environ`` variable correctly. -- Issue #10424: Argparse now includes the names of the missing required - arguments in the missing arguments error message. +- Issue #15505: `unittest.installHandler` no longer assumes SIGINT handler is + set to a callable object. -- Issue #12168: SysLogHandler now allows NUL termination to be controlled using - a new 'append_nul' attribute on the handler. +- Issue #13454: Fix a crash when deleting an iterator created by itertools.tee() + if all other iterators were very advanced before. -- Issue #11583: Speed up os.path.isdir on Windows by using GetFileAttributes - instead of os.stat. +- Issue #12411: Fix to cgi.parse_multipart to correctly use bytes boundaries + and bytes data. Patch by Jonas Wagner. -- Issue #12021: Make mmap's read() method argument optional. Patch by Petri - Lehtinen. +- Issue #16957: shutil.which() no longer searches a bare file name in the + current directory on Unix and no longer searches a relative file path with + a directory part in PATH directories. Patch by Thomas Kluyver. -- Issue #9205: concurrent.futures.ProcessPoolExecutor now detects killed - children and raises BrokenProcessPool in such a situation. Previously it - would reliably freeze/deadlock. +- Issue #1159051: GzipFile now raises EOFError when reading a corrupted file + with truncated header or footer. -- Issue #12040: Expose a new attribute ``sentinel`` on instances of - ``multiprocessing.Process``. Also, fix Process.join() to not use polling - anymore, when given a timeout. +- Issue #16993: shutil.which() now preserves the case of the path and extension + on Windows. -- Issue #11893: Remove obsolete internal wrapper class ``SSLFakeFile`` in the - smtplib module. Patch by Catalin Iacob. +- Issue #16992: On Windows in signal.set_wakeup_fd, validate the file + descriptor argument. -- Issue #12080: Fix a Decimal.power() case that took an unreasonably long time - to compute. +- Issue #16422: For compatibility with the Python version, the C version of + decimal now uses strings instead of integers for rounding mode constants. -- Issue #12221: Remove __version__ attributes from pyexpat, pickle, tarfile, - pydoc, tkinter, and xml.parsers.expat. This were useless version constants - left over from the Mercurial transition +- Issue #15861: tkinter now correctly works with lists and tuples containing + strings with whitespaces, backslashes or unbalanced braces. -- Named tuples now work correctly with vars(). +- Issue #9720: zipfile now writes correct local headers for files larger than + 4 GiB. -- Issue #12085: Fix an attribute error in subprocess.Popen destructor if the - constructor has failed, e.g. because of an undeclared keyword argument. Patch - written by Oleg Oshmyan. +- Issue #16955: Fix the poll() method for multiprocessing's socket + connections on Windows. -- Issue #12028: Make threading._get_ident() public, rename it to - threading.get_ident() and document it. This function was already used using - _thread.get_ident(). +- SSLContext.load_dh_params() now properly closes the input file. -- Issue #12171: IncrementalEncoder.reset() of CJK codecs (multibytecodec) calls - encreset() instead of decreset(). +- Issue #15031: Refactor some .pyc management code to cut down on code + duplication. Thanks to Ronan Lamy for the report and taking an initial stab + at the problem. -- Issue #12218: Removed wsgiref.egg-info. +- Issue #16398: Optimize deque.rotate() so that it only moves pointers + and doesn't touch the underlying data with increfs and decrefs. -- Issue #12196: Add pipe2() to the os module. +- Issue #16900: Issue a ResourceWarning when an ssl socket is left unclosed. -- Issue #985064: Make plistlib more resilient to faulty input plists. - Patch by Mher Movsisyan. +- Issue #13899: \A, \Z, and \B now correctly match the A, Z, and B literals + when used inside character classes (e.g. '[\A]'). Patch by Matthew Barnett. -- Issue #1625: BZ2File and bz2.decompress() now support multi-stream files. - Initial patch by Nir Aides. +- Issue #15545: Fix regression in sqlite3's iterdump method where it was + failing if the connection used a row factory (such as sqlite3.Row) that + produced unsortable objects. (Regression was introduced by fix for 9750). -- Issue #12175: BufferedReader.read(-1) now calls raw.readall() if available. +- fcntl: add F_DUPFD_CLOEXEC constant, available on Linux 2.6.24+. -- Issue #12175: FileIO.readall() now only reads the file position and size - once. +- Issue #15972: Fix error messages when os functions expecting a file name or + file descriptor receive the incorrect type. -- Issue #12175: RawIOBase.readall() now returns None if read() returns None. +- Issue #8109: The ssl module now has support for server-side SNI, thanks + to a :meth:`SSLContext.set_servername_callback` method. Patch by Daniel + Black. -- Issue #12175: FileIO.readall() now raises a ValueError instead of an IOError - if the file is closed. +- Issue #16860: In tempfile, use O_CLOEXEC when available to set the + close-on-exec flag atomically. -- Issue #11109: New service_action method for BaseServer, used by ForkingMixin - class for cleanup. Initial Patch by Justin Warkentin. +- Issue #16674: random.getrandbits() is now 20-40% faster for small integers. -- Issue #12045: Avoid duplicate execution of command in - ctypes.util._get_soname(). Patch by Sijin Joseph. +- Issue #16009: JSON error messages now provide more information. -- Issue #10818: Remove the Tk GUI and the serve() function of the pydoc module, - pydoc -g has been deprecated in Python 3.2 and it has a new enhanced web - server. +- Issue #16828: Fix error incorrectly raised by bz2.compress(b'') and + bz2.BZ2Compressor.compress(b''). Initial patch by Martin Packman. -- Issue #1441530: In imaplib, read the data in one chunk to speed up large - reads and simplify code. +- Issue #16833: In http.client.HTTPConnection, do not concatenate the request + headers and body when the payload exceeds 16 KB, since it can consume more + memory for no benefit. Patch by Benno Leslie. -- Issue #12070: Fix the Makefile parser of the sysconfig module to handle - correctly references to "bogus variable" (e.g. "prefix=$/opt/python"). +- Issue #16541: tk_setPalette() now works with keyword arguments. -- Issue #12100: Don't reset incremental encoders of CJK codecs at each call to - their encode() method anymore, but continue to call the reset() method if the - final argument is True. +- Issue #16820: In configparser, `parser.popitem()` no longer raises ValueError. + This makes `parser.clean()` work correctly. -- Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl - module. +- Issue #16820: In configparser, ``parser['section'] = {}`` now preserves + section order within the parser. This makes `parser.update()` preserve section + order as well. -- Issue #6501: os.device_encoding() returns None on Windows if the application - has no console. +- Issue #16820: In configparser, ``parser['DEFAULT'] = {}`` now correctly + clears previous values stored in the default section. Same goes for + ``parser.update({'DEFAULT': {}})``. -- Issue #12105: Add O_CLOEXEC to the os module. +- Issue #9586: Redefine SEM_FAILED on MacOSX to keep compiler happy. -- Issue #12079: Decimal('Infinity').fma(Decimal('0'), (3.91224318126786e+19+0j)) - now raises TypeError (reflecting the invalid type of the 3rd argument) rather - than Decimal.InvalidOperation. +- Issue #16787: Increase asyncore and asynchat default output buffers size, to + decrease CPU usage and increase throughput. -- Issue #12124: zipimport doesn't keep a reference to zlib.decompress() anymore - to be able to unload the module. +- Issue #10527: make multiprocessing use poll() instead of select() if available. -- Add the packaging module, an improved fork of distutils (also known as - distutils2). +- Issue #16688: Now regexes contained backreferences correctly work with + non-ASCII strings. Patch by Matthew Barnett. -- Issue #12065: connect_ex() on an SSL socket now returns the original errno - when the socket's timeout expires (it used to return None). +- Issue #16486: Make aifc files act as context managers. -- Issue #8809: The SMTP_SSL constructor and SMTP.starttls() now support - passing a ``context`` argument pointing to an ssl.SSLContext instance. - Patch by Kasun Herath. +- Issue #16485: Now file descriptors are closed if file header patching failed + on closing an aifc file. -- Issue #9516: Issue #9516: avoid errors in sysconfig when MACOSX_DEPLOYMENT_TARGET - is set in shell. +- Issue #16640: Run less code under a lock in sched module. -- Issue #8650: Make zlib module 64-bit clean. compress(), decompress() and - their incremental counterparts now raise OverflowError if given an input - larger than 4GB, instead of silently truncating the input and returning - an incorrect result. +- Issue #16165: sched.scheduler.run() no longer blocks a scheduler for other + threads. -- Issue #12050: zlib.decompressobj().decompress() now clears the unconsumed_tail - attribute when called without a max_length argument. +- Issue #16641: Default values of sched.scheduler.enter() are no longer + modifiable. -- Issue #12062: Fix a flushing bug when doing a certain type of I/O sequence - on a file opened in read+write mode (namely: reading, seeking a bit forward, - writing, then seeking before the previous write but still within buffered - data, and writing again). +- Issue #16618: Make glob.glob match consistently across strings and bytes + regarding leading dots. Patch by Serhiy Storchaka. -- Issue #9971: Write an optimized implementation of BufferedReader.readinto(). - Patch by John O'Connor. +- Issue #16788: Add samestat to Lib/ntpath.py -- Issue #11799: urllib.request Authentication Handlers will raise a ValueError - when presented with an unsupported Authentication Scheme. Patch contributed - by Yuval Greenfield. +- Issue #16713: Parsing of 'tel' urls using urlparse separates params from + path. -- Issue #10419, #6011: build_scripts command of distutils handles correctly - non-ASCII path (path to the Python executable). Open and write the script in - binary mode, but ensure that the shebang is decodable from UTF-8 and from the - encoding of the script. +- Issue #16443: Add docstrings to regular expression match objects. + Patch by Anton Kasyanov. -- Issue #8498: In socket.accept(), allow to specify 0 as a backlog value in - order to accept exactly one connection. Patch by Daniel Evers. +- Issue #15701: Fix HTTPError info method call to return the headers information. -- Issue #12011: signal.signal() and signal.siginterrupt() raise an OSError, - instead of a RuntimeError: OSError has an errno attribute. +- Issue #16752: Add a missing import to modulefinder. Patch by Berker Peksag. -- Issue #3709: add a flush_headers method to BaseHTTPRequestHandler, which - manages the sending of headers to output stream and flushing the internal - headers buffer. Patch contribution by Andrew Schaaf +- Issue #16646: ftplib.FTP.makeport() might lose socket error details. + (patch by Serhiy Storchaka) -- Issue #11743: Rewrite multiprocessing connection classes in pure Python. +- Issue #16626: Fix infinite recursion in glob.glob() on Windows when the + pattern contains a wildcard in the drive or UNC path. Patch by Serhiy + Storchaka. -- Issue #11164: Stop trying to use _xmlplus in the xml module. +- Issue #15783: Except for the number methods, the C version of decimal now + supports all None default values present in decimal.py. These values were + largely undocumented. -- Issue #11888: Add log2 function to math module. Patch written by Mark - Dickinson. +- Issue #11175: argparse.FileType now accepts encoding and errors + arguments. Patch by Lucas Maystre. -- Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional. +- Issue #16488: epoll() objects now support the `with` statement. Patch + by Serhiy Storchaka. -- Issue #8407: The signal handler writes the signal number as a single byte - instead of a nul byte into the wakeup file descriptor. So it is possible to - wait more than one signal and know which signals were raised. +- Issue #16298: In HTTPResponse.read(), close the socket when there is no + Content-Length and the incoming stream is finished. Patch by Eran + Rundstein. -- Issue #8407: Add pthread_kill(), sigpending() and sigwait() functions to the - signal module. +- Issue #16049: Add abc.ABC class to enable the use of inheritance to create + ABCs, rather than the more cumbersome metaclass=ABCMeta. Patch by Bruno + Dupuis. -- Issue #11927: SMTP_SSL now uses port 465 by default as documented. Patch - by Kasun Herath. +- Expose the TCP_FASTOPEN and MSG_FASTOPEN flags in socket when they're + available. -- Issue #12002: ftplib's abort() method raises TypeError. +- Issue #15701: Add a .headers attribute to urllib.error.HTTPError. Patch + contributed by Berker Peksag. -- Issue #11916: Add a number of MacOSX specific definitions to the errno module. - Patch by Pierre Carrier. +- Issue #15872: Fix 3.3 regression introduced by the new fd-based shutil.rmtree + that caused it to not ignore certain errors when ignore_errors was set. + Patch by Alessandro Moura and Serhiy Storchaka. -- Issue #11999: fixed sporadic sync failure mailbox.Maildir due to its trying to - detect mtime changes by comparing to the system clock instead of to the - previous value of the mtime. +- Issue #16248: Disable code execution from the user's home directory by + tkinter when the -E flag is passed to Python. Patch by Zachary Ware. -- Issue #11072: added MLSD command (RFC-3659) support to ftplib. +- Issue #13390: New function :func:`sys.getallocatedblocks()` returns the + number of memory blocks currently allocated. -- Issue #8808: The IMAP4_SSL constructor now allows passing an SSLContext - parameter to control parameters of the secure channel. Patch by Sijin - Joseph. +- Issue #16628: Fix a memory leak in ctypes.resize(). -- ntpath.samefile failed to notice that "a.txt" and "A.TXT" refer to the same - file on Windows XP. As noticed in issue #10684. +- Issue #13614: Fix setup.py register failure with invalid rst in description. + Patch by Julien Courteau and Pierre Paul Lefebvre. -- Issue #12000: When a SSL certificate has a subjectAltName without any - dNSName entry, ssl.match_hostname() should use the subject's commonName. - Patch by Nicolas Bareil. +- Issue #13512: Create ~/.pypirc securely (CVE-2011-4944). Initial patch by + Philip Jenvey, tested by Mageia and Debian. -- Issue #10775: assertRaises, assertRaisesRegex, assertWarns, and - assertWarnsRegex now accept a keyword argument 'msg' when used as context - managers. Initial patch by Winston Ewert. +- Issue #7719: Make distutils ignore ``.nfs*`` files instead of choking later + on. Initial patch by SilentGhost and Jeff Ramnani. -- Issue #10684: shutil.move used to delete a folder on case insensitive - filesystems when the source and destination name where the same except - for the case. +- Issue #13120: Allow to call pdb.set_trace() from thread. + Patch by Ilya Sandler. -- Issue #11647: objects created using contextlib.contextmanager now support - more than one call to the function when used as a decorator. Initial patch - by Ysj Ray. +- Issue #16585: Make CJK encoders support error handlers that return bytes per + PEP 383. -- Issue #11930: Removed deprecated time.accept2dyear variable. - Removed year >= 1000 restriction from datetime.strftime. +- Issue #10182: The re module doesn't truncate indices to 32 bits anymore. + Patch by Serhiy Storchaka. -- logging: don't define QueueListener if Python has no thread support. +- Issue #16333: use (",", ": ") as default separator in json when indent is + specified, to avoid trailing whitespace. Patch by Serhiy Storchaka. -- functools.cmp_to_key() now works with collections.Hashable(). +- Issue #16573: In 2to3, treat enumerate() like a consuming call, so superfluous + list() calls aren't added to filter(), map(), and zip() which are directly + passed enumerate(). -- Issue #11277: mmap.mmap() calls fcntl(fd, F_FULLFSYNC) on Mac OS X to get - around a mmap bug with sparse files. Patch written by Steffen Daode Nurpmeso. +- Issue #16464: Reset the Content-Length header when a urllib Request is reused + with new data. -- Issue #8407: Add signal.pthread_sigmask() function to fetch and/or change the - signal mask of the calling thread. +- Issue #12848: The pure Python pickle implementation now treats object + lengths as unsigned 32-bit integers, like the C implementation does. + Patch by Serhiy Storchaka. -- Issue #11858: configparser.ExtendedInterpolation expected lower-case section - names. +- Issue #16423: urllib.request now has support for ``data:`` URLs. Patch by + Mathias Panzenböck. -- Issue #11324: ConfigParser(interpolation=None) now works correctly. +- Issue #4473: Add a POP3.stls() to switch a clear-text POP3 session into + an encrypted POP3 session, on supported servers. Patch by Lorenzo Catucci. -- Issue #11811: ssl.get_server_certificate() is now IPv6-compatible. Patch - by Charles-François Natali. +- Issue #4473: Add a POP3.capa() method to query the capabilities advertised + by the POP3 server. Patch by Lorenzo Catucci. -- Issue #11763: don't use difflib in TestCase.assertMultiLineEqual if the - strings are too long. +- Issue #4473: Ensure the socket is shutdown cleanly in POP3.close(). + Patch by Lorenzo Catucci. -- Issue #11236: getpass.getpass responds to ctrl-c or ctrl-z on terminal. +- Issue #16522: added FAIL_FAST flag to doctest. -- Issue #11856: Speed up parsing of JSON numbers. +- Issue #15627: Add the importlib.abc.InspectLoader.source_to_code() method. -- Issue #11005: threading.RLock()._release_save() raises a RuntimeError if the - lock was not acquired. +- Issue #16408: Fix file descriptors not being closed in error conditions + in the zipfile module. Patch by Serhiy Storchaka. -- Issue #11258: Speed up ctypes.util.find_library() under Linux by a factor - of 5 to 10. Initial patch by Jonas H. +- Issue #14631: Add a new :class:`weakref.WeakMethod` to simulate weak + references to bound methods. -- Issue #11382: Trivial system calls, such as dup() or pipe(), needn't - release the GIL. Patch by Charles-François Natali. +- Issue #16469: Fix exceptions from float -> Fraction and Decimal -> Fraction + conversions for special values to be consistent with those for float -> int + and Decimal -> int. Patch by Alexey Kachayev. -- Issue #11223: Add threading._info() function providing informations about - the thread implementation. +- Issue #16481: multiprocessing no longer leaks process handles on Windows. -- Issue #11731: simplify/enhance email parser/generator API by introducing - policy objects. +- Issue #12428: Add a pure Python implementation of functools.partial(). + Patch by Brian Thorne. -- Issue #11768: The signal handler of the signal module only calls - Py_AddPendingCall() for the first signal to fix a deadlock on reentrant or - parallel calls. PyErr_SetInterrupt() writes also into the wake up file. +- Issue #16140: The subprocess module no longer double closes its child + subprocess.PIPE parent file descriptors on child error prior to exec(). -- Issue #11492: fix several issues with header folding in the email package. +- Remove a bare print to stdout from the subprocess module that could have + happened if the child process wrote garbage to its pre-exec error pipe. -- Issue #11852: Add missing imports and update tests. +- The subprocess module now raises its own SubprocessError instead of a + RuntimeError in various error situations which should not normally happen. -- Issue #11875: collections.OrderedDict's __reduce__ was temporarily - mutating the object instead of just working on a copy. +- Issue #16327: The subprocess module no longer leaks file descriptors + used for stdin/stdout/stderr pipes to the child when fork() fails. -- Issue #11467: Fix urlparse behavior when handling urls which contains scheme - specific part only digits. Patch by Santoso Wijaya. +- Issue #14396: Handle the odd rare case of waitpid returning 0 when not + expected in subprocess.Popen.wait(). -- collections.Counter().copy() now works correctly for subclasses. +- Issue #16411: Fix a bug where zlib.decompressobj().flush() might try to access + previously-freed memory. Patch by Serhiy Storchaka. -- Issue #11474: Fix the bug with url2pathname() handling of '/C|/' on Windows. - Patch by Santoso Wijaya. +- Issue #16357: fix calling accept() on a SSLSocket created through + SSLContext.wrap_socket(). Original patch by Jeff McNeil. -- Issue #11684: complete email.parser bytes API by adding BytesHeaderParser. +- Issue #16409: The reporthook callback made by the legacy + urllib.request.urlretrieve API now properly supplies a constant non-zero + block_size as it did in Python 3.2 and 2.7. This matches the behavior of + urllib.request.URLopener.retrieve. -- The bz2 module now handles 4GiB+ input buffers correctly. +- Issue #16431: Use the type information when constructing a Decimal subtype + from a Decimal argument. -- Issue #9233: Fix json.loads('{}') to return a dict (instead of a list), when - _json is not available. +- Issue #15641: Clean up deprecated classes from importlib + Patch by Taras Lyapun. -- Issue #11830: Remove unnecessary introspection code in the decimal module. +- Issue #16350: zlib.decompressobj().decompress() now accumulates data from + successive calls after EOF in unused_data, instead of only saving the argument + to the last call. decompressobj().flush() now correctly sets unused_data and + unconsumed_tail. A bug in the handling of MemoryError when setting the + unconsumed_tail attribute has also been fixed. Patch by Serhiy Storchaka. -- Issue #11703: urllib2.geturl() does not return correct url when the original - url contains #fragment. +- Issue #12759: sre_parse now raises a proper error when the name of the group + is missing. Initial patch by Serhiy Storchaka. -- Issue #10019: Fixed regression in json module where an indent of 0 stopped - adding newlines and acted instead like 'None'. +- Issue #16152: fix tokenize to ignore whitespace at the end of the code when + no newline is found. Patch by Ned Batchelder. -- Issue #11186: pydoc ignores a module if its name contains a surrogate - character in the index of modules. +- Issue #16284: Prevent keeping unnecessary references to worker functions + in concurrent.futures ThreadPoolExecutor. -- Issue #11815: Use a light-weight SimpleQueue for the result queue in - concurrent.futures.ProcessPoolExecutor. +- Issue #16230: Fix a crash in select.select() when one the lists changes + size while iterated on. Patch by Serhiy Storchaka. -- Issue #5162: Treat services like frozen executables to allow child spawning - from multiprocessing.forking on Windows. +- Issue #16228: Fix a crash in the json module where a list changes size + while it is being encoded. Patch by Serhiy Storchaka. -- logging.basicConfig now supports an optional 'handlers' argument taking an - iterable of handlers to be added to the root logger. Additional parameter - checks were also added to basicConfig. +- Issue #16351: New function gc.get_stats() returns per-generation collection + statistics. -- Issue #11814: Fix likely typo in multiprocessing.Pool._terminate(). +- Issue #14897: Enhance error messages of struct.pack and + struct.pack_into. Patch by Matti Mäki. -- Issue #11747: Fix range formatting in difflib.context_diff() and - difflib.unified_diff(). +- Issue #16316: mimetypes now recognizes the .xz and .txz (.tar.xz) extensions. + Patch by Serhiy Storchaka. -- Issue #8428: Fix a race condition in multiprocessing.Pool when terminating - worker processes: new processes would be spawned while the pool is being - shut down. Patch by Charles-François Natali. +- Issue #12890: cgitb no longer prints spurious

tags in text + mode when the logdir option is specified. -- Issue #2650: re.escape() no longer escapes the '_'. +- Issue #16307: Fix multiprocessing.Pool.map_async not calling its callbacks. + Patch by Janne Karila. -- Issue #11757: select.select() now raises ValueError when a negative timeout - is passed (previously, a select.error with EINVAL would be raised). Patch - by Charles-François Natali. +- Issue #16305: Fix a segmentation fault occurring when interrupting + math.factorial. -- Issue #7311: fix html.parser to accept non-ASCII attribute values. +- Issue #16116: Fix include and library paths to be correct when building C + extensions in venvs. -- Issue #11605: email.parser.BytesFeedParser was incorrectly converting - multipart subparts with an 8-bit CTE into unicode instead of preserving the - bytes. +- Issue #16245: Fix the value of a few entities in html.entities.html5. -- Issue #1690608: email.util.formataddr is now RFC 2047 aware: it now has a - charset parameter that defaults to utf-8 and is used as the charset for RFC - 2047 encoding when the realname contains non-ASCII characters. +- Issue #16301: Fix the localhost verification in urllib/request.py for file:// + urls. -- Issue #10963: Ensure that subprocess.communicate() never raises EPIPE. +- Issue #16250: Fix the invocations of URLError which had misplaced filename + attribute for exception. -- Issue #10791: Implement missing method GzipFile.read1(), allowing GzipFile - to be wrapped in a TextIOWrapper. Patch by Nadeem Vawda. +- Issue #10836: Fix exception raised when file not found in urlretrieve + Initial patch by Ezio Melotti. -- Issue #11707: Added a fast C version of functools.cmp_to_key(). - Patch by Filip Gruszczyński. +- Issue #14398: Fix size truncation and overflow bugs in the bz2 module. -- Issue #11688: Add sqlite3.Connection.set_trace_callback(). Patch by - Torsten Landschoff. +- Issue #12692: Fix resource leak in urllib.request when talking to an HTTP + server that does not include a ``Connection: close`` header in its responses. -- Issue #11746: Fix SSLContext.load_cert_chain() to accept elliptic curve - private keys. +- Issue #12034: Fix bogus caching of result in check_GetFinalPathNameByHandle. + Patch by Atsuo Ishimoto. -- Issue #5863: Rewrite BZ2File in pure Python, and allow it to accept - file-like objects using a new ``fileobj`` constructor argument. Patch by - Nadeem Vawda. +- Improve performance of `lzma.LZMAFile` (see also issue #16034). -- unittest.TestCase.assertSameElements has been removed. +- Issue #16220: wsgiref now always calls close() on an iterable response. + Patch by Brent Tubbs. -- sys.getfilesystemencoding() raises a RuntimeError if initfsencoding() was not - called yet: detect bootstrap (startup) issues earlier. +- Issue #16270: urllib may hang when used for retrieving files via FTP by using + a context manager. Patch by Giampaolo Rodola'. -- Issue #11393: Add the new faulthandler module. +- Issue #16461: Wave library should be able to deal with 4GB wav files, + and sample rate of 44100 Hz. -- Issue #11618: Fix the timeout logic in threading.Lock.acquire() under Windows. +- Issue #16176: Properly identify Windows 8 via platform.platform() -- Removed the 'strict' argument to email.parser.Parser, which has been - deprecated since Python 2.4. +- Issue #16088: BaseHTTPRequestHandler's send_error method includes a + Content-Length header in it's response now. Patch by Antoine Pitrou. -- Issue #11256: Fix inspect.getcallargs on functions that take only keyword - arguments. +- Issue #16114: The subprocess module no longer provides a misleading error + message stating that args[0] did not exist when either the cwd or executable + keyword arguments specified a path that did not exist. -- Issue #11696: Fix ID generation in msilib. +- Issue #16169: Fix ctypes.WinError()'s confusion between errno and winerror. -- itertools.accumulate now supports an optional *func* argument for - a user-supplied binary function. +- Issue #16110: logging.fileConfig now accepts a pre-initialised ConfigParser + instance. -- Issue #11692: Remove unnecessary demo functions in subprocess module. +- Issue #1492704: shutil.copyfile() raises a distinct SameFileError now if + source and destination are the same file. Patch by Atsuo Ishimoto. -- Issue #9696: Fix exception incorrectly raised by xdrlib.Packer.pack_int when - trying to pack a negative (in-range) integer. +- Issue #13896: Make shelf instances work with 'with' as context managers. + Original patch by Filip Gruszczyński. -- Issue #11675: multiprocessing.[Raw]Array objects created from an integer size - are now zeroed on creation. This matches the behaviour specified by the - documentation. +- Issue #15417: Add support for csh and fish in venv activation scripts. -- Issue #7639: Fix short file name generation in bdist_msi +- Issue #14377: ElementTree.write and some of the module-level functions have + a new parameter - *short_empty_elements*. It controls how elements with no + contents are emitted. -- Issue #11635: Don't use polling in worker threads and processes launched by - concurrent.futures. +- Issue #16089: Allow ElementTree.TreeBuilder to work again with a non-Element + element_factory (fixes a regression in SimpleTAL). -- Issue #5845: Automatically read readline configuration to enable completion - in interactive mode. +- Issue #9650: List commonly used format codes in time.strftime and + time.strptime docsttings. Original patch by Mike Hoy. -- Issue #6811: Allow importlib to change a code object's co_filename attribute - to match the path to where the source code currently is, not where the code - object originally came from. +- Issue #15452: logging configuration socket listener now has a verify option + that allows an application to apply a verification function to the + received configuration data before it is acted upon. -- Issue #8754: Have importlib use the repr of a module name in error messages. +- Issue #16034: Fix performance regressions in the new `bz2.BZ2File` + implementation. Initial patch by Serhiy Storchaka. -- Issue #11591: Prevent "import site" from modifying sys.path when python - was started with -S. +- `pty.spawn()` now returns the child process status returned by `os.waitpid()`. -- collections.namedtuple() now adds a _source attribute to the generated - class. This make the source more accessible than the outdated - "verbose" option which prints to stdout but doesn't make the source - string available. +- Issue #15756: `subprocess.poll()` now properly handles `errno.ECHILD` to + return a returncode of 0 when the child has already exited or cannot be waited + on. -- Issue #11371: Mark getopt error messages as localizable. Patch by Filip - Gruszczyński. +- Issue #15323: Improve failure message of `Mock.assert_called_once_with()`. -- Issue #11333: Add __slots__ to collections ABCs. +- Issue #16064: ``unittest -m`` claims executable is "python", not "python3". -- Issue #11628: cmp_to_key generated class should use __slots__. +- Issue #12376: Pass on parameters in `TextTestResult.__init__()` super call. -- Issue #11666: let help() display named tuple attributes and methods - that start with a leading underscore. +- Issue #15222: Insert blank line after each message in mbox mailboxes. -- Issue #11662: Make urllib and urllib2 ignore redirections if the - scheme is not HTTP, HTTPS or FTP (CVE-2011-1521). +- Issue #16013: Fix `csv.Reader` parsing issue with ending quote characters. + Patch by Serhiy Storchaka. -- Issue #5537: Fix time2isoz() and time2netscape() functions of - httplib.cookiejar for expiration year greater than 2038 on 32-bit systems. +- Issue #15421: Fix an OverflowError in `Calendar.itermonthdates()` after + `datetime.MAXYEAR`. Patch by Cédric Krier. -- Issue #4391: Use proper gettext plural forms in optparse. +- Issue #16112: platform.architecture does not correctly escape argument to + /usr/bin/file. Patch by David Benjamin. -- Issue #11127: Raise a TypeError when trying to pickle a socket object. +- Issue #15970: `xml.etree.ElementTree` now serializes correctly the empty HTML + elements 'meta' and 'param'. -- Issue #11563: ``Connection: close`` header is sent by requests using URLOpener - class which helps in closing of sockets after connection is over. Patch - contributions by Jeff McNeil and Nadeem Vawda. +- Issue #15842: The `SocketIO.{readable,writable,seekable}` methods now raise + ValueError when the file-like object is closed. Patch by Alessandro Moura. -- Issue #11459: A ``bufsize`` value of 0 in subprocess.Popen() really creates - unbuffered pipes, such that select() works properly on them. +- Issue #15876: Fix a refleak in the `curses` module: window.encoding. -- Issue #5421: Fix misleading error message when one of socket.sendto()'s - arguments has the wrong type. Patch by Nikita Vetoshkin. +- Issue #15881: Fix `atexit` hook in `multiprocessing`. Original patch by Chris + McDonough. -- Issue #10812: Add some extra posix functions to the os module. +- Issue #15841: The readable(), writable() and seekable() methods of + `io.BytesIO` and `io.StringIO` objects now raise ValueError when the object + has been closed. Patch by Alessandro Moura. -- Issue #10979: unittest stdout buffering now works with class and module - setup and teardown. +- Issue #15447: Use `subprocess.DEVNULL` in webbrowser, instead of opening + `os.devnull` explicitly and leaving it open. -- Issue #11243: fix the parameter querying methods of Message to work if - the headers contain un-encoded non-ASCII data. +- Issue #15509: `webbrowser.UnixBrowser` no longer passes empty arguments to + Popen when ``%action`` substitutions produce empty strings. -- Issue #11401: fix handling of headers with no value; this fixes a regression - relative to Python2 and the result is now the same as it was in Python2. +- Issue #12776, issue #11839: Call `argparse` type function (specified by + add_argument) only once. Before, the type function was called twice in the + case where the default was specified and the argument was given as well. This + was especially problematic for the FileType type, as a default file would + always be opened, even if a file argument was specified on the command line. -- Issue #9298: base64 bodies weren't being folded to line lengths less than 78, - which was a regression relative to Python2. Unlike Python2, the last line - of the folded body now ends with a carriage return. +- Issue #15906: Fix a regression in argparse caused by the preceding change, + when ``action='append'``, ``type='str'`` and ``default=[]``. -- Issue #11560: shutil.unpack_archive now correctly handles the format - parameter. Patch by Evan Dandrea. +- Issue #16113: Added sha3 module based on the Keccak reference implementation + 3.2. The `hashlib` module has four additional hash algorithms: `sha3_224`, + `sha3_256`, `sha3_384` and `sha3_512`. As part of the patch some common + code was moved from _hashopenssl.c to hashlib.h. -- Issue #5870: Add `subprocess.DEVNULL` constant. +- ctypes.call_commethod was removed, since its only usage was in the defunct + samples directory. -- Issue #11133: fix two cases where inspect.getattr_static can trigger code - execution. Patch by Andreas Stührk. +- Issue #16692: Added TLSv1.1 and TLSv1.2 support for the ssl modules. -- Issue #11569: use absolute path to the sysctl command in multiprocessing to - ensure that it will be found regardless of the shell PATH. This ensures - that multiprocessing.cpu_count works on default installs of MacOSX. +- Issue #16832: add abc.get_cache_token() to expose cache validity checking + support in ABCMeta. -- Issue #11501: disutils.archive_utils.make_zipfile no longer fails if zlib is - not installed. Instead, the zipfile.ZIP_STORED compression is used to create - the ZipFile. Patch by Natalia B. Bidart. +IDLE +---- -- Issue #11289: `smtp.SMTP` class is now a context manager so it can be used - in a `with` statement. Contributed by Giampaolo Rodola. +- Issue #18429: Format / Format Paragraph, now works when comment blocks + are selected. As with text blocks, this works best when the selection + only includes complete lines. -- Issue #11554: Fixed support for Japanese codecs; previously the body output - encoding was not done if euc-jp or shift-jis was specified as the charset. +- Issue #18226: Add docstrings and unittests for FormatParagraph.py. + Original patches by Todd Rovito and Phil Webster. -- Issue #11407: `TestCase.run` returns the result object used or created. - Contributed by Janathan Hartley. +- Issue #18279: Format - Strip trailing whitespace no longer marks a file as + changed when it has not been changed. This fix followed the addition of a + test file originally written by Phil Webster (the issue's main goal). -- Issue #11500: Fixed a bug in the OS X proxy bypass code for fully qualified - IP addresses in the proxy exception list. +- Issue #7136: In the Idle File menu, "New Window" is renamed "New File". + Patch by Tal Einat, Roget Serwy, and Todd Rovito. -- Issue #11491: dbm.error is no longer raised when dbm.open is called with - the "n" as the flag argument and the file exists. The behavior matches - the documentation and general logic. +- Remove dead imports of imp. -- Issue #1162477: Postel Principle adjustment to email date parsing: handle the - fact that some non-compliant MUAs use '.' instead of ':' in time specs. +- Issue #18196: Avoid displaying spurious SystemExit tracebacks. -- Issue #11131: Fix sign of zero in decimal.Decimal plus and minus - operations when the rounding mode is ROUND_FLOOR. +- Issue #5492: Avoid traceback when exiting IDLE caused by a race condition. -- Issue #9935: Speed up pickling of instances of user-defined classes. +- Issue #17511: Keep IDLE find dialog open after clicking "Find Next". + Original patch by Sarah K. -- Issue #5622: Fix curses.wrapper to raise correct exception if curses - initialization fails. +- Issue #18055: Move IDLE off of imp and on to importlib. -- Issue #11408: In threading.Lock.acquire(), only call gettimeofday() when - really necessary. Patch by Charles-François Natali. +- Issue #15392: Create a unittest framework for IDLE. + Initial patch by Rajagopalasarma Jayakrishnan. + See Lib/idlelib/idle_test/README.txt for how to run Idle tests. -- Issue #11391: Writing to a mmap object created with - ``mmap.PROT_READ|mmap.PROT_EXEC`` would segfault instead of raising a - TypeError. Patch by Charles-François Natali. +- Issue #14146: Highlight source line while debugging on Windows. -- Issue #9795: add context manager protocol support for nntplib.NNTP class. +- Issue #17838: Allow sys.stdin to be reassigned. -- Issue #11306: mailbox in certain cases adapts to an inability to open - certain files in read-write mode. Previously it detected this by - checking for EACCES, now it also checks for EROFS. +- Issue #13495: Avoid loading the color delegator twice in IDLE. -- Issue #11265: asyncore now correctly handles EPIPE, EBADF and EAGAIN errors - on accept(), send() and recv(). +- Issue #17798: Allow IDLE to edit new files when specified on command line. -- Issue #11377: Deprecate platform.popen() and reimplement it with os.popen(). +- Issue #14735: Update IDLE docs to omit "Control-z on Windows". -- Issue #8513: On UNIX, subprocess supports bytes command string. +- Issue #17532: Always include Options menu for IDLE on OS X. + Patch by Guilherme Simões. -- Issue #10866: Add socket.sethostname(). Initial patch by Ross Lagerwall. +- Issue #17585: Fixed IDLE regression. Now closes when using exit() or quit(). -- Issue #11140: Lock.release() now raises a RuntimeError when attempting - to release an unacquired lock, as claimed in the threading documentation. - The _thread.error exception is now an alias of RuntimeError. Patch by - Filip Gruszczyński. Patch for _dummy_thread by Aymeric Augustin. +- Issue #17657: Show full Tk version in IDLE's about dialog. + Patch by Todd Rovito. -- Issue #8594: ftplib now provides a source_address parameter to specify which - (address, port) to bind to before connecting. +- Issue #17613: Prevent traceback when removing syntax colorizer in IDLE. -- Issue #11326: Add the missing connect_ex() implementation for SSL sockets, - and make it work for non-blocking connects. +- Issue #1207589: Backwards-compatibility patch for right-click menu in IDLE. -- Issue #11297: Add collections.ChainMap(). +- Issue #16887: IDLE now accepts Cancel in tabify/untabify dialog box. -- Issue #10755: Add the posix.flistdir() function. Patch by Ross Lagerwall. +- Issue #17625: In IDLE, close the replace dialog after it is used. -- Issue #4761: Add the ``*at()`` family of functions (openat(), etc.) to the - posix module. Patch by Ross Lagerwall. +- Issue #14254: IDLE now handles readline correctly across shell restarts. -- Issue #7322: Trying to read from a socket's file-like object after a timeout - occurred now raises an error instead of silently losing data. +- Issue #17614: IDLE no longer raises exception when quickly closing a file. -- Issue #11291: poplib.POP no longer suppresses errors on quit(). +- Issue #6698: IDLE now opens just an editor window when configured to do so. -- Issue #11177: asyncore's create_socket() arguments can now be omitted. +- Issue #8900: Using keyboard shortcuts in IDLE to open a file no longer + raises an exception. -- Issue #6064: Add a ``daemon`` keyword argument to the threading.Thread - and multiprocessing.Process constructors in order to override the - default behaviour of inheriting the daemonic property from the current - thread/process. +- Issue #6649: Fixed missing exit status in IDLE. Patch by Guilherme Polo. -- Issue #10956: Buffered I/O classes retry reading or writing after a signal - has arrived and the handler returned successfully. +- Issue #17114: IDLE now uses non-strict config parser. -- Issue #10784: New os.getpriority() and os.setpriority() functions. +- Issue #9290: In IDLE the sys.std* streams now implement io.TextIOBase + interface and support all mandatory methods and properties. -- Issue #11114: Fix catastrophic performance of tell() on text files (up - to 1000x faster in some cases). It is still one to two order of magnitudes - slower than binary tell(). +- Issue #5066: Update IDLE docs. Patch by Todd Rovito. -- Issue #10882: Add os.sendfile function. +- Issue #16829: IDLE printing no longer fails if there are spaces or other + special characters in the file path. -- Issue #10868: Allow usage of the register method of an ABC as a class - decorator. +- Issue #16491: IDLE now prints chained exception tracebacks. -- Issue #11224: Fixed a regression in tarfile that affected the file-like - objects returned by TarFile.extractfile() regarding performance, memory - consumption and failures with the stream interface. +- Issue #16819: IDLE method completion now correctly works for bytes literals. -- Issue #10924: Adding salt and Modular Crypt Format to crypt library. - Moved old C wrapper to _crypt, and added a Python wrapper with - enhanced salt generation and simpler API for password generation. +- Issue #16504: IDLE now catches SyntaxErrors raised by tokenizer. Patch by + Roger Serwy. -- Issue #11074: Make 'tokenize' so it can be reloaded. +- Issue #16511: Use default IDLE width and height if config param is not valid. + Patch Serhiy Storchaka. -- Issue #11085: Moved collections abstract base classes into a separate - module called collections.abc, following the pattern used by importlib.abc. - For backwards compatibility, the names are imported into the collections - module. +- Issue #1207589: Add Cut/Copy/Paste items to IDLE right click Context Menu + Patch by Todd Rovito. -- Issue #4681: Allow mmap() to work on file sizes and offsets larger than - 4GB, even on 32-bit builds. Initial patch by Ross Lagerwall, adapted for - 32-bit Windows. +- Issue #16123: IDLE - deprecate running without a subprocess. + Patch by Roger Serwy. -- Issue #11169: compileall module uses repr() to format filenames and paths to - escape surrogate characters and show spaces. +Tests +----- -- Issue #11089: Fix performance issue limiting the use of ConfigParser() - with large config files. +- Issue #1666318: Add a test that shutil.copytree() retains directory + permissions. Patch by Catherine Devlin. -- Issue #10276: Fix the results of zlib.crc32() and zlib.adler32() on buffers - larger than 4GB. Patch by Nadeem Vawda. +- Issue #18273: move the tests in Lib/test/json_tests to Lib/test/test_json + and make them discoverable by unittest. Patch by Zachary Ware. -- Issue #11388: Added a clear() method to MutableSequence +- Fix a fcntl test case on KFreeBSD, Debian #708653 (Petr Salinger). -- Issue #11174: Add argparse.MetavarTypeHelpFormatter, which uses type names - for the names of optional and positional arguments in help messages. +- Issue #18396: Fix spurious test failure in test_signal on Windows when + faulthandler is enabled (Patch by Jeremy Kloth) -- Issue #9348: Raise an early error if argparse nargs and metavar don't match. +- Issue #17046: Fix broken test_executable_without_cwd in test_subprocess. -- Issue #9026: Fix order of argparse sub-commands in help messages. +- Issue #15415: Add new temp_dir() and change_cwd() context managers to + test.support, and refactor temp_cwd() to use them. Patch by Chris Jerdonek. -- Issue #9347: Fix formatting for tuples in argparse type= error messages. +- Issue #15494: test.support is now a package rather than a module (Initial + patch by Indra Talip) -- Issue #12191: Added shutil.chown() to change user and/or group owner of a - given path also specifying their names. +- Issue #17944: test_zipfile now discoverable and uses subclassing to + generate tests for different compression types. Fixed a bug with skipping + some tests due to use of exhausted iterators. -- Issue #13988: The _elementtree accelerator is used whenever available. - Now xml.etree.cElementTree becomes a deprecated alias to ElementTree. +- Issue #18266: test_largefile now works with unittest test discovery and + supports running only selected tests. Patch by Zachary Ware. -Build ------ +- Issue #17767: test_locale now works with unittest test discovery. + Original patch by Zachary Ware. -- Issue #6807: Run msisupport.mak earlier. +- Issue #18375: Assume --randomize when --randseed is used for running the + testsuite. -- Issue #10580: Minor grammar change in Windows installer. +- Issue #11185: Fix test_wait4 under AIX. Patch by Sébastien Sablé. -- Issue #13326: Clean __pycache__ directories correctly on OpenBSD. +- Issue #18207: Fix test_ssl for some versions of OpenSSL that ignore seconds + in ASN1_TIME fields. -- PEP 393: the configure option --with-wide-unicode is removed. +- Issue #18094: test_uuid no longer reports skipped tests as passed. -- Issue #12852: Set _XOPEN_SOURCE to 700, instead of 600, to get POSIX 2008 - functions on OpenBSD (e.g. fdopendir). +- Issue #17992: Add timeouts to asyncore and asynchat tests so that they won't + accidentally hang. -- Issue #11863: Remove support for legacy systems deprecated in Python 3.2 - (following PEP 11). These systems are systems using Mach C Threads, - SunOS lightweight processes, GNU pth threads and IRIX threads. +- Issue #17833: Fix test_gdb failures seen on machines where debug symbols + for glibc are available (seen on PPC64 Linux). -- Issue #8746: Correct faulty configure checks so that os.chflags() and - os.lchflags() are once again built on systems that support these - functions (BSD and OS X). Also add new stat file flags for OS X - (UF_HIDDEN and UF_COMPRESSED). +- Issue #7855: Add tests for ctypes/winreg for issues found in IronPython. + Initial patch by Dino Viehland. -- Issue #10645: Installing Python no longer creates a - Python-X.Y.Z-pyX.Y.egg-info file in the lib-dynload directory. +- Issue #11078: test___all__ now checks for duplicates in __all__. + Initial patch by R. David Murray. -- Do not accidentally include the directory containing sqlite.h twice when - building sqlite3. +- Issue #17712: Fix test_gdb failures on Ubuntu 13.04. -- Issue #11217: For 64-bit/32-bit Mac OS X universal framework builds, - ensure "make install" creates symlinks in --prefix bin for the "-32" - files in the framework bin directory like the installer does. +- Issue #17835: Fix test_io when the default OS pipe buffer size is larger + than one million bytes. -- Issue #11347: Use --no-as-needed when linking libpython3.so. +- Issue #17065: Use process-unique key for winreg tests to avoid failures if + test is run multiple times in parallel (eg: on a buildbot host). -- Issue #11411: Fix 'make DESTDIR=' with a relative destination. +- Issue #12820: add tests for the xml.dom.minicompat module. + Patch by John Chandler and Phil Connell. -- Issue #11268: Prevent Mac OS X Installer failure if Documentation - package had previously been installed. +- Issue #17691: test_univnewlines now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #11495: OSF support is eliminated. It was deprecated in Python 3.2. +- Issue #17790: test_set now works with unittest test discovery. + Patch by Zachary Ware. -IDLE ----- +- Issue #17789: test_random now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #14409: IDLE now properly executes commands in the Shell window - when it cannot read the normal config files on startup and - has to use the built-in default key bindings. - There was previously a bug in one of the defaults. +- Issue #17779: test_osx_env now works with unittest test discovery. + Patch by Zachary Ware. -- IDLE can be launched as python -m idlelib +- Issue #17766: test_iterlen now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #3573: IDLE hangs when passing invalid command line args - (directory(ies) instead of file(s)) (Patch by Guilherme Polo) +- Issue #17690: test_time now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #14200: IDLE shell crash on printing non-BMP unicode character. +- Issue #17692: test_sqlite now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #5219: Prevent event handler cascade in IDLE. +- Issue #11995: test_pydoc doesn't import all sys.path modules anymore. -- Issue #964437: Make IDLE help window non-modal. - Patch by Guilherme Polo and Roger Serwy. +- Issue #17448: test_sax now skips if there are no xml parsers available + instead of raising an ImportError. -- Issue #13933: IDLE auto-complete did not work with some imported - module, like hashlib. (Patch by Roger Serwy) +- Issue #11420: make test suite pass with -B/DONTWRITEBYTECODE set. + Initial patch by Thomas Wouters. -- Issue #13506: Add '' to path for IDLE Shell when started and restarted with Restart Shell. - Original patches by Marco Scataglini and Roger Serwy. +- Issue #10652: make tcl/tk tests run after __all__ test, patch by + Zachary Ware. -- Issue #4625: If IDLE cannot write to its recent file or breakpoint files, - display a message popup and continue rather than crash. Original patch by - Roger Serwy. +- Issue #11963: remove human verification from test_parser and test_subprocess. -- Issue #8641: Update IDLE 3 syntax coloring to recognize b".." and not u"..". - Patch by Tal Einat. +- Issue #11732: add a new suppress_crash_popup() context manager to test.support + that disables crash popups on Windows and use it in test_faulthandler and + test_capi. -- Issue #13296: Fix IDLE to clear compile __future__ flags on shell restart. - (Patch by Roger Serwy) +- Issue #13898: test_ssl no longer prints a spurious stack trace on Ubuntu. -- Issue #9871: Prevent IDLE 3 crash when given byte stings - with invalid hex escape sequences, like b'\x0'. - (Original patch by Claudiu Popa.) +- Issue #17283: Share code between `__main__.py` and `regrtest.py` in + `Lib/test`. -- Issue #12636: IDLE reads the coding cookie when executing a Python script. +- Issue #17249: convert a test in test_capi to use unittest and reap threads. -- Issue #12540: Prevent zombie IDLE processes on Windows due to changes - in os.kill(). +- Issue #17107: Test client-side SNI support in urllib.request thanks to + the new server-side SNI support in the ssl module. Initial patch by + Daniel Black. -- Issue #12590: IDLE editor window now always displays the first line - when opening a long file. With Tk 8.5, the first line was hidden. +- Issue #17041: Fix testing when Python is configured with the + --without-doc-strings. -- Issue #11088: don't crash when using F5 to run a script in IDLE on MacOSX - with Tk 8.5. +- Issue #16923: Fix ResourceWarnings in test_ssl. -- Issue #1028: Tk returns invalid Unicode null in %A: UnicodeDecodeError. - With Tk < 8.5 _tkinter.c:PythonCmd() raised UnicodeDecodeError, caused - IDLE to exit. Converted to valid Unicode null in PythonCmd(). +- Issue #15539: Added regression tests for Tools/scripts/pindent.py. -- Issue #11718: IDLE's open module dialog couldn't find the __init__.py - file in a package. +- Issue #17479: test_io now works with unittest test discovery. + Patch by Zachary Ware. -Tools/Demos ------------ +- Issue #17066: test_robotparser now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #14053: patchcheck.py ("make patchcheck") now works with MQ patches. - Patch by Francisco Martín Brugué. +- Issue #17334: test_index now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #13930: 2to3 is now able to write its converted output files to another - directory tree as well as copying unchanged files and altering the file - suffix. See its new -o, -W and --add-suffix options. This makes it more - useful in many automated code translation workflows. +- Issue #17333: test_imaplib now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #13628: python-gdb.py is now able to retrieve more frames in the Python - traceback if Python is optimized. +- Issue #17082: test_dbm* now work with unittest test discovery. + Patch by Zachary Ware. -- Issue #11996: libpython (gdb), replace "py-bt" command by "py-bt-full" and - add a smarter "py-bt" command printing a classic Python traceback. +- Issue #17079: test_ctypes now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #11179: Make ccbench work under Python 3.1 and 2.7 again. +- Issue #17304: test_hash now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #10639: reindent.py no longer converts newlines and will raise - an error if attempting to convert a file with mixed newlines. - "--newline" option added to specify new line character. +- Issue #17303: test_future* now work with unittest test discovery. + Patch by Zachary Ware. -Extension Modules ------------------ +- Issue #17163: test_file now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #16847: Fixed improper use of _PyUnicode_CheckConsistency() in - non-pydebug builds. Several extension modules now compile cleanly when - assert()s are enabled in standard builds (-DDEBUG flag). +- Issue #16925: test_configparser now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #13840: The error message produced by ctypes.create_string_buffer - when given a Unicode string has been fixed. +- Issue #16918: test_codecs now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #9975: socket: Fix incorrect use of flowinfo and scope_id. Patch by - Vilmos Nebehaj. +- Issue #16919: test_crypt now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #7777: socket: Add Reliable Datagram Sockets (PF_RDS) support. +- Issue #16910: test_bytes, test_unicode, and test_userstring now work with + unittest test discovery. Patch by Zachary Ware. -- Issue #13159: FileIO and BZ2Compressor/BZ2Decompressor now use a linear-time - buffer growth strategy instead of a quadratic-time one. +- Issue #16905: test_warnings now works with unittest test discovery. + Initial patch by Berker Peksag. -- Issue #10141: socket: Add SocketCAN (PF_CAN) support. Initial patch by - Matthias Fuchs, updated by Tiago Gonçalves. +- Issue #16898: test_bufio now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #13070: Fix a crash when a TextIOWrapper caught in a reference cycle - would be finalized after the reference to its underlying BufferedRWPair's - writer got cleared by the GC. +- Issue #16888: test_array now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #12881: ctypes: Fix segfault with large structure field names. +- Issue #16896: test_asyncore now works with unittest test discovery. + Patch by Zachary Ware. -- Issue #13058: ossaudiodev: fix a file descriptor leak on error. Patch by - Thomas Jarosch. +- Issue #16897: test_bisect now works with unittest test discovery. + Initial patch by Zachary Ware. -- Issue #13013: ctypes: Fix a reference leak in PyCArrayType_from_ctype. - Thanks to Suman Saha for finding the bug and providing a patch. +- Issue #16852: test_genericpath, test_posixpath, test_ntpath, and test_macpath + now work with unittest test discovery. Patch by Zachary Ware. -- Issue #13022: Fix: _multiprocessing.recvfd() doesn't check that - file descriptor was actually received. +- Issue #16748: test_heapq now works with unittest test discovery. -- Issue #1172711: Add 'long long' support to the array module. - Initial patch by Oren Tirosh and Hirokazu Yamamoto. +- Issue #10646: Tests rearranged for os.samefile/samestat to check for not + just symlinks but also hard links. -- Issue #12483: ctypes: Fix a crash when the destruction of a callback - object triggers the garbage collector. +- Issue #15302: Switch regrtest from using getopt to using argparse. -- Issue #12950: Fix passing file descriptors in multiprocessing, under - OpenIndiana/Illumos. +- Issue #15324: Fix regrtest parsing of --fromfile, --match, and --randomize + options. -- Issue #12764: Fix a crash in ctypes when the name of a Structure field is not - a string. +- Issue #16702: test_urllib2_localnet tests now correctly ignores proxies for + localhost tests. -- Issue #11241: subclasses of ctypes.Array can now be subclassed. +- Issue #16664: Add regression tests for glob's behaviour concerning entries + starting with a ".". Patch by Sebastian Kreft. -- Issue #9651: Fix a crash when ctypes.create_string_buffer(0) was passed to - some functions like file.write(). +- Issue #13390: The ``-R`` option to regrtest now also checks for memory + allocation leaks, using :func:`sys.getallocatedblocks()`. -- Issue #10309: Define _GNU_SOURCE so that mremap() gets the proper - signature. Without this, architectures where sizeof void* != sizeof int are - broken. Patch given by Hallvard B Furuseth. +- Issue #16559: Add more tests for the json module, including some from the + official test suite at json.org. Patch by Serhiy Storchaka. -- Issue #12051: Fix segfault in json.dumps() while encoding highly-nested - objects using the C accelerations. +- Issue #16661: Fix the `os.getgrouplist()` test by not assuming that it gives + the same output as :command:`id -G`. -- Issue #12017: Fix segfault in json.loads() while decoding highly-nested - objects using the C accelerations. +- Issue #16115: Add some tests for the executable argument to + subprocess.Popen(). Initial patch by Kushal Das. -- Issue #1838: Prevent segfault in ctypes, when _as_parameter_ on a class is set - to an instance of the class. +- Issue #16126: PyErr_Format format mismatch in _testcapimodule.c. + Patch by Serhiy Storchaka. -Tests ------ +- Issue #15304: Fix warning message when `os.chdir()` fails inside + `test.support.temp_cwd()`. Patch by Chris Jerdonek. -- Issue #13125: Silence spurious test_lib2to3 output when in non-verbose mode. - Patch by Mikhail Novikov. +- Issue #15802: Fix test logic in `TestMaildir.test_create_tmp()`. Patch by + Serhiy Storchaka. -- Issue #13447: Add a test file to host regression tests for bugs in the - scripts found in the Tools directory. +- Issue #15557: Added a test suite for the webbrowser module, thanks to Anton + Barkovsky. -- Issue #10881: Fix test_site failure with OS X framework builds. +- Issue #16698: Skip posix test_getgroups when built with OS X + deployment target prior to 10.6. -- Issue #13901: Prevent test_distutils failures on OS X with --enable-shared. +Build +----- -- Issue #13862: Fix spurious failure in test_zlib due to runtime/compile time - minor versions not matching. +- Issue #16067: Add description into MSI file to replace installer's + temporary name. -- Issue #12804: Fix test_socket and test_urllib2net failures when running tests - on a system without internet access. +- Issue #18257: Fix readlink usage in python-config. Install the python + version again on Darwin. -- Issue #13726: Fix the ambiguous -S flag in regrtest. It is -o/--slow for slow - tests. +- Issue #18481: Add C coverage reporting with gcov and lcov. A new make target + "coverage-report" creates an instrumented Python build, runs unit tests + and creates a HTML. The report can be updated with "make coverage-lcov". -- Issue #11659: Fix ResourceWarning in test_subprocess introduced by #11459. - Patch by Ben Hayden. +- Issue #17845: Clarified the message printed when some module are not built. -- Issue #11577: fix ResourceWarning triggered by improved binhex test coverage +- Issue #18256: Compilation fix for recent AIX releases. Patch by + David Edelsohn. -- Issue #11509: Significantly increase test coverage of fileinput. - Patch by Denver Coneybeare at PyCon 2011 Sprints. +- Issue #17547: In configure, explicitly pass -Wformat for the benefit for GCC + 4.8. -- Issue #11689: Fix a variable scoping error in an sqlite3 test +- Issue #15172: Document NASM 2.10+ as requirement for building OpenSSL 1.0.1 + on Windows. -- Issue #13786: Remove unimplemented 'trace' long option from regrtest.py. +- Issue #17591: Use lowercase filenames when including Windows header files. + Patch by Roumen Petrov. -- Issue #13725: Fix regrtest to recognize the documented -d flag. - Patch by Erno Tukia. +- Issue #17550: Fix the --enable-profiling configure switch. -- Issue #13304: Skip test case if user site-packages disabled (-s or - PYTHONNOUSERSITE). (Patch by Carl Meyer) +- Issue #17425: Build with openssl 1.0.1d on Windows. -- Issue #5661: Add a test for ECONNRESET/EPIPE handling to test_asyncore. Patch - by Xavier de Gaye. +- Issue #16754: Fix the incorrect shared library extension on linux. Introduce + two makefile macros SHLIB_SUFFIX and EXT_SUFFIX. SO now has the value of + SHLIB_SUFFIX again (as in 2.x and 3.1). The SO macro is removed in 3.4. -- Issue #13218: Fix test_ssl failures on Debian/Ubuntu. +- Issue #5033: Fix building of the sqlite3 extension module when the + SQLite library version has "beta" in it. Patch by Andreas Pelme. -- Re-enable lib2to3's test_parser.py tests, though with an expected failure - (see issue #13125). +- Issue #17228: Fix building without pymalloc. -- Issue #12656: Add tests for IPv6 and Unix sockets to test_asyncore. +- Issue #3718: Use AC_ARG_VAR to set MACHDEP in configure.ac. -- Issue #6484: Add unit tests for mailcap module (patch by Gregory Nofi) +- Issue #16235: Implement python-config as a shell script. -- Issue #11651: Improve the Makefile test targets to run more of the test suite - more quickly. The --multiprocess option is now enabled by default, reducing - the amount of time needed to run the tests. "make test" and "make quicktest" - now include some resource-intensive tests, but no longer run the test suite - twice to check for bugs in .pyc generation. Tools/scripts/run_test.py provides - an easy platform-independent way to run test suite with sensible defaults. +- Issue #16769: Remove outdated Visual Studio projects. -- Issue #12331: The test suite for the packaging module can now run from an - installed Python. +- Issue #17031: Fix running regen in cross builds. -- Issue #12331: The test suite for lib2to3 can now run from an installed - Python. +- Issue #3754: fix typo in pthread AC_CACHE_VAL. -- Issue #12626: In regrtest, allow to filter tests using a glob filter - with the ``-m`` (or ``--match``) option. This works with all test cases - using the unittest module. This is useful with long test suites - such as test_io or test_subprocess. +- Issue #15484: Fix _PYTHON_PROJECT_BASE for srcdir != builddir builds; + use _PYTHON_PROJECT_BASE in distutils/sysconfig.py. -- Issue #12624: It is now possible to fail after the first failure when - running in verbose mode (``-v`` or ``-W``), by using the ``--failfast`` - (or ``-G``) option to regrtest. This is useful with long test suites - such as test_io or test_subprocess. +- Drop support for Windows 2000 (changeset e52df05b496a). -- Issue #12587: Correct faulty test file and reference in test_tokenize. - (Patch by Robert Xiao) +- Issue #17029: Let h2py search the multiarch system include directory. -- Issue #12573: Add resource checks for dangling Thread and Process objects. +- Issue #16953: Fix socket module compilation on platforms with + HAVE_BROKEN_POLL. Patch by Jeffrey Armstrong. -- Issue #12549: Correct test_platform to not fail when OS X returns 'x86_64' - as the processor type on some Mac systems. +- Issue #16320: Remove redundant Makefile dependencies for strings and bytes. -- Skip network tests when getaddrinfo() returns EAI_AGAIN, meaning a temporary - failure in name resolution. +- Cross compiling needs host and build settings. configure no longer + creates a broken PYTHON_FOR_BUILD variable when --build is missing. -- Issue #11812: Solve transient socket failure to connect to 'localhost' - in test_telnetlib.py. +- Fix cross compiling issue in setup.py, ensure that lib_dirs and inc_dirs are + defined in cross compiling mode, too. -- Solved a potential deadlock in test_telnetlib.py. Related to issue #11812. +- Issue #16836: Enable IPv6 support even if IPv6 is disabled on the build host. -- Avoid failing in test_robotparser when mueblesmoraleda.com is flaky and - an overzealous DNS service (e.g. OpenDNS) redirects to a placeholder - Web site. +- Issue #16593: Have BSD 'make -s' do the right thing, thanks to Daniel Shahaf -- Avoid failing in test_urllibnet.test_bad_address when some overzealous - DNS service (e.g. OpenDNS) resolves a non-existent domain name. The test - is now skipped instead. +- Issue #16262: fix out-of-src-tree builds, if mercurial is not installed. -- Issue #12440: When testing whether some bits in SSLContext.options can be - reset, check the version of the OpenSSL headers Python was compiled against, - rather than the runtime version of the OpenSSL library. +- Issue #15298: ensure _sysconfigdata is generated in build directory, not + source directory. -- Issue #11512: Add a test suite for the cgitb module. Patch by Robbie Clemons. +- Issue #15833: Fix a regression in 3.3 that resulted in exceptions being + raised if importlib failed to write byte-compiled files. This affected + attempts to build Python out-of-tree from a read-only source directory. -- Issue #12497: Install test/data to prevent failures of the various codecmaps - tests. +- Issue #15923: Fix a mistake in ``asdl_c.py`` that resulted in a TypeError + after 2801bf875a24 (see #15801). -- Issue #12496: Install test/capath directory to prevent test_connect_capath - testcase failure in test_ssl. +- Issue #16135: Remove OS/2 support. -- Issue #12469: Run wakeup and pending signal tests in a subprocess to run the - test in a fresh process with only one thread and to not change signal - handling of the parent process. +- Issue #15819: Make sure we can build Python out-of-tree from a read-only + source directory. (Somewhat related to issue #9860.) -- Issue #8716: Avoid crashes caused by Aqua Tk on OSX when attempting to run - test_tk or test_ttk_guionly under a username that is not currently logged - in to the console windowserver (as may be the case under buildbot or ssh). +- Issue #15587: Enable Tk high-resolution text rendering on Macs with + Retina displays. Applies to Tkinter apps, such as IDLE, on OS X + framework builds linked with Cocoa Tk 8.5. -- Issue #12407: Explicitly skip test_capi.EmbeddingTest under Windows. +- Issue #17161: make install now also installs a python3 man page. -- Issue #12400: regrtest -W doesn't rerun the tests twice anymore, but captures - the output and displays it on failure instead. regrtest -v doesn't print the - error twice anymore if there is only one error. +C-API +----- -- Issue #12141: Install copies of template C module file so that - test_build_ext of test_distutils and test_command_build_ext of - test_packaging are no longer silently skipped when - run outside of a build directory. +- Issue #18351: Fix various issues in a function in importlib provided to help + PyImport_ExecCodeModuleWithPathnames() (and thus by extension + PyImport_ExecCodeModule() and PyImport_ExecCodeModuleEx()). -- Issue #8746: Add additional tests for os.chflags() and os.lchflags(). - Patch by Garrett Cooper. +- Issue #9369: The types of `char*` arguments of PyObject_CallFunction() and + PyObject_CallMethod() now changed to `const char*`. Based on patches by + Jörg Müller and Lars Buitinck. -- Issue #10736: Fix test_ttk test_widgets failures with Cocoa Tk 8.5.9 - 2.8 + on Mac OS X. (Patch by Ronald Oussoren) +- Issue #17206: Py_CLEAR(), Py_DECREF(), Py_XINCREF() and Py_XDECREF() now + expand their arguments once instead of multiple times. Patch written by Illia + Polosukhin. -- Issue #12057: Add tests for ISO 2022 codecs (iso2022_jp, iso2022_jp_2, - iso2022_kr). +- Issue #17522: Add the PyGILState_Check() API. -- Issue #12096: Fix a race condition in test_threading.test_waitfor(). Patch - written by Charles-François Natali. +- Issue #17327: Add PyDict_SetDefault. -- Issue #11614: import __hello__ prints "Hello World!". Patch written by - Andreas Stührk. +- Issue #16881: Fix Py_ARRAY_LENGTH macro for GCC < 3.1. -- Issue #5723: Improve json tests to be executed with and without accelerations. +- Issue #16505: Remove unused Py_TPFLAGS_INT_SUBCLASS. -- Issue #12041: Make test_wait3 more robust. +- Issue #16086: PyTypeObject.tp_flags and PyType_Spec.flags are now unsigned + (unsigned long and unsigned int) to avoid an undefined behaviour with + Py_TPFLAGS_TYPE_SUBCLASS ((1 << 31). PyType_GetFlags() result type is + now unsigned too (unsigned long, instead of long). -- Issue #11873: Change regex in test_compileall to fix occasional failures when - when the randomly generated temporary path happened to match the regex. +- Issue #16166: Add PY_LITTLE_ENDIAN and PY_BIG_ENDIAN macros and unified + endianness detection and handling. -- Issue #11958: Fix FTP tests for IPv6, bind to "::1" instead of "localhost". - Patch written by Charles-Francois Natali. +Documentation +------------- -- Issue #8407, #11859: Fix tests of test_io using threads and an alarm: use - pthread_sigmask() to ensure that the SIGALRM signal is received by the main - thread. +- Issue #23006: Improve the documentation and indexing of dict.__missing__. + Add an entry in the language datamodel special methods section. + Revise and index its discussion in the stdtypes mapping/dict section. -- Issue #11811: Factor out detection of IPv6 support on the current host - and make it available as ``test.support.IPV6_ENABLED``. Patch by - Charles-François Natali. +- Issue #17701: Improving strftime documentation. -- Issue #10914: Add a minimal embedding test to test_capi. +- Issue #18440: Clarify that `hash()` can truncate the value returned from an + object's custom `__hash__()` method. -- Issue #11223: Skip test_lock_acquire_interruption() and - test_rlock_acquire_interruption() of test_threadsignals if a thread lock is - implemented using a POSIX mutex and a POSIX condition variable. A POSIX - condition variable cannot be interrupted by a signal (e.g. on Linux, the - futex system call is restarted). +- Issue #17844: Add links to encoders and decoders for bytes-to-bytes codecs. -- Issue #11790: Fix sporadic failures in test_multiprocessing.WithProcessesTestCondition. +- Issue #14097: improve the "introduction" page of the tutorial. -- Fix possible "file already exists" error when running the tests in parallel. +- Issue #17977: The documentation for the cadefault argument's default value + in urllib.request.urlopen() is fixed to match the code. -- Issue #11719: Fix message about unexpected test_msilib skip on non-Windows - platforms. Patch by Nadeem Vawda. +- Issue #6696: add documentation for the Profile objects, and improve + profile/cProfile docs. Patch by Tom Pinckney. -- Issue #11727: Add a --timeout option to regrtest: if a test takes more than - TIMEOUT seconds, dumps the traceback of all threads and exits. +- Issue #15940: Specify effect of locale on time functions. -- Issue #11653: fix -W with -j in regrtest. +- Issue #17538: Document XML vulnerabilties -- The email test suite now lives in the Lib/test/test_email package. The test - harness code has also been modernized to allow use of new unittest features. +- Issue #16642: sched.scheduler timefunc initial default is time.monotonic. + Patch by Ramchandra Apte -- regrtest now discovers test packages as well as test modules. +- Issue #17047: remove doubled words in docs and docstrings + reported by Serhiy Storchaka and Matthew Barnett. -- Issue #11577: improve test coverage of binhex.py. Patch by Arkady Koplyarov. +- Issue #15465: Document the versioning macros in the C API docs rather than + the standard library docs. Patch by Kushal Das. -- New test_crashers added to exercise the scripts in the Lib/test/crashers - directory and confirm they fail as expected +- Issue #16406: Combine the pages for uploading and registering to PyPI. -- Issue #11578: added test for the timeit module. Patch by Michael Henry. +- Issue #16403: Document how distutils uses the maintainer field in + PKG-INFO. Patch by Jyrki Pulliainen. -- Issue #11503: improve test coverage of posixpath.py. Patch by Evan Dandrea. +- Issue #16695: Document how glob handles filenames starting with a + dot. Initial patch by Jyrki Pulliainen. -- Issue #11505: improves test coverage of string.py, increases granularity of - string.Formatter tests. Initial patch by Alicia Arlen. +- Issue #8890: Stop advertising an insecure practice by replacing uses + of the /tmp directory with better alternatives in the documentation. + Patch by Geoff Wilson. -- Issue #11548: Improve test coverage of the shutil module. Patch by - Evan Dandrea. +- Issue #17203: add long option names to unittest discovery docs. -- Issue #11554: Reactivated test_email_codecs. +- Issue #13094: add "Why do lambdas defined in a loop with different values + all return the same result?" programming FAQ. -- Issue #11505: improves test coverage of string.py. Patch by Alicia - Arlen +- Issue #14901: Update portions of the Windows FAQ. + Patch by Ashish Nitin Patil. -- Issue #11490: test_subprocess.test_leaking_fds_on_error no longer gives a - false positive if the last directory in the path is inaccessible. +- Issue #16267: Better document the 3.3+ approach to combining + @abstractmethod with @staticmethod, @classmethod and @property -- Issue #11223: Fix test_threadsignals to fail, not hang, when the - non-semaphore implementation of locks is used under POSIX. +- Issue #15209: Clarify exception chaining description in exceptions module + documentation -- Issue #10911: Add tests on CGI with non-ASCII characters. Patch written by - Pierre Quentel. +- Issue #15990: Improve argument/parameter documentation. -- Issue #9931: Fix hangs in GUI tests under Windows in certain conditions. - Patch by Hirokazu Yamamoto. +- Issue #16209: Move the documentation for the str built-in function to a new + str class entry in the "Text Sequence Type" section. -- Issue #10512: Properly close sockets under test.test_cgi. +- Issue #13538: Improve str() and object.__str__() documentation. -- Issue #10992: Make tests pass under coverage. +- Issue #16489: Make it clearer that importlib.find_loader() needs parent + packages to be explicitly imported. -- Issue #10826: Prevent sporadic failure in test_subprocess on Solaris due - to open door files. +- Issue #16400: Update the description of which versions of a given package + PyPI displays. -- Issue #10990: Prevent tests from clobbering a set trace function. +- Issue #15677: Document that zlib and gzip accept a compression level of 0 to + mean 'no compression'. Patch by Brian Brazil. -C-API ------ +- Issue #16197: Update winreg docstrings and documentation to match code. + Patch by Zachary Ware. -- Issue #13452: PyUnicode_EncodeDecimal() doesn't support error handlers - different than "strict" anymore. The caller was unable to compute the - size of the output buffer: it depends on the error handler. +- Issue #8040: added a version switcher to the documentation. Patch by + Yury Selivanov. -- Issue #13560: Add PyUnicode_DecodeLocale(), PyUnicode_DecodeLocaleAndSize() - and PyUnicode_EncodeLocale() functions to the C API to decode/encode from/to - the current locale encoding. +- Issue #16241: Document -X faulthandler command line option. + Patch by Marek Šuppa. -- Issue #10831: PyUnicode_FromFormat() supports %li, %lli and %zi formats. +- Additional comments and some style changes in the concurrent.futures URL + retrieval example -- Issue #11246: Fix PyUnicode_FromFormat("%V") to decode the byte string from - UTF-8 (with replace error handler) instead of ISO-8859-1 (in strict mode). - Patch written by Ray Allen. +- Issue #16115: Improve subprocess.Popen() documentation around args, shell, + and executable arguments. -- Issue #10830: Fix PyUnicode_FromFormatV("%c") for non-BMP characters on - narrow build. +- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument. Done with + great native-speaker help from R. David Murray. -- Add PyObject_GenericGetDict and PyObject_GeneriSetDict. They are generic - implementations for the getter and setter of a ``__dict__`` descriptor of C - types. +- Issue #15533: Clarify docs and add tests for `subprocess.Popen()`'s cwd + argument. -- Issue #13727: Add 3 macros to access PyDateTime_Delta members: - PyDateTime_DELTA_GET_DAYS, PyDateTime_DELTA_GET_SECONDS, - PyDateTime_DELTA_GET_MICROSECONDS. +- Issue #15979: Improve timeit documentation. -- Issue #10542: Add 4 macros to work with surrogates: Py_UNICODE_IS_SURROGATE, - Py_UNICODE_IS_HIGH_SURROGATE, Py_UNICODE_IS_LOW_SURROGATE, - Py_UNICODE_JOIN_SURROGATES. +- Issue #16036: Improve documentation of built-in `int()`'s signature and + arguments. -- Issue #12724: Add Py_RETURN_NOTIMPLEMENTED macro for returning NotImplemented. +- Issue #15935: Clarification of `argparse` docs, re: add_argument() type and + default arguments. Patch contributed by Chris Jerdonek. -- PY_PATCHLEVEL_REVISION has been removed, since it's meaningless with - Mercurial. +- Issue #11964: Document a change in v3.2 to the behavior of the indent + parameter of json encoding operations. -- Issue #12173: The first argument of PyImport_ImportModuleLevel is now `const - char *` instead of `char *`. +- Issue #15116: Remove references to appscript as it is no longer being + supported. -- Issue #12380: PyArg_ParseTuple now accepts a bytearray for the 'c' format. +Tools/Demos +----------- -Documentation -------------- +- Issue #18817: Fix a resource warning in Lib/aifc.py demo. Patch by + Vajrasky Kok. -- Issue #23006: Improve the documentation and indexing of dict.__missing__. - Add an entry in the language datamodel special methods section. - Revise and index its discussion in the stdtypes mapping/dict section. +- Issue #18439: Make patchcheck work on Windows for ACKS, NEWS. -- Issue #13989: Document that GzipFile does not support text mode, and give a - more helpful error message when opened with an invalid mode string. +- Issue #18448: Fix a typo in Tools/demo/eiffel.py. -- Issue #13921: Undocument and clean up sqlite3.OptimizedUnicode, - which is obsolete in Python 3.x. It's now aliased to str for - backwards compatibility. +- Issue #18457: Fixed saving of formulas and complex numbers in + Tools/demo/ss1.py. -- Issue #12102: Document that buffered files must be flushed before being used - with mmap. Patch by Steffen Daode Nurpmeso. +- Issue #18449: Make Tools/demo/ss1.py work again on Python 3. Patch by + Févry Thibault. -- Issue #8982: Improve the documentation for the argparse Namespace object. +- Issue #12990: The "Python Launcher" on OSX could not launch python scripts + that have paths that include wide characters. -- Issue #9343: Document that argparse parent parsers must be configured before - their children. +- Issue #15239: Make mkstringprep.py work again on Python 3. -- Issue #13498: Clarify docs of os.makedirs()'s exist_ok argument. Done with - great native-speaker help from R. David Murray. +- Issue #17028: Allowed Python arguments to be supplied to the Windows + launcher. -- Issues #13491 and #13995: Fix many errors in sqlite3 documentation. - Initial patch for #13491 by Johannes Vogel. +- Issue #17156: pygettext.py now detects the encoding of source files and + correctly writes and escapes non-ascii characters. -- Issue #13402: Document absoluteness of sys.executable. +- Issue #15539: Fix a number of bugs in Tools/scripts/pindent.py. Now + pindent.py works with a "with" statement. pindent.py no longer produces + improper indentation. pindent.py now works with continued lines broken after + "class" or "def" keywords and with continuations at the start of line. -- Issue #13883: PYTHONCASEOK also works on OS X. +- Issue #11797: Add a 2to3 fixer that maps reload() to imp.reload(). -- Issue #9021: Add an introduction to the copy module documentation. +- Issue #10966: Remove the concept of unexpected skipped tests. -- Issue #6005: Examples in the socket library documentation use sendall, where - relevant, instead send method. +- Issue #9893: Removed the Misc/Vim directory. -- Issue #12798: Updated the mimetypes documentation. +- Removed the Misc/TextMate directory. -- Issue #12949: Document the kwonlyargcount argument for the PyCode_New - C API function. +- Issue #16245: Add the Tools/scripts/parse_html5_entities.py script to parse + the list of HTML5 entities and update the html.entities.html5 dictionary. -- Issue #13513: Fix io.IOBase documentation to correctly link to the - io.IOBase.readline method instead of the readline module. +- Issue #15378: Fix Tools/unicode/comparecodecs.py. Patch by Serhiy Storchaka. -- Issue #13237: Reorganise subprocess documentation to emphasise convenience - functions and the most commonly needed arguments to Popen. +- Issue #16549: Make json.tool work again on Python 3 and add tests. + Initial patch by Berker Peksag and Serhiy Storchaka. -- Issue #13141: Demonstrate recommended style for socketserver examples. +- Issue #13301: use ast.literal_eval() instead of eval() in Tools/i18n/msgfmt.py + Patch by Serhiy Storchaka. -- Issue #11818: Fix tempfile examples for Python 3. +Windows +------- +- Issue #18569: The installer now adds .py to the PATHEXT variable when extensions + are registered. Patch by Paul Moore. **(For information about older versions, consult the HISTORY file.)**