The latest version of this document is always available at:
- http://starship.skyport.net/~lemburg/unicode-proposal.txt
+ http://starship.python.net/~lemburg/unicode-proposal.txt
Older versions are available as:
- http://starship.skyport.net/~lemburg/unicode-proposal-X.X.txt
+ http://starship.python.net/~lemburg/unicode-proposal-X.X.txt
Conventions:
only use 7-bit ASCII then everything is fine and no such notice is
needed, but if you include Latin-1 characters not defined in ASCII, it
may well be worthwhile including a hint since people in other
-countries will want to be able to read you source strings too.
+countries will want to be able to read your source strings too.
Unicode Type Object:
through to the user.
In containment tests ('a' in u'abc' and u'a' in 'abc') both sides
-should be coerced to Unicode before applying the test. Errors occuring
+should be coerced to Unicode before applying the test. Errors occurring
during coercion (e.g. None in u'abc') should not be masked.
s + u := unicode(s) + u
All string methods should delegate the call to an equivalent Unicode
-object method call by converting all envolved strings to Unicode and
+object method call by converting all involved strings to Unicode and
then applying the arguments to the Unicode method of the same name,
e.g.
Exceptions:
-----------
-UnicodeError is defined in the exceptions module as subclass of
+UnicodeError is defined in the exceptions module as a subclass of
ValueError. It is available at the C level via PyExc_UnicodeError.
All exceptions related to Unicode encoding/decoding should be
subclasses of UnicodeError.
encodings, e.g.
'utf-8': 8-bit variable length encoding
- 'utf-16': 16-bit variable length encoding (litte/big endian)
+ 'utf-16': 16-bit variable length encoding (little/big endian)
'utf-16-le': utf-16 but explicitly little endian
'utf-16-be': utf-16 but explicitly big endian
'ascii': 7-bit ASCII codepage
marks (BOM) for file input/output.
All other encodings such as the CJK ones to support Asian scripts
-should be implemented in seperate packages which do not get included
+should be implemented in separate packages which do not get included
in the core Python distribution and are not a part of this proposal.
"""
def encode(self,input,errors='strict'):
- """ Encodes the object intput and returns a tuple (output
+ """ Encodes the object input and returns a tuple (output
object, length consumed).
errors defines the error handling to apply. It defaults to
'strict' handling.
The method may not store state in the Codec instance. Use
- SteamCodec for codecs which have to keep state in order to
+ StreamCodec for codecs which have to keep state in order to
make encoding/decoding efficient.
"""
'strict' handling.
The method may not store state in the Codec instance. Use
- SteamCodec for codecs which have to keep state in order to
+ StreamCodec for codecs which have to keep state in order to
make encoding/decoding efficient.
"""
the line breaking knowledge from the underlying stream's
.readline() method -- there is currently no support for
line breaking using the codec decoder due to lack of line
- buffering. Sublcasses should however, if possible, try to
+ buffering. Subclasses should however, if possible, try to
implement this method using their own knowledge of line
breaking.
""" Resets the codec buffers used for keeping state.
Note that no stream repositioning should take place.
- This method is primarely intended to be able to recover
+ This method is primarily intended to be able to recover
from decoding errors.
"""
It is not required by the Unicode implementation to use these base
classes, only the interfaces must match; this allows writing Codecs as
-extensions types.
+extension types.
As guideline, large mapping tables should be implemented using static
C data in separate (shared) extension modules. That way multiple
-------------------------
Support for these is left to user land Codecs and not explicitly
-intergrated into the core. Note that due to the Internal Format being
-implemented, only the area between \uE000 and \uF8FF is useable for
+integrated into the core. Note that due to the Internal Format being
+implemented, only the area between \uE000 and \uF8FF is usable for
private encodings.
the Basic Multilingual Plane (BMP) of Unicode.
It is the Codec's responsibility to ensure that the data they pass to
-the Unicode object constructor repects this assumption. The
+the Unicode object constructor respects this assumption. The
constructor does not check the data for Unicode compliance or use of
surrogates.
Future implementations can extend the 32 bit restriction to the full
set of all UTF-16 addressable characters (around 1M characters).
-The Unicode API should provide inteface routines from <PythonUnicode>
+The Unicode API should provide inte
rface routines from <PythonUnicode>
to the compiler's wchar_t which can be 16 or 32 bit depending on the
compiler/libc/platform being used.
projects / python / commitdiff