Issue #25388: Fixed tokenizer crash when processing undecodable source code

author Serhiy Storchaka <storchaka@gmail.com>

Sat, 14 Nov 2015 13:12:04 +0000 (15:12 +0200)

committer Serhiy Storchaka <storchaka@gmail.com>

Sat, 14 Nov 2015 13:12:04 +0000 (15:12 +0200)
author Serhiy Storchaka <storchaka@gmail.com>
Sat, 14 Nov 2015 13:12:04 +0000 (15:12 +0200)
committer Serhiy Storchaka <storchaka@gmail.com>
Sat, 14 Nov 2015 13:12:04 +0000 (15:12 +0200)
diff --cc Misc/NEWS
Simple merge
diff --cc Parser/tokenizer.c
Simple merge
author	Serhiy Storchaka <storchaka@gmail.com>
	Sat, 14 Nov 2015 13:12:04 +0000 (15:12 +0200)
committer	Serhiy Storchaka <storchaka@gmail.com>
	Sat, 14 Nov 2015 13:12:04 +0000 (15:12 +0200)
		1	2
Misc/NEWS	patch \|	diff1 \|	diff2 \|	blob \| history
Parser/tokenizer.c	patch \|	diff1 \|	diff2 \|	blob \| history