]> granicus.if.org Git - libvpx/commit
Fix potential overflow issue in SSSE3 forward 8x8 2D-DCT
authorJingning Han <jingning@google.com>
Tue, 3 Jun 2014 01:48:33 +0000 (18:48 -0700)
committerGerrit Code Review <gerrit@gerrit.golo.chromium.org>
Tue, 3 Jun 2014 21:21:47 +0000 (14:21 -0700)
commit540d910350121895597dab8c9c219aa28c0f64e4
tree8cca182b7011eaf3656ce38ef5d280372fac4e73
parent5c2696c378fbbfe8ab894506e23fb79d596d0c43
Fix potential overflow issue in SSSE3 forward 8x8 2D-DCT

The SSSE3 implementation might find a potential overflow issue in
its second 1-D transform, if all input residual pixels are close to
255. This commit fixes the issue and re-enables the unit test on
the SSSE3 version.

Change-Id: I0520478abdab7afd3ff2842516bec951111e9b3c
vp9/encoder/x86/vp9_dct_ssse3_x86_64.asm