]> granicus.if.org Git - libvpx/commit
quantize: normalize intermediate types
authorJohann <johannkoenig@google.com>
Wed, 16 Aug 2017 17:22:48 +0000 (10:22 -0700)
committerJohann <johannkoenig@google.com>
Thu, 17 Aug 2017 19:34:28 +0000 (12:34 -0700)
commit7f602d6114ed0544a2f8526f8660488e92b4038e
tree06cb8390bd8d0f51c93ff993610d878e719b8c66
parentf95686895b041555d533840aed8928a08f2f1de0
quantize: normalize intermediate types

Despite abs_coeff being a positive value, all the other implementations
treat it as signed which simplifies restoring the sign.

HBD builds cast qcoeff to avoid a visual studio warning. Match
vp9_quantize.c style of casting the entire expression.

Change-Id: I62b539b8df05364df3d7644311e325288da7c5b5
vp9/encoder/vp9_quantize.c
vpx_dsp/quantize.c