From: paulwilkins Date: Thu, 30 Jun 2016 12:38:57 +0000 (+0100) Subject: Fix error in get_ul_intra_threshold() for 10/12 bit. X-Git-Tag: v1.6.1~464^2 X-Git-Url: https://granicus.if.org/sourcecode?a=commitdiff_plain;h=e25d6252a41bcc10bd099569193aac4a032589fc;p=libvpx Fix error in get_ul_intra_threshold() for 10/12 bit. The scaling of the threshold for 10 and 12 bit here appears to be in the wrong direction. For 10 and 12 bit we expect sse values to be higher and hence the threshold used should be scaled up not down. Change-Id: I2678116652b539aef48100e0f22873edd4f5a786 --- diff --git a/vp9/encoder/vp9_firstpass.c b/vp9/encoder/vp9_firstpass.c index 11b397cd6..66ccc92c4 100644 --- a/vp9/encoder/vp9_firstpass.c +++ b/vp9/encoder/vp9_firstpass.c @@ -506,10 +506,10 @@ static int get_ul_intra_threshold(VP9_COMMON *cm) { ret_val = UL_INTRA_THRESH; break; case VPX_BITS_10: - ret_val = UL_INTRA_THRESH >> 2; + ret_val = UL_INTRA_THRESH << 2; break; case VPX_BITS_12: - ret_val = UL_INTRA_THRESH >> 4; + ret_val = UL_INTRA_THRESH << 4; break; default: assert(0 && "cm->bit_depth should be VPX_BITS_8, "