]> granicus.if.org Git - libvpx/commitdiff
Fix error in get_ul_intra_threshold() for 10/12 bit.
authorpaulwilkins <paulwilkins@google.com>
Thu, 30 Jun 2016 12:38:57 +0000 (13:38 +0100)
committerpaulwilkins <paulwilkins@google.com>
Thu, 30 Jun 2016 12:38:57 +0000 (13:38 +0100)
The scaling of the threshold for 10 and 12 bit here appears
to be in the wrong direction. For 10 and 12 bit we expect sse
values to be higher and hence the threshold used should be
scaled up not down.

Change-Id: I2678116652b539aef48100e0f22873edd4f5a786

vp9/encoder/vp9_firstpass.c

index 11b397cd6880f713d8c4bd1d40813ed7ab64960b..66ccc92c42b9136d30c50cc628eb51ce4fd63359 100644 (file)
@@ -506,10 +506,10 @@ static int get_ul_intra_threshold(VP9_COMMON *cm) {
         ret_val = UL_INTRA_THRESH;
         break;
       case VPX_BITS_10:
-        ret_val = UL_INTRA_THRESH >> 2;
+        ret_val = UL_INTRA_THRESH << 2;
         break;
       case VPX_BITS_12:
-        ret_val = UL_INTRA_THRESH >> 4;
+        ret_val = UL_INTRA_THRESH << 4;
         break;
       default:
         assert(0 && "cm->bit_depth should be VPX_BITS_8, "