]> granicus.if.org Git - libvpx/commit
projects / libvpx / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: f00a237) | patch
added checks to prevent rate/distortion overflow
authorYaowu Xu <yaowu@google.com>
Sat, 20 Jul 2013 00:38:55 +0000 (17:38 -0700)
committerYaowu Xu <yaowu@google.com>
Sat, 20 Jul 2013 00:52:50 +0000 (17:52 -0700)
commitea284d62814cedd59baa20a1db1f44b16abb431d
tree4741ec7dc8fcdba751216e8389bd5c12e47a897etree | snapshot
parentf00a237a43b86298f18ff9f09c29c4cf965f6d04commit | diff
added checks to prevent rate/distortion overflow

At speed 2, due to the threshold scheme used, it is possible the rate
and distortion assigned with INT_MAX value. The patch added checking
to prevent the INT_MAX value is used in further calculation of RD
scores. The patch also changed the assertion in rd_use_partition() to
be mirror similar assertion in rd_pick_partition().

Change-Id: Idb52c543cc1e10abdf6e6a5d6e9cb535a42214dc
vp9/encoder/vp9_encodeframe.c diff | blob | history
Unnamed repository; edit this file 'description' to name the repository.