This should speed the affected cases (MBAFF temporal direct MBs) up. Originally committed as revision 21686 to svn://svn.ffmpeg.org/ffmpeg/trunk