Just noticed there is a memory leak in h264.c with the usage of rbsp_buffer.
Here is a patch which frees the rbsp_buffer in decode_end().
patch by (Gábor Kovács | picard / demoscene \ hu)
Originally committed as revision 4607 to svn://svn.ffmpeg.org/ffmpeg/trunk