mencoder segfaults when x264 with 8x8dct is used

[sebastian_ml@…]

Hi all,

I'm trying to encode a dvd video using the following mencoder.conf/command
line:

x264encopts=subq=5:frameref=3:bframes=2:b_pyramid=1:turbo=1:qp_step=4:weight_b=1:4x4mv=1:8x8dct=1:direct_pred=2:keyint=240

-x264encopts bitrate=992:pass=1

mencoder doesn't like it:
1 duplicate frame(s)!
Muxer frame buffer sending 2 frame(s) to the muxer.
Writing header...
ODML: vprp aspect is 16384:6985.
Setting audio delay to 0.083s.
Writing header...
ODML: vprp aspect is 16384:6985.
Setting audio delay to 0.083s.
Pos: 0.0s 3f (36%) 0fps Trem: 0min 0mb A-V:0.007 [0:0] A/Vms
0/82 Pos: 0.0s 4f (36%) 0fps Trem: 0min 0mb A-V:0.010 [0:0]
A/Vms 1/67 * [crop] Allocating mp_image_t, 720x480x12bpp YUV planar, 518400
bytes
Segmentation fault

I removed one option after the other to find out which one is
responsible and I found it was 8x8dct. When I set it to 0 mencoder works.

Here's what I use:

• mplayer and x264 from svn (unset CFLAGS before building)
• Linux section_eight 2.6.17.13 #3 Sun Sep 10 02:41:44 CEST 2006 i686 AMD

Sempron(tm) 2400+ GNU/Linux

• -rwxr-xr-x 1 root root 1188368 2. Sep 03:52 /lib/libc-2.4.so*
• lrwxrwxrwx 1 root root 11 11. Sep 19:24 /lib/libc.so.6 -> libc-2.4.so*
• gcc -v

Using built-in specs.
Target: i686-pc-linux-gnu
Configured
with: /var/tmp/portage/gcc-4.1.1/work/gcc-4.1.1/configure --prefix=/usr --bindir=/usr/i686-pc-linux-gnu/gcc-bin/4.1.1 --includedir=/usr/lib/gcc/i686-pc-linux-gnu/4.1.1/include --datadir=/usr/share/gcc-data/i686-pc-linux-gnu/4.1.1 --mandir=/usr/share/gcc-data/i686-pc-linux-gnu/4.1.1/man --infodir=/usr/share/gcc-data/i686-pc-linux-gnu/4.1.1/info --with-gxx-include-dir=/usr/lib/gcc/i686-pc-linux-gnu/4.1.1/include/g++-v4 --host=i686-pc-linux-gnu --build=i686-pc-linux-gnu --disable-altivec --enable-nls --without-included-gettext --with-system-zlib --disable-checking --disable-werror --disable-libunwind-exceptions --disable-multilib --disable-libmudflap --disable-libssp --disable-libgcj --enable-languages=c,c++ --enable-shared --enable-threads=posix --enable-cxa_atexit --enable-clocale=gnu
Thread model: posix
gcc version 4.1.1 (Gentoo 4.1.1)

• GNU ld version 2.16.1
• GNU assembler 2.16.1

Copyright 2005 Free Software Foundation, Inc.
This program is free software; you may redistribute it under the terms of
the GNU General Public License. This program has absolutely no warranty.
This assembler was configured for a target of `i686-pc-linux-gnu'.

• cat /proc/cpuinfo

processor : 0
vendor_id : AuthenticAMD
cpu family : 6
model : 8
model name : AMD Sempron(tm) 2400+
stepping : 1
cpu MHz : 1670.452
cache size : 256 KB
fdiv_bug : no
hlt_bug : no
f00f_bug : no
coma_bug : no
fpu : yes
fpu_exception : yes
cpuid level : 1
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca
cmov pat pse36 mmx fxsr sse syscall mp mmxext 3dnowext 3dnow up ts
bogomips : 3343.85

I'll attach the logs in a minute.

Regards
Sebastian

[sebastian_ml@…]

2>

[sebastian_ml@…]

1>

[sebastian_ml@…]

gdb output

[sebastian_ml@…]

Forgot to mention the SVN revisions (they don't show up because the subversion
eclass I use doesn't copy the .svn directory):

x264: Revision 564
mplayer: Revision 19838