VDPAU doesn't work with latest ffmpeg 3.3.4 or git master

[marillat@…]

VDPAU Nvidia 384.69 Debian unstable amd64
SInce ffmpeg 3.3.4 or with ffmpeg git master -vo vdpau display a black video
​http://samples.mplayerhq.hu/V-codecs/h264/x264_Overflow_Sample.mkv
Audio work fine.
How to reproduce:

$ mplayer-v x264_Overflow_Sample.mkv
MPlayer 1.3SVN-r37959 (C) 2000-2017 MPlayer Team
CPU vendor name: GenuineIntel  max cpuid level: 13
CPU: Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz (Family: 6, Model: 42, Stepping: 7)
extended cpuid-level: 8
extended cache-info: 16801856
Detected cache-line size is 64 bytes
CPUflags:  MMX: 1 MMX2: 1 3DNow: 0 3DNowExt: 0 SSE: 1 SSE2: 1 SSE3: 1 SSSE3: 1 SSE4: 1 SSE4.2: 1 AVX: 1
Compiled with runtime CPU detection.
get_path('codecs.conf') -> '/home/marillat/.mplayer/codecs.conf'
Reading optional codecs config file /home/marillat/.mplayer/codecs.conf: No such file or directory
Reading optional codecs config file /etc/mplayer/codecs.conf: No such file or directory
Using built-in default codecs.conf.
init_freetype
Using MMX (with tiny bit MMX2) Optimized OnScreenDisplay
get_path('fonts') -> '/home/marillat/.mplayer/fonts'
Configuration: --prefix=/usr --confdir=/etc/mplayer --datadir=/usr/share/mplayer --enable-xmga --enable-mga --enable-joystick --enable-libopencore_amrnb --enable-libopencore_amrwb --disable-openal --disable-decoder=amrnb --language=all --enable-menu --enable-radio --enable-radio-capture --extra-libs=-ldl -lvorbisenc -lvorbis --enable-xvmc --with-xvmclib=XvMCW --disable-png --enable-tdfxfb --enable-s3fb --disable-gui --enable-runtime-cpudetection --extra-ldflags=-Wl,-z,defs -Wl,--as-needed -Wl,-z,relro
CommandLine: '-v' 'x264_Overflow_Sample.mkv'
Using nanosleep() timing
get_path('input.conf') -> '/home/marillat/.mplayer/input.conf'
Reading optional input config file /home/marillat/.mplayer/input.conf: No such file or directory
Parsing input config file /etc/mplayer/input.conf
Input config file /etc/mplayer/input.conf parsed: 92 binds
Opening joystick device /dev/input/js0
Can't open joystick device /dev/input/js0: No such file or directory
Can't init input joystick
Setting up LIRC support...
do_connect: could not connect to socket
connect: No such file or directory
Failed to open LIRC support. You will not be able to use your remote control.
get_path('x264_Overflow_Sample.mkv.conf') -> '/home/marillat/.mplayer/x264_Overflow_Sample.mkv.conf'

Playing x264_Overflow_Sample.mkv.
get_path('sub/') -> '/home/marillat/.mplayer/sub/'
[file] File size is 34362697 bytes
STREAM: [file] x264_Overflow_Sample.mkv
STREAM: Description: File
STREAM: Author: Albeu
STREAM: Comment: based on the code from ??? (probably Arpi)
libavformat version 57.71.100 (internal)
Configuration: --enable-gpl --enable-postproc
LAVF_check: Matroska / WebM
libavformat file format detected.
st:0 removing common factor 1000000 from timebase
st:1 removing common factor 1000000 from timebase
[matroska,webm @ 0xe2d3be6c80]Before avformat_find_stream_info() pos: 5628 bytes read:33186 seeks:2 nb_streams:2
[h264 @ 0xe2d3c02740]nal_unit_type: 7, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]nal_unit_type: 8, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]nal_unit_type: 7, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]nal_unit_type: 8, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]nal_unit_type: 5, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]Reinit context to 1280x528, pix_fmt: yuv420p
[h264 @ 0xe2d3c02740]no picture 
[matroska,webm @ 0xe2d3be6c80]All info found
[matroska,webm @ 0xe2d3be6c80]After avformat_find_stream_info() pos: 200364 bytes read:241774 seeks:2 frames:35
==> Found video stream: 0
======= VIDEO Format ======
  biSize 80
  biWidth 1280
  biHeight 528
  biPlanes 1
  biBitCount 0
  biCompression 875967048='H264'
  biSizeImage 0
Unknown extra header dump: [1] [64] [0] [33] [ff] [e1] [0] [18] [67] [64] [0] [33] [ac] [3c] [41] [c0] [50] [4] [3a] [10] [0] [0] [3e] [90] [0] [b] [b8] [8] [f1] [83] [19] [e0] [1] [0] [5] [68] [ee] [bc] [c0] [30] 
===========================
[lavf] stream 0: video (h264), -vid 0, x264 1280x528 3783 kb/s
==> Found audio stream: 1
======= WAVE Format =======
Format Tag: 16709 (0x4145)
Channels: 6
Samplerate: 48000
avg byte/sec: 192000
Block align: 1
bits/sample: 0
cbSize: 0
==========================================================================
[lavf] stream 1: audio (eac3), -aid 0, -alang eng, English Dolby Digital Plus English 5.1 (1.5m)
LAVF: 1 audio and 1 video streams found
LAVF: build 3753828
VIDEO:  [H264]  1280x528  0bpp  23.976 fps    0.0 kbps ( 0.0 kbyte/s)
[V] filefmt:44  fourcc:0x34363248  size:1280x528  fps:23.976  ftime:=0.0417
open: No such file or directory
[MGA] Couldn't open: /dev/mga_vid
open: No such file or directory
[MGA] Couldn't open: /dev/mga_vid
[VO_TDFXFB] Can't open /dev/fb0: No such file or directory.
s3fb: can't open /dev/fb0: No such file or directory
X11 opening display: :0.0
vo: X11 color mask:  FFFFFF  (R:FF0000 G:FF00 B:FF)
vo: X11 running at 1920x1080 with depth 24 and 32 bpp (":0.0" => local display)
[x11] Detected wm supports NetWM.
[x11] Detected wm supports ABOVE state.
[x11] Detected wm supports BELOW state.
[x11] Detected wm supports FULLSCREEN state.
[x11] Current fstype setting honours FULLSCREEN ABOVE BELOW X atoms
==========================================================================
Opening video decoder: [ffmpeg] FFmpeg's libavcodec codec family
libavcodec version 57.89.100 (internal)
Configuration: --enable-gpl --enable-postproc
[h264 @ 0xe2d3c02740]nal_unit_type: 7, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]nal_unit_type: 8, nal_ref_idc: 3
INFO: libavcodec init OK!
Selected video codec: [ffh264] vfm: ffmpeg (FFmpeg H.264)
==========================================================================
Clip info:
 encoder: libebml v0.7.7 + libmatroska v0.8.1
 creation_time: 2007-06-24T12:00:01.000000Z
Load subtitles in ./
get_path('sub/') -> '/home/marillat/.mplayer/sub/'
==========================================================================
Opening audio decoder: [ffmpeg] FFmpeg/libavcodec audio decoders
dec_audio: Allocating 1536000 + 131072 = 1667072 bytes for output buffer.
FFmpeg's libavcodec audio codec
[eac3 @ 0xe2d3c02740]Channel layout '5.1(side)' with 6 channels does not match specified number of channels 2: ignoring specified channel layout
INFO: libavcodec "eac3" init OK!
AUDIO: 48000 Hz, 2 ch, floatle, 1536.0 kbit/50.00% (ratio: 192000->384000)
Selected audio codec: [ffeac3] afm: ffmpeg (FFmpeg E-AC-3)
==========================================================================
Building audio filter chain for 48000Hz/2ch/floatle -> 0Hz/0ch/??...
[libaf] Adding filter dummy 
[dummy] Was reinitialized: 48000Hz/2ch/floatle
[dummy] Was reinitialized: 48000Hz/2ch/floatle
Trying preferred audio driver 'alsa', options '[none]'
alsa-init: requested format: 48000 Hz, 2 channels, 1d
alsa-init: using ALSA 1.1.3
alsa-init: setup for 1/2 channel(s)
alsa-init: using device default
alsa-init: opening device in blocking mode
alsa-init: device reopened in blocking mode
alsa-init: got buffersize=131072
alsa-init: got period size 1024
alsa: 48000 Hz/2 channels/8 bpf/131072 bytes buffer/Float 32 bit Little Endian
AO: [alsa] 48000Hz 2ch floatle (4 bytes per sample)
AO: Description: ALSA-0.9.x-1.x audio output
AO: Author: Alex Beregszaszi, Zsolt Barat <joy@streamminister.de>
AO: Comment: under development
Building audio filter chain for 48000Hz/2ch/floatle -> 48000Hz/2ch/floatle...
[dummy] Was reinitialized: 48000Hz/2ch/floatle
[dummy] Was reinitialized: 48000Hz/2ch/floatle
Starting playback...
Increasing filtered audio buffer size from 0 to 131072
[h264 @ 0xe2d3c02740]nal_unit_type: 5, nal_ref_idc: 3
[h264 @ 0xe2d3c02740]Reinit context to 1280x528, pix_fmt: yuv420p
[h264 @ 0xe2d3c02740]no picture 
[h264 @ 0xe2d3c02740]nal_unit_type: 1, nal_ref_idc: 2
[h264 @ 0xe2d3c02740]no picture 
[h264 @ 0xe2d3c02740]nal_unit_type: 1, nal_ref_idc: 2
[ffmpeg] aspect_ratio: 0.000000
VDec: vo config request - 1280 x 528 (preferred colorspace: Planar YV12)
Trying filter chain: vo
VDec: using Planar YV12 as output csp (no 0)
Movie-Aspect is 2.35:1 - prescaling to correct movie aspect.
VO Config (1280x528->1280x546,flags=0,'MPlayer',0x32315659)
VO: [vdpau] 1280x528 => 1280x546 Planar YV12 
VO: Description: VDPAU with X11
VO: Author: Rajib Mahapatra <rmahapatra@nvidia.com> and others
[vdpau] Updating CSC matrix for BT.601
*** [vo] Exporting mp_image_t, 1280x528x12bpp YUV planar, 1013760 bytes
Unicode font: 5369 glyphs.
Unicode font: 5369 glyphs.
A:   0.1 V:   0.0 A-V:  0.088 ct:  0.000   0/  0 ??% ??% ??,?% 0 0 
[h264 @ 0xe2d3c02740]nal_unit_type: 1, nal_ref_idc: 0

[beastd]

Can't reproduce here.

Will try on another machine as soon as time permits.

[beastd]

Can you still reproduce this behavior with current MPlayer and FFmpeg 3.4?

[marillat@…]

Replying to beastd:

Can you still reproduce this behavior with current MPlayer and FFmpeg 3.4?

Still the same with svn r38004

For the record svn doesn't build with libopenjpeg 2.3

[beastd]

Replying to marillat@…:

Replying to beastd:

Can you still reproduce this behavior with current MPlayer and FFmpeg 3.4?

Still the same with svn r38004

Can you paste the new MPlayer console output.

For the record svn doesn't build with libopenjpeg 2.3

Hmm, strange. It builds with libopenjpeg 2.3 here. Please open a new ticket and include the build error (after the build fails, please execute once more make (without -j) and paste that output) and attach config.log.

[marillat@…]

Replying to beastd:

Can you paste the new MPlayer console output.

Build with only --disable-libopenjpeg

MPlayer SVN-r38005-7 (C) 2000-2017 MPlayer Team
do_connect: could not connect to socket
connect: No such file or directory
Failed to open LIRC support. You will not be able to use your remote control.

Playing /home/marillat/Video/A380_landing_SF.mkv.
libavformat version 57.83.100 (internal)
libavformat file format detected.
[lavf] stream 0: video (h264), -vid 0
[lavf] stream 1: audio (aac), -aid 0
VIDEO:  [H264]  1280x720  0bpp  25.000 fps    0.0 kbps ( 0.0 kbyte/s)
==========================================================================
Opening video decoder: [ffmpeg] FFmpeg's libavcodec codec family
libavcodec version 57.107.100 (internal)
Selected video codec: [ffh264] vfm: ffmpeg (FFmpeg H.264)
==========================================================================
Clip info:
 encoder: libebml v1.3.4 + libmatroska v1.4.5
 creation_time: 2017-03-05T13:42:11.000000Z
Load subtitles in /home/marillat/Video/
==========================================================================
Opening audio decoder: [ffmpeg] FFmpeg/libavcodec audio decoders
AUDIO: 44100 Hz, 2 ch, floatle, 0.0 kbit/0.00% (ratio: 0->352800)
Selected audio codec: [ffaac] afm: ffmpeg (FFmpeg AAC (MPEG-2/MPEG-4 Audio))
==========================================================================
couldn't open play stream: Device or resource busy
ao2: can't open sndio
[AO OSS] audio_setup: Can't open audio device /dev/dsp: No such file or directory
AO: [alsa] 48000Hz 2ch floatle (4 bytes per sample)
Starting playback...
Movie-Aspect is 1.78:1 - prescaling to correct movie aspect.
VO: [vdpau] 1280x720 => 1280x720 Planar YV12 
A:   3.3 V:   3.3 A-V:  0.000 ct: -0.001   0/  0  6%  2%  0.3% 0 0 

Exiting... (Quit)

For the record svn doesn't build with libopenjpeg 2.3

Hmm, strange. It builds with libopenjpeg 2.3 here. Please open a new ticket and include the build error (after the build fails, please execute once more make (without -j) and paste that output) and attach config.log.

Done in #2337

[marillat@…]

mplayer is working correctly today, you can close this bug.

I don't know where the problem come from.

I'll try to not report this sort of bug the next time.

[beastd]

It's a bit unfortunate we couldn't find out what the real culprit was.

Hopefully we can narrow things down further next time.