theora transcode segfault

changed milestone to %0.8.5-test3

mpeg2.ts input, wizard, theo, mpeg2-ts encapsulated.. crash

Program received signal SIGSEGV, Segmentation fault.
[Switching to thread 532.0xe28]
__module_Need (p_this=0x7d271d8, psz_capability=<incomplete type>,
    psz_name=<incomplete type>, b_strict=1) at src/misc/modules.c:672
672             vlc_object_release( p_tmp->p_module );

(gdb) bt

[#0](https://code.videolan.org/videolan/vlc/-/issues/0)  __module_Need (p_this=0x7d271d8, psz_capability=<incomplete type>,
    psz_name=<incomplete type>, b_strict=1) at src/misc/modules.c:672
[#1](https://code.videolan.org/videolan/vlc/-/issues/1)  0x077c72e9 in Send (p_stream=0x7d28ca8, id=0x7d14838, p_buffer=0x7d8a320)
    at transcode.c:1621
[#2](https://code.videolan.org/videolan/vlc/-/issues/2)  0x00444ed0 in sout_InputSendBuffer (p_input=<incomplete type>,
    p_buffer=<incomplete type>) at src/stream_output/stream_output.c:275
[#3](https://code.videolan.org/videolan/vlc/-/issues/3)  0x0046eea8 in DecoderDecode (p_dec=0x7d12b80, p_block=0x7d89a90)
    at src/input/decoder.c:579
[#4](https://code.videolan.org/videolan/vlc/-/issues/4)  0x0047c0c0 in EsOutSend (out=0x7d18da8, es=0x7d07450, p_block=0x7d89a90)
    at src/input/es_out.c:1084
[#5](https://code.videolan.org/videolan/vlc/-/issues/5)  0x04514a32 in ParsePES (p_demux=0x7d07ba8, pid=0x7d36fd8)
    at ../../include/vlc_es_out.h:108
[#6](https://code.videolan.org/videolan/vlc/-/issues/6)  0x04515cd2 in Demux (p_demux=0x7d07ba8) at ts.c:1768
[#7](https://code.videolan.org/videolan/vlc/-/issues/7)  0x00440ac3 in MainLoop (p_input=0x7d0c958) at src/input/input.c:525
[#8](https://code.videolan.org/videolan/vlc/-/issues/8)  0x004417ff in Run (p_input=0x7d0c958) at src/input/input.c:432
[#9](https://code.videolan.org/videolan/vlc/-/issues/9)  0x77bcb530 in msvcrt!_endthreadex ()
   from /cygdrive/c/WINDOWS/system32/msvcrt.dll
[#10](https://code.videolan.org/videolan/vlc/-/issues/10) 0x07d0c958 in ?? ()
[#11](https://code.videolan.org/videolan/vlc/-/issues/11) 0x00000000 in ?? () from

Works fine on Debian.

BTW: TS does not support theo encapsulation, but it does not seem to be the cause

Only available options in win32 wizard: video theora -> encapsulation mpeg2 ts, audio ogg -> encapsulation none

Actually fails everywhere.

The transcode is very erratic, but always result in a corruption of the objects structure.

However, it appears to be in libtheora itself.

added 1 deleted label

Thread 7 (Thread 1129372592 (LWP 30762)):
[#0](https://code.videolan.org/videolan/vlc/-/issues/0)  0x400c1964 in GetHalfPixelSumAbsDiffs (
    SrcData=0x852ed90 "\021\021\021\021\021\020\021\020\021\021\021\021\021\021\021\021\022\022\021\021\021\022\022\023\022\022\021\021\021\022\022\023\020\020\020\020\020\020\020\020\020\021\021\021\021\021\021\020\020\020\020\020\020\020\020\020\021\020\020\020\021\021\021\021", '\020' <repeats 42 times>, "\021\021\021\021", '\020' <repeats 18 times>, '\021' <repeats 16 times>, "\022\021\022\022\022\021\021\020\020\020\021\022\022\022\022\022\022\021\021\021\021\021\021\020", '\022' <repeats 13 times>, "\021\021\021\020\020\020\020\020\017\017\017\021\021\022\022\022\022\022\022"...,
    RefDataPtr1=0x84d6b78 '\021' <repeats 56 times>, "\022\022\022\022\022\022\022\022", '\020' <repeats 21 times>, '\021' <repeats 27 times>, "\020\020\020\020\020\020\020\020", '\021' <repeats 56 times>, '\020' <repeats 24 times>...,
    RefDataPtr2=0x84d6c88 '\020' <repeats 14 times>, "\021\021\021\021\021\021\021\021\021\021\020\020\020\020\020\020\020\020", '\021' <repeats 24 times>, '\020' <repeats 24 times>, '\021' <repeats 56 times>, "\020\020\020\020\020\020\020\020\021\021\021\021\021\021\021\021", '\020' <repeats 48 times>...,
    PixelsPerLine=240, ErrorSoFar=56, BestSoFar=81) at mcomp.c:287
[#1](https://code.videolan.org/videolan/vlc/-/issues/1)  0x400c25e8 in GetMBMVInterError (cpi=0x8481050,
    RefFramePtr=0x84d1fa8 '\021' <repeats 18 times>, "\022\022\022\022\022\022\022", '\021' <repeats 15 times>, "\022\022\022\022\022\022\022\022", '\021' <repeats 32 times>, "\022\022\022\022\022\022\022\021\021\021\021\021\021\021\021\021", '\022' <repeats 16 times>, '\021' <repeats 16 times>, "\022\022\022\022\022\022\022\022", '\021' <repeats 16 times>, "\020\020\020\020\020\020\020\020", '\021' <repeats 40 times>..., FragIndex=130, PixelsPerLine=240,
    MVPixelOffset=0x848122c, MV=0x4350cb24) at mcomp.c:636
[#2](https://code.videolan.org/videolan/vlc/-/issues/2)  0x400d2db7 in PickModes (cpi=0x8481050, SBRows=6, SBCols=8,
    PixelsPerLine=240, InterError=0x4350cca0, IntraError=0x4350cc9c)
    at encode.c:1231
[#3](https://code.videolan.org/videolan/vlc/-/issues/3)  0x400d51fa in CompressFrame (cpi=0x8481050) at encoder_toplevel.c:718
[#4](https://code.videolan.org/videolan/vlc/-/issues/4)  0x400d5a91 in theora_encode_YUVin (t=0x82db774, yuv=0x4350cd58)
    at encoder_toplevel.c:976
[#5](https://code.videolan.org/videolan/vlc/-/issues/5)  0x08100db6 in Encode (p_enc=0x82db1e0, p_pict=0x82dbd38) at theora.c:805
[#6](https://code.videolan.org/videolan/vlc/-/issues/6)  0x43512f74 in transcode_video_process (p_stream=0x82ab820, id=0x82ad6b0,
    in=0x8602740, out=0x4350cf94) at transcode.c:2274
[#7](https://code.videolan.org/videolan/vlc/-/issues/7)  0x435147ed in Send (p_stream=0x82ab820, id=0x82ad6b0, p_buffer=0x8602740)
    at transcode.c:1140
[#8](https://code.videolan.org/videolan/vlc/-/issues/8)  0x080846b1 in sout_InputSendBuffer (p_input=0x82ad638, p_buffer=0x8602740)
    at stream_output/stream_output.c:277
[#9](https://code.videolan.org/videolan/vlc/-/issues/9)  0x080c2dac in DecoderDecode (p_dec=0x82acad8, p_block=0x8601eb0)
    at input/decoder.c:579
[#10](https://code.videolan.org/videolan/vlc/-/issues/10) 0x080c6436 in EsOutSend (out=0x84d6b7c, es=0x82d9930, p_block=0x8601eb0)
    at input/es_out.c:1087
[#11](https://code.videolan.org/videolan/vlc/-/issues/11) 0x4445bd7e in Demux (p_demux=0x82a9ca8) at vlc_es_out.h:108
[#12](https://code.videolan.org/videolan/vlc/-/issues/12) 0x080684fd in MainLoop (p_input=0x82abbb8) at input/input.c:527
[#13](https://code.videolan.org/videolan/vlc/-/issues/13) 0x0806a0db in Run (p_input=0x82abbb8) at input/input.c:434
[#14](https://code.videolan.org/videolan/vlc/-/issues/14) 0x40074ced in start_thread () from /lib/tls/libpthread.so.0
[#15](https://code.videolan.org/videolan/vlc/-/issues/15) 0x401b2dde in clone () from /lib/tls/libc.so.6

changed milestone to %0.8.6 maintenance

still segfaults with svn 16290 contrib 20060730 and ffmpeg 6021 but only when the transcoded output resolution is not the same as the input (using scale or width and height).

changed milestone to %0.8.6

Same here. Still fails with svn 20060927. Even tried things like setting "fps=..." etc. Encoding to ogg-vorbis only is fine, but aadding vorbis either spends a lot of CPU without output or even crashes :-(

PS: Does this work with older versions of libtheora or something?!?

This seems more related to muxing Video into ogg then to theora. Ogg also seems to crash with mp4v and div3 sometimes...

To be honest: I didn't even think about putting something else into an Ogg-container :-)

But trying with just theora and leaving vorbis away (video-only file) does not seem to change much. hartman, if you are right with the assumption it's in the mux-part then maybe there is something broken with libogg in that part where video is muxed in - audio seems to work fine. And even if just one stream (only video) is put in an ogg-container, it seems to break.

It seems to work when you use theora with a raw container. Only thing is that VLC doesn't seem to be able to playback plain Theora without a container - which is "strange" anyway :-)

Maybe somebody knows how the muxing-parts (libogg?) could be fixed?

Some weird case of memory corruption.. Crash reproducable every time for a file transcode with the same input file, default theo and vorb values, ogg mux (only option) and constantly the same output file name H:\vorbtest yet when I change the output name by adding a single character it works again.

got different type of crashes when i transcode an input WMV(WMV3 video + wma2 audio) stream in ogg/theora+vorbis. Transcoding platform: linux mandriva 2006 + latests ffmpeg snapshot + vlc 0.8.6-rc1.

I'm not cropping or changing the size.

Command line used: vlc --color -vvv mmsh://input_ip:8800 --sout '#transcode{vcodec=theora,acodec=vorb,ab=96} :std{access=shout,mux=ogg,dst=xxxxx@localhost:8000/mixlive.ogg}'

When video source is 320x240 vlc mostly launches and transcode it. When it crashes i see that:

[00000253] stream_out_transcode private debug: source 320x240, crop 320x240, destination 320x240, padding 320x240 [00000253] stream_out_transcode private debug: encoder aspect is 576000:432000 [00000298] main encoder debug: looking for encoder module: 5 candidates [00000298] main encoder debug: using encoder module "theora" [00000260] main private debug: adding a new input [00000260] mux_ogg private debug: adding input [00000260] mux_ogg private debug: theora stream *** glibc detected *** corrupted double-linked list: 0x087ff480 ***

(gdb) bt #0 0xffffe410 in __kernel_vsyscall () #1 (closed) 0xb7af7051 in raise () from /lib/tls/libc.so.6 #2 (closed) 0xb7af8a3b in abort () from /lib/tls/libc.so.6 #3 (closed) 0xb7b2d9d5 in __fsetlocking () from /lib/tls/libc.so.6 #4 0xb7b3415c in malloc_usable_size () from /lib/tls/libc.so.6 #5 (closed) 0xb7b344d2 in free () from /lib/tls/libc.so.6 #6 (closed) 0x0811a7d4 in DecodeVideo__ffmpeg () #7 (closed) 0x00000002 in ?? () #8 (closed) 0x00000077 in ?? () #9 (closed) 0x088e5d3f in ?? () #10 (closed) 0x00000708 in ?? () #11 (closed) 0xb7bfcff4 in ?? () from /lib/tls/libc.so.6 #12 (closed) 0xb7bfe880 in __malloc_initialize_hook () from /lib/tls/libc.so.6 #13 (closed) 0x0000025f in ?? () #14 (closed) 0xb5a03dd8 in ?? () #15 (closed) 0xb7b36226 in malloc () from /lib/tls/libc.so.6 Previous frame inner to this frame (corrupt stack?) (gdb)

next time i launched it it ran OKay, i could see the theora stream with video and sound, but when i closed VLC:

(gdb) bt #0 0xffffe410 in __kernel_vsyscall () #1 (closed) 0xb7a8a051 in raise () from /lib/tls/libc.so.6 #2 (closed) 0xb7a8ba3b in abort () from /lib/tls/libc.so.6 #3 (closed) 0xb7ac09d5 in __fsetlocking () from /lib/tls/libc.so.6 #4 0xb7ac715c in malloc_usable_size () from /lib/tls/libc.so.6 #5 (closed) 0xb7ac74d2 in free () from /lib/tls/libc.so.6 #6 (closed) 0x08464306 in av_freep (arg=0xb7b8fff4) at mem.c:136 #7 (closed) 0x081c573f in avcodec_default_free_buffers (s=0x8603608) at utils.c:1221 #8 (closed) 0x0841f340 in vc1_decode_end (avctx=0x0) at vc1.c:4336 #9 (closed) 0x081c6945 in avcodec_close (avctx=0x8603608) at utils.c:963 #10 (closed) 0x08119978 in CloseDecoder () #11 (closed) 0xb7b90480 in _IO_list_all () from /lib/tls/libc.so.6 #12 (closed) 0x084776d8 in psz_tag.14514 () #13 (closed) 0x086f6488 in ?? () #14 (closed) 0x0846cb9c in _IO_stdin_used () #15 (closed) 0x084775ae in psz_tag.14514 () #16 (closed) 0x0847dcd1 in key_perm () #17 (closed) 0x0860afd8 in ?? () #18 (closed) 0x0846c022 in _IO_stdin_used () #19 (closed) 0x00000005 in ?? () #20 (closed) 0x08537710 in ?? () #21 (closed) 0x085c2864 in ?? () #22 (closed) 0x0860afd8 in ?? () #23 (closed) 0x00000000 in ?? () (gdb)

when video source is 384x288, vlc ALWAYS crashes

[00000253] stream_out_transcode private debug: source 384x288, crop 384x288, destination 384x288, padding 384x288 [00000253] stream_out_transcode private debug: encoder aspect is 576000:432000 [00000298] main encoder debug: looking for encoder module: 5 candidates [00000298] main encoder debug: using encoder module "theora" [00000260] main private debug: adding a new input [00000260] mux_ogg private debug: adding input [00000260] mux_ogg private debug: theora stream [00000297] ffmpeg decoder warning: Bits overconsumption: 6863 > 6768 at 19x8 (wmv3@0x8702960) *** glibc detected *** realloc(): invalid size: 0x088b1fd8 ***

(gdb) bt #0 0xffffe410 in __kernel_vsyscall () #1 (closed) 0xb7a4b051 in raise () from /lib/tls/libc.so.6 #2 (closed) 0xb7a4ca3b in abort () from /lib/tls/libc.so.6 #3 (closed) 0xb7a819d5 in __fsetlocking () from /lib/tls/libc.so.6 #4 0xb7a89da9 in free () from /lib/tls/libc.so.6 #5 (closed) 0xb7a8a836 in realloc () from /lib/tls/libc.so.6 #6 (closed) 0xb7c64cd6 in oggpackB_write () from /usr/lib/libogg.so.0 #7 (closed) 0x088b1fd8 in ?? () #8 (closed) 0x00000c00 in ?? () #9 (closed) 0x00000000 in ?? () (gdb)

Second try:

(gdb) bt #0 0xffffe410 in __kernel_vsyscall () #1 (closed) 0xb7a3f051 in raise () from /lib/tls/libc.so.6 #2 (closed) 0xb7a40a3b in abort () from /lib/tls/libc.so.6 #3 (closed) 0xb7a759d5 in __fsetlocking () from /lib/tls/libc.so.6 #4 0xb7a7ccd1 in free () from /lib/tls/libc.so.6 #5 (closed) 0xb7a7e226 in malloc () from /lib/tls/libc.so.6 #6 (closed) 0x08119262 in LibavcodecCallback () #7 (closed) 0x00000042 in ?? () #8 (closed) 0x00000003 in ?? () #9 (closed) 0x00000033 in ?? () #10 (closed) 0x00000031 in ?? () #11 (closed) 0x00000001 in ?? () #12 (closed) 0x0000007f in ?? () #13 (closed) 0x00000028 in ?? () #14 (closed) 0x00000027 in ?? () #15 (closed) 0x00000002 in ?? () #16 (closed) 0x086f7da0 in ?? () #17 (closed) 0x084facc0 in ulti_codebook () #18 (closed) 0x087037f0 in ?? () #19 (closed) 0x0000000a in ?? () #20 (closed) 0x000007fa in ?? () #21 (closed) 0x08702910 in ?? () #22 (closed) 0x08464271 in av_log (avcl=0xf00, level=192, fmt=0xb594bc4c "õ\031") at log.c:65 #23 (closed) 0x0842b39e in vc1_decode_blocks (v=0xb7b44ff4) at vc1.c:3971 Previous frame inner to this frame (corrupt stack?) (gdb)

Third try:

[00000260] mux_ogg private debug: theora stream [00000297] ffmpeg decoder warning: get_buffer() failed (stride changed) (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: cannot decode one frame (1518 bytes) [00000297] ffmpeg decoder warning: releasing zombie picture (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: get_buffer() failed (stride changed) (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: cannot decode one frame (3642 bytes) [00000297] ffmpeg decoder warning: releasing zombie picture (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: get_buffer() failed (stride changed) (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: cannot decode one frame (2218 bytes) [00000252] main stream output debug: adding a new input [00000253] stream_out_transcode private debug: creating audio transcoding from fcc=wma2' to fcc=vorb' [00000305] main decoder debug: looking for decoder module: 21 candidates [00000305] ffmpeg decoder debug: libavcodec already initialized [00000305] ffmpeg decoder debug: ffmpeg codec (Windows Media Audio 2) started [00000305] main decoder debug: using decoder module "ffmpeg" [00000306] main encoder debug: looking for encoder module: 5 candidates [00000306] main encoder debug: using encoder module "vorbis" [00000307] main private debug: looking for audio filter2 module: 3 candidates [00000307] audio_format private debug: s16l->fl32, bits per sample: 16 [00000307] main private debug: using audio filter2 module "audio_format" [00000260] main private debug: adding a new input [00000260] mux_ogg private debug: adding input [00000260] mux_ogg private debug: vorbis stream [00000297] ffmpeg decoder warning: releasing zombie picture (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: get_buffer() failed (stride changed) (wmv3@0x87015f0) [00000297] ffmpeg decoder warning: cannot decode one frame (2150 bytes) ./mixlive: line 6: 31906 Erreur de segmentation (core dumped)

(gdb) bt #0 0x081c8308 in alloc_picture (s=0x8703020, pic=0x8705dc4, shared=Variable "shared" is not available. ) at mpegvideo.c:449 #1 (closed) 0x081da665 in MPV_frame_start (s=0x8703020, avctx=0x87015f0) at mpegvideo.c:1575 #2 (closed) 0x0842d718 in vc1_decode_frame (avctx=0x87015f0, data=0xb5a37e74, data_size=0x62b, buf=0x890d738 "#Ãöáº\177>\006¬b/À\b\205LX\023\024\bi¼L!`,\024\202\aq\202\212Â\213\211\203\006\031\202\213C\f\027\001ÌX¦³ZâÌðag²¸\217ÖGiÂÀ!ö¸f8fÎþ,B¯ß\003vCh\234P÷¢r*ØO\002\004Ý\032ÙúósÇ8¯\2140½lÅ¬\036²é\2303³~eÇÙìêÈH\2123dæ\vûÜVü\233¡\217l\034°{FM", buf_size=141563376) at vc1.c:4289 Previous frame inner to this frame (corrupt stack?)

When video source is 320x240 (which mostly works) and i try to duplicate the stream to forward it as original stream + transcoding it to theora. VLC ALWAYS crashes ..

Command line used: vlc --color -vvv mmsh://input_ip:8800 --sout '#duplicate{dst="transcode{vcodec=theora,acodec=vorb,ab=96} :std{access=shout,mux=ogg,dst=xxxx@localhost:8000/mixlive.ogg}", dst=std{access=mmsh,mux=asfh,dst=:8080}}'

(gdb) bt #0 0x081c8308 in alloc_picture (s=0x8711cf0, pic=0x8714910, shared=Variable "shared" is not available. ) at mpegvideo.c:449 #1 (closed) 0x081da665 in MPV_frame_start (s=0x8711cf0, avctx=0x870ff10) at mpegvideo.c:1575 #2 (closed) 0x0842d718 in vc1_decode_frame (avctx=0x870ff10, data=0xb59f3e44, data_size=0x61b, buf=0x8818a78 "ãÛB\213>p½À¸7+\a\037-ñ1CBWÈaÛ\bÊ\023\030\030ÀF\004", buf_size=141623056) at vc1.c:4289 Previous frame inner to this frame (corrupt stack?)

Hope it can help you .. I can make the original stream available if you need it.

Briah

changed milestone to %0.9.0 bugs

Patch to fix Theora encoder in VLC's SVN trunk (2006-12-22T00:28:01+0100)

Added attachment:

vlc-20061222T002801+0100-theora_encoder-1.patch

Original author: n-roeser@gmx.net

That should fix it. PLEASE TEST!

Merry Christmas.

Original author: n-roeser@gmx.net

changed milestone to %0.9.0-test1

theora transcode segfault

Child items ...

Activity