I have a question about decoding MVC with the SDK 3 beta:
How is this supposed to work if the encoded stream is separated like in the m2ts files of AVCHD and Blu-Ray?
How does decodeheader work? Do you have to call it on the base and the dependent stream?
What does DecodeFrameAsync expect? Do I need to merge the two streams in one? Do I interleave frames or can I interleave NALUs?
The streams are separated into MVC base viewand MVC dependent view. Either as 2 elementary streams muxed in a ts or as two separate files. One stream with profile high, the other with stereo high.
So it seems I have to merge the streams before passing it to the decoder. Should they be merged frame by frame or on any NALU border?