Android MediaCodec for HEVC

android android-ndk android-mediacodec hevc
Jack picture Jack · Jan 19, 2015 · Viewed 8.3k times · Source

I'm looking into using the android MediaCodec class to decode HEVC. Are there any examples of projects that do this?

At present I configure the decoder with the following:

AMEDIAFORMAT_KEY_MIME: "video/hevc"
AMEDIAFORMAT_KEY_MAX_HEIGHT: 4320
AMEDIAFORMAT_KEY_MAX_WIDTH: 8192
AMEDIAFORMAT_KEY_HEIGHT: 1600
AMEDIAFORMAT_KEY_WIDTH: 3840
AMEDIAFORMAT_KEY_FRAME_RATE: 24
AMEDIAFORMAT_KEY_PUSH_BLANK_BUFFERS_ON_STOP: 1

When using this setup, I get no video output. I've also tried setting csd-0, csd-1 and csd-2 to the VPS, SPS and PPS respectively, but have had no luck.

I get the following error in the console, but have been assured it is unrelated:

01-19 15:40:36.048: E/OMXNodeInstance(17230): OMX_GetExtensionIndex OMX.google.android.index.storeMetaDataInBuffers failed
01-19 15:40:36.048: E/ACodec(17230): [OMX.google.hevc.decoder] storeMetaDataInBuffers failed w/ err -2147483648

I have found that dequeueOutputBuffer is always returning -1. It appears that dequeueInputBuffer is returning indices that have been queued by queueInputBuffer before they are obtained from dequeueOutputBuffer.

Has anyone managed to decode HEVC video on Android?

Answer

mstorsjo picture mstorsjo · Jan 19, 2015

VLC at least has support for it, although I'm not sure exactly which decoders it has been tested with (I can see from your log snippet that you're using the SW decoder). As far as I know, the only detail about it that you'd need to take care of is passing the packets in annex b format (with start codes) instead of the mp4/mkv format - just as for H264.

See e.g. http://git.videolan.org/?p=vlc.git;a=commitdiff;h=86630a1, http://git.videolan.org/?p=vlc.git;a=commitdiff;h=5e19ce93 and http://git.videolan.org/?p=vlc.git;a=commitdiff;h=7b79a086 for some examples on this.

Also, the log message about storeMetaDataInBuffers failing is unrelated and nothing to worry about, see Q12 at http://bigflake.com/mediacodec/.

Related questions

Android Fatal signal 11 (SIGSEGV) at 0x636f7d89 (code=1). How can it be tracked down?

I've been reading the other posts on tracking down the reasons for getting a SIGSEGV in an Android app. I plan to scour my app for possible NullPointers related to Canvas use, but my SIGSEGV barfs up a different memory …

Read More
java.lang.ClassNotFoundException: Didn't find class on path: dexpathlist

I'm currently working on a project in which I have to use purely native ndk. It worked when I try running an helloworld example from Irrlicht engine source. Then I try using it in my project following the same format …

Read More
Error: No toolchains found in the NDK toolchains folder for ABI with prefix: llvm

I want to compile an open source android project (Netguard) using gradel (gradlew clean build) But I encountered this Error: A problem occurred configuring project ':app'. > Exception thrown while executing model rule: NdkComponentModelPlugin.Rules#cre ateToolchains > No …

Read More