Codec Optimization TR

Blueprint Specifications

Summit Minutes: https://wiki.linaro.org/Events/2011-06-MMWG/CodecOptimization

Summit Actions and Closure Notes

  • Mans, Tom, Mandeep to work with Darrell on -turbo
  • Study how Android does hardware capability selection to dynamically load NEON vs non-NEON components?
  • Look at OpenSSL on ARM; evaluate NEON optimization potential
  • Look at libjpeg Android loading: how is support for hardware codecs handled?
  • Investigate how libjpeg-turbo could cater for handling hardware decoding
    • Switching would need to be dynamic because for smaller images the latency overhead could negate the benefit
    • How would the hardware codec be exposed to libjpeg-turbo
    • What about decoding hundreds of images in a gallery
  • Investigate OpenCV implementation -- how much of it is vectorizable; what has been SSE'd; how hard will it be to add NEON routines (Mandeep: some Freescale work done)
    • Do a broad sweep of Ubuntu packages that are using SSE and missing NEON for candidates for work
      • pixman, skia probably already have NEON code
      • transcoding for MMS might be another use case
  • Look at use of composition/blending and color conversion in SurfaceFlinger; potential for NEON work or handled by the GPU already?

    • Investigate which upstream projects could accept NEON optimizations

JPEG

libjpeg-turbo

  • High priority for integrated libjpeg-turbo

MP3

  • Well optimized for ARM.

SILK

  • Need optimized for ARM neon, low priority

Speex

  • Need optimized for ARM neon, low priority

x264

  • Most of the vendors use hardware to accelerate. SW encoder will be optimized with neon.

VC1

  • Most of the vendors use hardware to accelerate.

WMA

  • Specific licensing needed

Test Framework/Testcases

Test Content

  • Will be hosted in public place, can be accessed by all working group and partner vendors.
  • Used for case of optimized codec benchmark, conformance test for encoder, demo application.

Supported format matrix

Hosting location

  • To be defined

WorkingGroups/Middleware/Multimedia/Specs/1111/CodecOptimization (last modified 2011-07-07 12:45:50)