3D object rendering in openCV using metaio in Android

3d, android, augmented-reality, metaio, opencv

Solution

Start with the Hello world example by metaio: http://dev.metaio.com/sdk/tutorials/hello-world/ There you can see the example code how to e.g. render a figure on a marker

But metaio and OpenVC are not for the rendering part, well metaio a little bit more then OpenCV but they do the computer vision part of your application. To render something you have to write OpenGL code yourself, or you conect the tracking of metaio to some more complex rendering engine like jMonkey, libGDX etc.

Problem

I am developing an appication, wher I'm using opencv to detect shapes in a camera image and want to display 3D objects rendered by metaio on those shapes. How can this be achieved? I have tried custom rendering, but 'onNewCameraFrame' method is not being called. I have to convert each camera frame that we get in 'onNewCameraFrame()' method to Mat object for shape detection logic. But it's not being called. I have even added call to 'requestCameraImage()' method of metaio sdk.

Original source