I've been struggling to implement a quad to quad system in my Android application. The aim is to let the user take a picture, add 4 cornerpoints and have that quad extracted from the image as a rectangle.
I had a look at this method and this question to use OpenCV for this. The resulting code is this:
public static Bitmap warp(Bitmap image, MyPoint p1, MyPoint p2, MyPoint p3, MyPoint p4) {
int resultWidth = 500;
int resultHeight = 500;
Mat inputMat = new Mat(image.getHeight(), image.getHeight(), CvType.CV_8UC4);
Utils.bitmapToMat(image, inputMat);
Mat outputMat = new Mat(resultWidth, resultHeight, CvType.CV_8UC4);
Point ocvPIn1 = new Point(p1.getX(), p1.getY());
Point ocvPIn2 = new Point(p2.getX(), p2.getY());
Point ocvPIn3 = new Point(p3.getX(), p3.getY());
Point ocvPIn4 = new Point(p4.getX(), p4.getY());
List<Point> source = new ArrayList<Point>();
source.add(ocvPIn1);
source.add(ocvPIn2);
source.add(ocvPIn3);
source.add(ocvPIn4);
Mat startM = Converters.vector_Point2f_to_Mat(source);
Point ocvPOut1 = new Point(0, 0);
Point ocvPOut2 = new Point(0, resultHeight);
Point ocvPOut3 = new Point(resultWidth, resultHeight);
Point ocvPOut4 = new Point(resultWidth, 0);
List<Point> dest = new ArrayList<Point>();
dest.add(ocvPOut1);
dest.add(ocvPOut2);
dest.add(ocvPOut3);
dest.add(ocvPOut4);
Mat endM = Converters.vector_Point2f_to_Mat(dest);
Mat perspectiveTransform = new Mat(3, 3, CvType.CV_32FC1);
Core.perspectiveTransform(startM, endM, perspectiveTransform);
Imgproc.warpPerspective(inputMat,
outputMat,
perspectiveTransform,
new Size(resultWidth, resultHeight),
Imgproc.INTER_CUBIC);
Bitmap output = Bitmap.createBitmap(resultWidth, resultHeight, Bitmap.Config.RGB_565);
Utils.matToBitmap(outputMat, output);
return output;
}
While testing, I make sure the order of the corner points is top-left, bottom-left, bottom-right, top-right.
The strange thing is that the result isn't always the same. Most of the times it shows a square of a single color, sometimes a black square, sometimes a diagonal line with different colors in it. Even experimenting with startM = endM
results in non-deterministic behaviour.
What am I missing here?
Found it, the problem was in these lines:
Mat perspectiveTransform = new Mat(3, 3, CvType.CV_32FC1);
Core.perspectiveTransform(startM, endM, perspectiveTransform);
Which should be replaced by this:
Mat perspectiveTransform = Imgproc.getPerspectiveTransform(startM, endM);