Huge slowup using openCV matchTemplate on android
I'm making small project with tracking Mat pattern on Android camera frames by using openCV's _matchTemplate_ method.
However, by the time my code reaches _matchTemplate_ and _minMaxLoc_, framerate drops to ~1 per 10 seconds on my phone, yet in Android Profiler, memory and CPU usage are as flat as my grandma's ECG.
I assumed it could be caused by script waiting to find matches, but I tried it on series of pictures on my PC and it took less than second to go through over 200 pictures (even without match it would simply point to top left corner, no hickups there).
Here is code for my tracking method:
public Mat simpleTrack(Mat input, boolean showCrosshair, boolean showTracker)
{
if (firstRun)
{
crosshairDimensions(input);
firstRun = false;
}
if (showCrosshair)
{
Imgproc.rectangle(input, new Point(rowstart, colstart), new Point(rowend, colend), new Scalar(255, 0, 0), 3);
}
else if (showTracker)
{
if (getTemplate)
{
template = input.submat(rowstart, rowend, colstart, colend);
getTemplate = false;
}
Imgproc.matchTemplate(input, template, mRgbaM, Imgproc.TM_CCOEFF_NORMED);
Point top_left = Core.minMaxLoc(mRgbaM).maxLoc;
Point bottom_right = new Point(top_left.x + framewidth, top_left.y + frameheight);
Imgproc.rectangle(input, top_left, bottom_right, new Scalar(0, 255, 0), 3);
}
//call Garbage Collector every n'th cycle iteration
if (iteration % cycle == 0)
{
System.gc();
}
iteration++;
return input;
}
java opencv
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
add a comment |
I'm making small project with tracking Mat pattern on Android camera frames by using openCV's _matchTemplate_ method.
However, by the time my code reaches _matchTemplate_ and _minMaxLoc_, framerate drops to ~1 per 10 seconds on my phone, yet in Android Profiler, memory and CPU usage are as flat as my grandma's ECG.
I assumed it could be caused by script waiting to find matches, but I tried it on series of pictures on my PC and it took less than second to go through over 200 pictures (even without match it would simply point to top left corner, no hickups there).
Here is code for my tracking method:
public Mat simpleTrack(Mat input, boolean showCrosshair, boolean showTracker)
{
if (firstRun)
{
crosshairDimensions(input);
firstRun = false;
}
if (showCrosshair)
{
Imgproc.rectangle(input, new Point(rowstart, colstart), new Point(rowend, colend), new Scalar(255, 0, 0), 3);
}
else if (showTracker)
{
if (getTemplate)
{
template = input.submat(rowstart, rowend, colstart, colend);
getTemplate = false;
}
Imgproc.matchTemplate(input, template, mRgbaM, Imgproc.TM_CCOEFF_NORMED);
Point top_left = Core.minMaxLoc(mRgbaM).maxLoc;
Point bottom_right = new Point(top_left.x + framewidth, top_left.y + frameheight);
Imgproc.rectangle(input, top_left, bottom_right, new Scalar(0, 255, 0), 3);
}
//call Garbage Collector every n'th cycle iteration
if (iteration % cycle == 0)
{
System.gc();
}
iteration++;
return input;
}
java opencv
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
add a comment |
I'm making small project with tracking Mat pattern on Android camera frames by using openCV's _matchTemplate_ method.
However, by the time my code reaches _matchTemplate_ and _minMaxLoc_, framerate drops to ~1 per 10 seconds on my phone, yet in Android Profiler, memory and CPU usage are as flat as my grandma's ECG.
I assumed it could be caused by script waiting to find matches, but I tried it on series of pictures on my PC and it took less than second to go through over 200 pictures (even without match it would simply point to top left corner, no hickups there).
Here is code for my tracking method:
public Mat simpleTrack(Mat input, boolean showCrosshair, boolean showTracker)
{
if (firstRun)
{
crosshairDimensions(input);
firstRun = false;
}
if (showCrosshair)
{
Imgproc.rectangle(input, new Point(rowstart, colstart), new Point(rowend, colend), new Scalar(255, 0, 0), 3);
}
else if (showTracker)
{
if (getTemplate)
{
template = input.submat(rowstart, rowend, colstart, colend);
getTemplate = false;
}
Imgproc.matchTemplate(input, template, mRgbaM, Imgproc.TM_CCOEFF_NORMED);
Point top_left = Core.minMaxLoc(mRgbaM).maxLoc;
Point bottom_right = new Point(top_left.x + framewidth, top_left.y + frameheight);
Imgproc.rectangle(input, top_left, bottom_right, new Scalar(0, 255, 0), 3);
}
//call Garbage Collector every n'th cycle iteration
if (iteration % cycle == 0)
{
System.gc();
}
iteration++;
return input;
}
java opencv
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
I'm making small project with tracking Mat pattern on Android camera frames by using openCV's _matchTemplate_ method.
However, by the time my code reaches _matchTemplate_ and _minMaxLoc_, framerate drops to ~1 per 10 seconds on my phone, yet in Android Profiler, memory and CPU usage are as flat as my grandma's ECG.
I assumed it could be caused by script waiting to find matches, but I tried it on series of pictures on my PC and it took less than second to go through over 200 pictures (even without match it would simply point to top left corner, no hickups there).
Here is code for my tracking method:
public Mat simpleTrack(Mat input, boolean showCrosshair, boolean showTracker)
{
if (firstRun)
{
crosshairDimensions(input);
firstRun = false;
}
if (showCrosshair)
{
Imgproc.rectangle(input, new Point(rowstart, colstart), new Point(rowend, colend), new Scalar(255, 0, 0), 3);
}
else if (showTracker)
{
if (getTemplate)
{
template = input.submat(rowstart, rowend, colstart, colend);
getTemplate = false;
}
Imgproc.matchTemplate(input, template, mRgbaM, Imgproc.TM_CCOEFF_NORMED);
Point top_left = Core.minMaxLoc(mRgbaM).maxLoc;
Point bottom_right = new Point(top_left.x + framewidth, top_left.y + frameheight);
Imgproc.rectangle(input, top_left, bottom_right, new Scalar(0, 255, 0), 3);
}
//call Garbage Collector every n'th cycle iteration
if (iteration % cycle == 0)
{
System.gc();
}
iteration++;
return input;
}
java opencv
java opencv
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
edited Oct 15 '18 at 2:02
Rodrigo Rodrigues
3,0871721
3,0871721
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
asked Oct 15 '18 at 1:46
Mateusz ŻetMateusz Żet
62
62
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Ok, so if anyone had similar problem, the problem was caused by low-end Android device provided - on newer device the code started gaining speed.
What improved my performance even more was changing input Mat from RGB to Grayscale (or using threshold filter, so that script won't choke on a file that is over 10MB). I have also reduced resolution from 4k to HD.
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f52808735%2fhuge-slowup-using-opencv-matchtemplate-on-android%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Ok, so if anyone had similar problem, the problem was caused by low-end Android device provided - on newer device the code started gaining speed.
What improved my performance even more was changing input Mat from RGB to Grayscale (or using threshold filter, so that script won't choke on a file that is over 10MB). I have also reduced resolution from 4k to HD.
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
add a comment |
Ok, so if anyone had similar problem, the problem was caused by low-end Android device provided - on newer device the code started gaining speed.
What improved my performance even more was changing input Mat from RGB to Grayscale (or using threshold filter, so that script won't choke on a file that is over 10MB). I have also reduced resolution from 4k to HD.
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
add a comment |
Ok, so if anyone had similar problem, the problem was caused by low-end Android device provided - on newer device the code started gaining speed.
What improved my performance even more was changing input Mat from RGB to Grayscale (or using threshold filter, so that script won't choke on a file that is over 10MB). I have also reduced resolution from 4k to HD.
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
Ok, so if anyone had similar problem, the problem was caused by low-end Android device provided - on newer device the code started gaining speed.
What improved my performance even more was changing input Mat from RGB to Grayscale (or using threshold filter, so that script won't choke on a file that is over 10MB). I have also reduced resolution from 4k to HD.
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
answered Nov 14 '18 at 0:33
Mateusz ŻetMateusz Żet
62
62
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f52808735%2fhuge-slowup-using-opencv-matchtemplate-on-android%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
