Is there a right way to programmatically prevent a brief wrong recognition (in object detection app) to trigger an action?

Context

I'm building an app which performs real-time object detection throught the camera module of the device. The render is like the image below.

Let's say I try to recognize an apple, most of the time the app will recognize an apple. However, sometimes, the app will recognize the wrong fruit (let's say a lemon) on a few camera frames.

Goal

As the recognition of a fruit triggers an action in my code, my goal is to programmatically prevent a brief wrong recognition to trigger an action, and only take into account the majority result.

What I've tried

I tried this way : if the same fruit is recognized several frames in a row, I assumed the result is supposed to be the right one. But as my device process image recognition several times per second, even a wrong guess can be recognized several times in a row, and leads to the wrong action.

Question

Is there any known techniques for avoiding this behavior ?

from Is there a right way to programmatically prevent a brief wrong recognition (in object detection app) to trigger an action?