I have been trying to use the Find Image and Click on Image to interact with and find elements in a remote desktop interface in development of a POC bot for a client.
I have gotten nothing but inaccuracy from these functions, regardless of the target or settings.
Take this page -
Looking for this item -
At 99% accuracy the bot found this location on the page (the red mark) -
Take this snippet of a larger window of the virtual desktop application -
The red marks correspond to the attempts by the bot to click on this button at 99% and 99.5% accuracy (lower or higher accuracy values were either wildly inaccurate or not found, respectively) -
The green mark corresponds to the attempt by the bot to click this button at 99.5% accuracy (lower or higher accuracy values were either wildly inaccurate or not found, respectively) -
Clearly the function is not working as required and I would like to know if there is anything I can do to improve my results, as the success of this bot requires these functions.