Appium along with Sikuli for Mobile App testing

Question

I was trying to use Sikuli for Image Identification along with Appium.

So, when I tried finding an image after launching app on device using Appium, but Sikuli returned an error saying, "cannot find img/x.png on the screen".

Note: I want the test to be run on real device and not emulator.

Answer 1

Sikuli is an automation tool designed for desktops. Not mobile. Sikuli automates anything you see on the desktop screen. It uses image recognition to identify and control GUI components. So All the images which you are trying to capture should be on the desktop screen. If you are using an real device I recommend you to use screen casting to mirror the device in to the desktop and run Sikuli commands.

Screen mirroring useful links:

http://www.droidscreencast.com/

https://www.ibm.com/developerworks/community/blogs/mobileblog/entry/mirroring_an_android_device_screen_onto_your_desktop?lang=en

Answer 2

Actually it is possible to use Sikuli for mobile too. With Appium. Here is example of how to do it. in this project is described the process how to setup and how to use this framework. Examples are attached.