Mouse and Keyboard

Mouse and keyboard building blocks can move the mouse pointer, click, scroll and type text. They are among the most used building blocks because they combine LEAPTEST’s image and text recognition abilities with user interface control.

Clicking

The Click image and Click text blocks are used to find an image or text on screen, move the mouse pointer and click where it is found. Click position is used to click in a specific position on screen.

Hovering

The Hover image, Hover text and Hover position blocks are similar, but hover the mouse pointer without clicking.

Scrolling and dragging

The Scroll wheel block is used to perform an explicit mouse scroll at a specific postion on screen, while the Drag mouse block is used to drag (and optionally drop) using the mouse pointer.

Typing on the keyboard

The Type text block is used to type text using the keyboard.

Press and hold key(s)

The Press Key and Release Key blocks are used to keep keys pressed while performing other actions, e.g. dragging with the mouse.

Author: Claus Topholt, June 6, 2016.