Show overlay control and page html

[thephiloospher]

Hi Martin,

I have a question:
there is a way to find a point in a html page with "Show overlay control"?

[Martin]

Hi,

You mean in action Control UI? There's no way to do this to my knowledge since Automagic does not know the structure of the currently displayed html page.
You could try to move the input focus within the page using one or multiple actions Execute Root Command: input keyevent DPAD_DOWN.

Regards,
Martin

[thephiloospher]

Ok thanks Martin.
I solved it but took me a lot to determine the coordinates (X, Y).
Excuse my English, I try to explain.

I have a suggestion: create a grid (if possible with adjustable opacity):

Level 1 (top): the grid
Level 2: browser (or another app)

When do I determine a point in the html page (buttons, text input, etc..) active browser, active the grid (tranparent) and active "Show overlay control" in the Control UI.
I click on the grid, the corresponding point that interests me and "Show overlay control" returns the coordinates (X and Y).

Do you think it will be useful to many people?
And 'possible?

(Automagic is wonderful, I spend hours to create each type of flow!! )

[Martin]

That would be a great feature, unfortunately this is technically not possible to my knowledge since Automagic can not click on a real coordinate with action Control UI. Automagic can only use the coordinate in action Control UI to find an element and then click on this element. Unfortunately the browser component containing the page looks to Automagic like one big element and Automagic has no way to access the structure/elements within the html page.
With a rooted device you could achieve something like this using Execute Root Command: input tap x y. To find the coordinates you can enable Pointer location in the developer settings of Android.

[thephiloospher]

My Android is rooted and I used to own Root Execute Command: input xy tap into my flow. And it works!

I try to enable Pointer location in the settings of the Android developer to determine the coordinates in the next flows.

Thanks for the suggestion.