A slot-style UI drawn entirely as pixels on a <canvas> — no DOM, no accessibility tree, exactly what the App Automate planner perceives on a WebGL game. Tap a control; the console reads back HIT/MISS against known geometry. Drive it by hand, with browser automation (clicks log to console as [canvas-poc]), or via window.canvasPoc.
A hit means the tap landed inside a control's known rect. Distance to the control centre (px, in the 360×720 canvas space) is logged so you can measure how far off a coordinate tap is.
canvasPoc.tapAt(190,646).| id | rect x,y,w,h | centre | feasibility case |
|---|
How the same frame reaches the planner. Today mobile is squeezed into a 1280×720 landscape box (letterboxed); the proposal uses a portrait box at the same pixel budget. Watch the SPIN glyph size.