← All roles

Software Engineer, CUA Control

Simular· Engineering
Apply on company site
Singapore, Palo AltoFull-timePosted 6mo ago

About the role

Engineer to work on the control layer translating an AI model's intent into precise, reliable actions at the OS level across macOS, Windows, and Linux (mouse/keyboard input, UI element detection, window management, error recovery).

Responsibilities

  • Work on the low-level computer control stack: mouse/keyboard injection, screen capture, coordinate mapping, input simulation
  • Implement UI element detection using accessibility APIs (AXUIElement, UI Automation), DOM/a11y trees, and visual grounding
  • Help build the abstraction layer that lets our agent operate across OS platforms and application types
  • Tackle reliability problems: element targeting under UI changes, window occlusion, resolution scaling, cross-app focus management
  • Contribute to feedback loops: how does the agent know its action worked? How does it recover when something unexpected happens?
  • Work closely with the model and planning team on the interface between intent and execution

Qualifications

  • You've built OS-level input automation (CGEvent, SendInput, xdotool, or similar)
  • You understand accessibility frameworks - AXUIElement on macOS, UI Automation on Windows, AT-SPI on Linux
  • You've dealt with flaky element selectors, timing issues, resolution-dependent coordinates
  • You think carefully about reliability and edge cases
  • You've worked with tools like Playwright, Appium, PyAutoGUI, Hammerspoon, or similar

Skills

Required:OS-level input automationAccessibility frameworksUI element targeting and timing issuesCross-platform development
Nice to have:Automation/testing tools
Last updated Jul 29, 2026. Interested? Apply on the company site.

About Simular

The Autonomous Computer Company

Simular AI delivers open-source, intelligent AI agents powered by leading research to automate computer tasks, streamline workflows, and enhance productivity. Transform your digital experience today!

AI agentsautomationproductivityresearch
Company profileWebsite

More open roles at Simular