Testing with Real Robots over the Internet: What Could Go Wrong?

location_city Chicago schedule Mar 30th 11:30 AM - 12:10 PM CDT place Sauganash East

When I started the Selenium project, I'd frequently describe Selenium as "like a robot" that is trapped inside your computer. For the past 11+ years, I've been testing that metaphor by building real mechanical robots for testing apps and devices, pushing the definition of "end" in end-to-end testing. Lately, I've been remotely controlling these robot over the internet, and learned some lessons I'd like to share. In this talk, I'll compare and contrast how testing with a physical robot over the internet is different than traditional testing approaches with Selenium or Appium.


Outline/Structure of the Deep Dive Session

  • Overview of telerobotics and telepresence
  • Why test with physical robots vs traditional approaches
  • How testing with physical robots is different
    • Motors
    • Sensors
    • Cameras
    • Object locator strategies:
      • "Traditional" approaches with OpenCV
      • "AI" approaches with machine learning
  • Challenges of testing with robots
    • Lighting
    • Latency
    • Mechanical wear and tear
    • Skills required
    • "Does it scale?"
  • Future work

Learning Outcome

Understanding of the costs, benefits, challenges, and opportunities of testing with robots.

Target Audience


Prerequisites for Attendees

Attendees should have a general interest in mobile testing and robots.

schedule Submitted 7 months ago