location_city Chicago schedule Mar 29th 11:35 AM - 12:15 PM CDT place Sauganash East

In this talk, Noemi will cover key concepts about crawlers - what they are, why and when we need them, types of crawlers, and their components. We will see a demo for creating and using crawlers with Selenium, and the pros and cons of doing so.


Outline/Structure of the Presentation

1. What is a crawler?

2. Why and when do we need one?

  • Discovery testing
  • Finding particular common issues
  • Generally in production or pre-prod (late)
  • Quick coverage

3. Types of crawlers:

  •  API vs. UI
  •  View-only vx. all across / tree crawler
  •  Exhaustive vs. smart

4. Components of a crawler / key concepts:

  •  View / node: how to tell you are in a different one
  • Arcs: how to navigate / not only clicks, staging, moving objects, not Dom...
  • Visited storage: not always needed
  • Heat map: by usage / by issues found / by novelty

5. Crawling with Selenium - examples

Learning Outcome

At the end of this presentation, attendees will have:

  1. Learned key concepts about crawlers
  2. Learned about different types of crawlers
  3. Gained an understanding of when to use each type of crawler
  4. Learned how to identify views and navigating in all types of apps.
  5. Watched how to create crawlers with Selenium.

Target Audience

Testers, Developers, Automation Engineers, SDETs, Testing Managers

schedule Submitted 7 months ago