Alexander Chapman
Full Stack Engineer
Description
Become a key part of an innovative AI startup creating the first comprehensive testing platform for web agents. Help transform how teams assess and optimize web agents within dynamic, real-world settings. This is a foundational engineering position where you'll have a hand in defining how they crawl, organize, and analyze data from the open web at scale.
Your Responsibilities:
- Build large-scale, distributed crawlers to handle millions of domains.
- Develop systems to manage dynamic content, AJAX-driven websites, and DOM changes.
- Overcome anti-bot challenges at scale, including captchas and proxy handling.
- Clean and structure data for AI model training and testing.
What They?re Seeking:
- Expertise in web scraping and crawling tools (Selenium, Puppeteer, Playwright, Scrapy).
- In-depth understanding of anti-bot techniques (TLS fingerprinting, HTTP headers, bot-like behavior).
- Hands-on experience with proxy management and performance-optimized scraping solutions.
- Strong skills in Python, Go, or TypeScript.
- Familiarity with HTTP/2, WebSockets, and browser fingerprinting techniques.
- Join them and help shape the future of web agent testing!
