Audit websites for SEO issues with a browsing agent
An open-source agent visits each URL in a real Chromium browser, extracts SEO tags, checks broken links, pauses for human login input, and writes a summary report. Task: The workflow uses a Python tool with Browser Use and Claude API to audit URLs listed in input.csv. It opens pages in a visible Chromium window, extracts SEO tags (title, description, H1, canonical), and checks same-domain links via httpx. The agent pauses for human intervention on 404s, login walls, or redirects, then writes results to report.json and a plain-English summary.; tools: Claude. Human role: Source evidence is unavailable for specific human roles beyond the described pause for login input.; limitations: The browser runs visibly, making it unsuitable for server-side CI. A 20-URL audit costs ~$0.12 with Sonnet, reducible via --tiered flag. It requires manual handling of login prompts and edge cases. Broken link checks are limited to same-domain links by default..
Tools
Published on Agent Work Atlas:
Overview
An open-source agent visits each URL in a real Chromium browser, extracts SEO tags, checks broken links, pauses for human login input, and writes a summary report.
Workflow
The workflow uses a Python tool with Browser Use and Claude API to audit URLs listed in input.csv. It opens pages in a visible Chromium window, extracts SEO tags (title, description, H1, canonical), and checks same-domain links via httpx. The agent pauses for human intervention on 404s, login walls, or redirects, then writes results to report.json and a plain-English summary.
Reported result
The tool generates PASS/FAIL statuses per URL. On the author's sites, it identified a title cannibalizing the homepage, a query at position 9.5 with 0% CTR, missing internal links, and an orphan page. No broader success metrics are provided beyond these specific findings.
Human role
Source evidence is unavailable for specific human roles beyond the described pause for login input.
Limitations
The browser runs visibly, making it unsuitable for server-side CI. A 20-URL audit costs ~$0.12 with Sonnet, reducible via --tiered flag. It requires manual handling of login prompts and edge cases. Broken link checks are limited to same-domain links by default.
Try it
I want to run a small SEO audit pilot. First, create an input.csv file with [replaceable: 5 specific URLs from my site]. Ensure I have ANTHROPIC_API_KEY set. Run the command: python main.py --tiered --auto. If the tool pauses for login or encounters a 404, I will manually intervene. After completion, review report-summary.txt for PASS/FAIL statuses. Verify that the tool correctly identified any missing meta descriptions or broken internal links. Do not proceed to full site audit until I confirm the pilot results are accurate.
Source reports are not independently verified. Publication date is the catalog publication date, not the original article date.