Web Skills

# Web Scraping Skill Extract structured data from websites using Python. Use the helper script or write custom code. Scraping runs in the sandbox: fetch and parse with `execute_shell`, using the helper script below or your own Python when a page needs custom handling. Write results under `~/out/` so they sync back as artifacts. ## Using the Helper Script ```bash # Scrape a single page and extract all links python ~/skills/web-scraping/scraper.py https://example.com --links # Extract text content python ~/skills/web-scraping/scraper.py https://example.com --text # Extract data using CSS selectors python ~/skills/web-scraping/scraper.py https://example.com --selector "h1,h2,h3" --output ~/out/headings.json # Extract table data to CSV python ~/skills/web-scraping/scraper.py https://example.com --tables --output ~/out/tables.csv # Full page analysis python ~/skills/web-scraping/scraper.py https://example.com --analyze ``` ## Custom Scraping Code ### Basic Page Fetching ```pytho...