Python Script for Automated Web Scraping

Collecting data from the web manually is impossible at scale. This prompt generates a BeautifulSoup or Selenium script to extract data ethically and efficiently.

The Core Prompt

Write a Python script using BeautifulSoup to scrape the titles and prices of books from "example.com/books". Include a "User-Agent" header to prevent being blocked and save the data to a CSV file.

Ethics & Safety

Including a "User-Agent" and a "Rate Limit" (time.sleep) is standard practice to ensure you aren't accidentally performing a DDoS attack on the site.

Usage Tips

• Pagination: Ask the AI to "handle multiple pages by looking for the Next button."
• Error Handling: Add "try-except blocks to handle missing data or 404 errors."

Example AI Output

import requests from bs4 import BeautifulSoup ... headers = {'User-Agent': '...'}