What is Web Scraping?
Web scraping is the automated collection of data from websites or online services, often by software that extracts text, images, metadata, or other content at scale. In AI compliance, it is significant because scraped data can raise issues under privacy, copyright, contract, security, and terms-of-service rules, especially when used for model training or profiling.
In Depth
In practice, web scraping may be used to build training datasets, monitor competitors, populate databases, or extract public content for analysis. Compliance teams need to know what sources were scraped, whether access controls or robots exclusions were bypassed, whether personal data or protected content was collected, and whether retention, security, and downstream use are legally justified.
The compliance relevance varies by jurisdiction and use case. Under GDPR and related data protection laws, scraping can trigger obligations around lawful basis, transparency, data minimisation, and data subject rights when personal data is involved; copyright and database-right rules may also apply in the EU and UK; and contractual restrictions or anti-bot controls may create additional legal and operational risk. For AI programs, web scraping is often linked to training-data governance, provenance documentation, and model risk reviews under frameworks such as the EU AI Act, ISO/IEC 42001, NIST AI RMF, and privacy guidance tied to AI development.
Related Frameworks
Related Topics
Related Terms
Weekly digest — coming soon
Leave your email to get the first issue when it ships. Free, no account required.
We use your email only for the digest. Privacy policy