Getting Structured Data from the Internet Running Web CrawlersScrapers on a Big Data Production Scale

[bookworm79 0]

Free Download Jay M. Patel, "Getting Structured Data from the Internet: Running Web Crawlers/Scrapers on a Big Data Production Scale"
English | ISBN: 1484265750 | 2020 | 420 pages | AZW3 | 8 MB
Utilize web scraping at scale to quickly get unlimited amounts of free data available on the web into a structured format. This book teaches you to use Python scripts to crawl through websites at scale and scrape data from HTML and JavaScript-enabled pages and convert it into structured data formats such as CSV, Excel, JSON, or load it into a SQL database of your choice.

This book goes beyond the basics of web scraping and covers advanced topics such as natural language processing (NLP) and text analytics to extract names of people, places, email addresses, contact details, etc., from a page at production scale using distributed big data techniques on an Amazon Web Services (AWS)-based cloud infrastructure. It book covers developing a robust data processing and ingestion pipeline on the Common Crawl corpus, containing petabytes of data publicly available and a web crawl data set available on AWS's registry of open data.
Read more

Ukryta Zawartość

Treść widoczna tylko dla użytkowników forum DarkSiders. Zaloguj się lub załóż darmowe konto na forum aby uzyskać dostęp bez limitów.

Links are Interchangeable - Single Extraction