Tutorials and guides

Discover step-by-step instructions, practical tips, and best practices for extracting data, building scrapers, and overcoming common challenges in your scraping projects.

All Basics Business E-commerce NodeJS Python Real Estate SEO Tools Tools and Libraries Tutorials and guides Use Cases

May 19, 2025

Best Ways to Find All URLs on Any Website

Find all URLs on a domain by using a site crawler, parsing the sitemap file, exploring robots.txt, applying search engine queries with operators, or writing a custom scraping script.

Tutorials and guides Python Use Cases

May 7, 2025

How to Scrape a Website that Requires Login with Python

Learn how to handle login authentication in Python using various methods, from basic auth and API endpoints to CSRF tokens, WAFs, reCAPTCHA, Scrapy, and cookie reuse.

Python Tutorials and guides Tools and Libraries

Apr 22, 2025

Web Scraping with Playwright and Python

Learn how to use Playwright with Python for web scraping. This guide covers setup, element selection, scraping text and images, handling pagination, taking screenshots, saving data, and more with clear examples.

Python Tools and Libraries Tutorials and guides

Mar 11, 2025

How to Scrape Google Flights

Learn how to scrape Google Flights data using HasData's API, with step-by-step examples for one-way, round-trip, and multi-passenger searches. Customize results with filters for price, airlines, layovers, baggage, and more.

Tutorials and guides Python

Feb 10, 2025

How To Retry Failed Python Requests

Learn how to implement retry mechanisms in Python Requests to handle timeout errors, HTTP status codes like 403, 429, 500, 502, 503, and 504, and avoid infinite loops with effective backoff strategies.

Python Tools and Libraries Tutorials and guides

Jan 6, 2025

How to Scrape Google Maps Reviews

Learn how to scrape Google Maps reviews effectively using Python, APIs, or no-code tools. Explore methods to extract reviews for specific places, multiple locations, and search results, with step-by-step guidance and tips.

Tutorials and guides Business Python

Oct 29, 2024

How to Scrape YouTube Data for Free: A Complete Guide

Learn effective methods for scraping YouTube data, including extracting video details, channel info, playlists, comments, and search results. Explore tools like YouTube Data API, yt-dlp, and Selenium for a step-by-step guide to accessing valuable YouTube insights.

Python Tutorials and guides Tools and Libraries

Oct 16, 2024

Scrape Etsy.com Product, Shop and Search Results Data

Learn how to scrape Etsy product, shop, and search results data with methods like Requests, BeautifulSoup, Selenium, and web scraping APIs. Explore strategies for data extraction and storage from Etsy's platform.

E-commerce Tutorials and guides Python

Aug 13, 2024

How to Scroll Page using Selenium in Python

Explore various techniques for scrolling pages using Selenium in Python. Learn about JavaScript Executor, Action Class, keyboard events, handling overflow elements, and tips for improving scrolling accuracy, managing pop-ups, and dealing with frames and nested elements.

Tools and Libraries Python Tutorials and guides

Oct 31, 2024

How to Select Elements By Text in XPath?

Discover basic and advanced XPath techniques for selecting web elements by text, including contains(), text(), regular expressions, and more.

Tutorials and guides Tools and Libraries

Apr 30, 2024

Web Crawling With Python

Discover how to build powerful Python web crawlers to extract data from the web at scale. This comprehensive guide covers everything from the basics of web crawling to advanced techniques for dealing with anti-bot measures.

Python Tutorials and guides

May 28, 2024

Best PHP Web Scraping Libraries

Looking for the best PHP web scraping libraries? We've compared 10 of the most popular libraries to help you choose the right one for your needs. Learn about the pros and cons of each library, and see examples of how they can be used.

Tools and Libraries Tutorials and guides

Apr 30, 2024

Web Scraping in R

Learn how to use the power of R programming language to scrape data from webpages automatically! In this article, we’ll discuss the basics of web scraping in R – ranging from setting up necessary packages and tools to structuring and cleaning scraped datasets.

Tools and Libraries Tutorials and guides