Blog
Discover the latest insights, tips, and strategies for web scraping and data extraction. Our blog covers everything from practical tutorials and best practices in web scraping to advanced use cases, industry trends, and no-code tools that simplify data collection.
Aug 16, 2022
Web Scraping with XPath in Selenium
Using XPath in Selenium for scraping helps to parse dynamic elements and to find element at any level of DOM structure.
- Basics
- Python
Aug 2, 2022
Web Scraping with C#
The advantage of C# programming language in web scraping is that it allows to integrate the browser directly into forms using the C# WebBrowser. The scraped data can be saved to any output file, or displayed on the screen.
- Tools and Libraries
Jul 26, 2022
Web Scraping Without Getting Blocked
To reduce the number of bots using the site, developers use IP address recognition, HTTP request headers checking, CAPTCHA, and other methods to detect bot traffic. However, it is still possible to bypass. To do this, you need to follow some rules during scraping.
- Basics
Jul 18, 2022
The Best Programming Languages for Web Scraping
There are ten programming languages which are used for web scraping: Python, Ruby, Node.JS, GoLang, Perl, PHP, C#, C&C++, Java and Rust. The choice of a suitable language depends on its capabilities, convenience and the tools it provides.
- Basics
- Tools and Libraries
Jul 11, 2022
How to Use Web Scraping in E-Commerce for Strategic Marketing & Advertising Decisions
As a data extraction method, web scraping allows companies to track competitors' activities, automate workflows, optimize existing products and launch new ones based on consumer behavior and requirements.
- E-commerce
- Use Cases
- Basics
Jul 4, 2022
Get Mobile App Source Code Encrypted by IBM MobileFirst
There are applications encrypted on IBM MobileFirst. But there is a way to get application source code without decrypting data.
- Tools and Libraries
- Use Cases
Jun 29, 2022
Web Scraping with Node.js: How to Leverage the Power of JavaScript
NodeJS is a JavaScript runtime environment built on top of the V8 JS engine developed by Google. But above all, Node.js is a platform for building web applications. Like JavaScript, it is ideal for solving web tasks.
- NodeJS
- Tools and Libraries
Jun 24, 2022
A Comprehensive Guide to Web Scraping with Selenium WebDriver in Python
Unlike other libraries, Selenium uses a Google Chrome WebDriver (whether in active or headless)mode for scraping, which makes the process more like manual data collection.
- Tools and Libraries
- Python
Jun 22, 2022
How to Use cURL in Python
cURL is a handy query utility that supports most transfer protocols. The LibcURL API was created for its use in one's own programs. And for use in Python was created a thin wrapper above libcURL which is called PycURL.
- Python
- Tools and Libraries
Jun 16, 2022
Web Scraping with Python: from Fundamentals to Practice
Web scraping with Python is a great way to gather data from the internet. It is a powerful, easy-to-learn programming language that makes web scraping more straightforward than other methods.
- Python
- Tools and Libraries
Jun 13, 2022
5 Chrome DevTools Tips & Tricks for Scraping
DevTools is a set of developer utilities that are built into the browser and make one's work more comfortable. This article will describe 5 tips & tricks for Chrome DevTools that we use for scraping and developing frontend or backend applications.
- Basics
- Tools and Libraries
Jun 10, 2022
The Ultimate CSS Selectors Cheat Sheet for Web Scraping
Each site has its own structure, which contains elements of the same type. For their web scraping, CSS selectors are useful. They are used for selecting elements of the same type on all pages of the website.
- Basics
Jun 8, 2022
Web Scraping for Real Estate Data: Complete Guide
Real estate web scraping is the collection of real estate and consumer data from web pages to identify vacant properties, analyze consumer needs, investment opportunities, and price optimization.
- Basics
- Real Estate
- Use Cases
Jun 2, 2022
The 7 Best Free Proxies for Web Scraping
You can't do web scraping without proxies on a large scale. And the main reason is that you won't get through the restrictions on multiple requests to a site from a single IP address without a proxy.
- Basics
May 26, 2022
How to Scrape Yelp Using Node.js
We’ve prepared a tutorial in which we will make a Yelp scraper that can take a link to a business directory, go to each business page, and collect needed information.
- Use Cases
- Business
- NodeJS