Blog

Web Scraping with XPath in Selenium
Web Scraping with XPath in Selenium
Aug 16, 2022

Using XPath in Selenium for scraping helps to parse dynamic elements and to find element at any level of DOM structure.

Learn More
Web Scraping Using Scrapy Python
Web Scraping Using Scrapy Python
Aug 09, 2022

Scrapy is the most popular web scraping framework in Python. Unlike BeautifulSoup or Selenium, Scrapy is not a library. The big advantage is that the tool is completely free.

Learn More
Web Scraping with C#
Web Scraping with C#
Aug 02, 2022

The advantage of C# programming language in web scraping is that it allows to integrate the browser directly into forms using the C# WebBrowser. The scraped data can be saved to any output file, or displayed on the screen.

Learn More
Web Scraping Without Getting Blocked
Web Scraping Without Getting Blocked
Jul 26, 2022

To reduce the number of bots using the site, developers use IP address recognition, HTTP request headers checking, CAPTCHA, and other methods to detect bot traffic. However, these are still possible to bypass. To do this, you need to follow some rules during scraping.

Learn More
The Best Programming Languages for Web Scraping
The Best Programming Languages for Web Scraping
Jul 18, 2022

There are ten programming languages which are used for web scraping: Python, Ruby, Node.JS, GoLang, Perl, PHP, C#, C&C++, Java and Rust. The choice of a suitable language depends on its capabilities, convenience and the tools it provides.

Learn More
How to Use Web Scraping in E-Commerce for Strategic Marketing & Advertising Decisions
How to Use Web Scraping in E-Commerce for Strategic Marketing & Advertising Decisions
Jul 11, 2022

As a data extraction method, web scraping allows companies to track competitors' activities, automate workflows, optimize existing products and launch new ones based on consumer behavior and requirements.

Learn More
Get Mobile App Source Code Encrypted by IBM MobileFirst
Get Mobile App Source Code Encrypted by IBM MobileFirst
Jul 04, 2022

There are applications encrypted on IBM MobileFirst. But there is a way to get application source code without decrypting data.

Learn More
Web Scraping with Node.js: How to Leverage the Power of JavaScript
Web Scraping with Node.js: How to Leverage the Power of JavaScript
Jun 29, 2022

NodeJS is a JavaScript runtime environment built on top of the V8 JS engine developed by Google. But above all, Node.js is a platform for building web applications. Like JavaScript, it is ideal for solving web tasks.

Learn More
A Comprehensive Guide to Web Scraping with Selenium WebDriver in Python
A Comprehensive Guide to Web Scraping with Selenium WebDriver in Python
Jun 24, 2022

Unlike other libraries, Selenium uses a Google Chrome WebDriver (whether in active or headless)mode for scraping, which makes the process more like manual data collection.

Learn More
How to Use cURL in Python
How to Use cURL in Python
Jun 22, 2022

cURL is a handy query utility that supports most transfer protocols. The LibcURL API was created for its use in one's own programs. And for use in Python was created a thin wrapper above libcURL which is called PycURL.

Learn More
Web Scraping with Python: from Fundamentals to Practice
Web Scraping with Python: from Fundamentals to Practice
Jun 16, 2022

Web scraping with Python is a great way to gather data from the internet. It is a powerful, easy-to-learn programming language that makes web scraping more straightforward than other methods.

Learn More
5 Chrome DevTools Tips & Tricks for Scraping
5 Chrome DevTools Tips & Tricks for Scraping
Jun 13, 2022

DevTools is a set of developer utilities that are built into the browser and make one's work more comfortable. This article will describe 5 tips & tricks for Chrome DevTools that we use for scraping and developing frontend or backend applications.

Learn More
The Ultimate CSS Selectors Cheat Sheet for Web Scraping
The Ultimate CSS Selectors Cheat Sheet for Web Scraping
Jun 10, 2022

Each site has its own structure, which contains elements of the same type. For their web scraping, CSS selectors are useful. They are used for selecting elements of the same type on all pages of the website.

Learn More
Web Scraping for Real Estate Data: Complete Guide
Web Scraping for Real Estate Data: Complete Guide
Jun 08, 2022

Real estate web scraping is the collection of real estate and consumer data from web pages to identify vacant properties, analyze consumer needs, investment opportunities, and price optimization.

Learn More
The 7 Best Free Proxies for Web Scraping
The 7 Best Free Proxies for Web Scraping
Jun 02, 2022

You can't do web scraping without proxies on a large scale. And the main reason is that you won't get through the restrictions on multiple requests to a site from a single IP address without a proxy.

Learn More