BatchURLScraper

There are various reasons why someone would want to extract data from a website. SEO-related purposes, targeted marketing via email, competition watching, web and data mining or monitoring websites for changes are amongst the most common. But dedicated tools are required to pull data from the web and, while the Internet offers a variety of online data extraction platforms, some users might still prefer going for a standard desktop application. If that is also your case, then you can try BatchURLScraper.

As its name implies, BatchURLScraper is a web crawler that supports batch operations, meaning it can process multiple websites in one go. It provides a simple and fast method to gather all kinds of data from selected URLs and save the output locally.

The application relies on various extraction methods to parse the content of a website, namely Regex , XQuery, CSSPath and XPath. It is compatible with various user agents, as provided by popular search engines and web browsers.

With the help of BatchURLScraper, you can easily extract data from several web pages at once, following a few pre-configured rules. It comes with a set of rules for the most common data types, namely email addresses, prices, or reviews, which allows you to understand how everything works and configure your own rules.

Each rule can be tested to see if it works as it should by sending an individual query to a target page. The rule tester previews the HTML code of the source page and applies the rule to display the extracted data.

BatchURLScraper features a multithreading crawling engine, which allows it to carry out its tasks at high speed. It can extract various pieces of information from a list of websites without a lot of hassle and export the results to CSV format.