ProxyCrawl Reviews

I have been using Crawlbase for a research project for about a year, and could not be happier. It is simple and reliable and saves me so much headache. When a website I rely on became unavailable, I reported it and they had it working again in less than 24 hours. The support team was responsive and clear. I would recommend Crawlbase to anyone who needs these kinds of services.

I've used Crawlbase's Crawling API mainly and have gone through their docs extensively.

There are 2 things that I've had great experience with, the first 1 is the simple/easier to follow docs and the 2nd one is the ease of plug and play API that has actually provided good quality data without failing.

One of the key use cases where I leveraged Crawlbase was to collect product pricing and availability data from various e-commerce platforms.

Experimented with a few before this one, but this baby is easier to use. I merely install the job and it is successfully running. The results are clean, and I barely had to tweak the finished product.

Okay, I'm impressed. I needed a way to scrape product availability data from five retail sites daily. This worked very well with JavaScript-heavy pages, auto-retried failed requests for me and allowed me to schedule crawls like clockwork. And no surcharge for mobile or residential IPs, which is a huge bonus. I personally really LOVED the webhook integration. The moment the crawl was finished, I had a clean data dump sent to my endpoint. That alone saved me hours. Hell, support even followed up to make sure I didn't have issues. That's rare. I still hang on to my little custom scripts for a couple of edge cases, but this displaced 90% of what I was running.

The learning curve proved unusually brief. I dragged over thousands of product reviews from different sources, and it all came over neat and clean.

I wanted a tool for extracting products form some investments sites! And they have anti bot measures! This platform did it so much better than the others I tired..! With the residential and mobile proxies- the number of blocks was way better. And the Captcha bypass was really impressive! I also liked that I was able to save the data right out of the box with their cloud storage API. Which meant I did not have any extra setup to do. The crawlers async queue is a nice one. It just keeps going on in the back ground and allows me to deal with other stuff and frankly for the price, I did not expect this kind of stability and scale!

Tested it out on a product search site. Quick, no blocks, and clean JSON out. All in all, super smooth experience.

Ok, I don't have time to babysit scraping jobs, so their background crawler is awesome. It's processing thousands of URLs as I work on other things. The proxy network helps keep things sailing' smooth too.

I tried this on a big directory with many nested links. All slid effortlessly, and I never had to manually throttle. Great job with the redirects, avoiding the duplicates, and all nerd things Definitely a keeper.