Scraping Fish Reviews and details

Social recommendations and mentions

• Self-hosted, simple web browser service – send URL, get screenshots

  Happy to suggest another web scraping API alternative I rely on: https://scrapingfish.com. - Source: Hacker News / 3 months ago

• Can confirm Indeed is selling user information

  > What is a good way to web scrap [sic] them Maybe using Scraping Fish [0]? Per [1], "They [scrapingfish.com] seem to handle all the more annoying parts of web scraping: bypassing anti scraping things such as rate limits and captchas." [0] https://scrapingfish.com/. - Source: Hacker News / 12 months ago

• SaaS Subscription or Usage-Based Pricing?

  At https://scrapingfish.com/ we have both options, usage based https://scrapingfish.com/buy and subscriptions (monthly unlimited requests plan) https://scrapingfish.com/unlimited. Despite subscriptions being cheaper option per request, usage based is way more popular. Only less than 10% of our users have subscribed to unlimited monthly plan. I guess usage based plans give users more control over how much they... - Source: Hacker News / about 1 year ago

• What is the most useful project you've ever worked on?

  I’m still working on a web scraping API (https://scrapingfish.com/). For some people it’s evil bot but for others it’s enabler for public data access. I thinks it’s useful. - Source: Hacker News / about 1 year ago

• Ask HN: How much to charge for an API call?

  To give you a reference point, at https://scrapingfish.com/ we charge $0.002 per API call but in our case, the API call gives you the value by itself: access to mobile proxies and cluster of browsers. For you, I would recommend to either give the API access for free as I assume users already pay for the product. Another option would be to include API access only to higher plan users who pay more and this could be... - Source: Hacker News / about 1 year ago

• Web Scraping in Python – The Complete Guide

  I'm using Scraping Fish because of their pay-as-you-go style pricing as opposed to subscription with monthly scraping volume commitment. And they don't charge extra credits for JS rendering or residential proxies because the cost of each request is the same: https://scrapingfish.com. - Source: Hacker News / about 1 year ago

• Ask HN: What apps have you created for your own use?

  I've created a mobile proxy pool for a personal project of web scraping real estate data: https://scrapingfish.com/blog/byo-mobile-proxy-for-web-scraping Then, I expanded the infrastructure and built a web scraping API on top of it: https://scrapingfish.com. - Source: Hacker News / over 1 year ago

• Email Obfuscation Rendered Almost Ineffective Against ChatGPT

  0.2 cents is how much a single request costs for well-protect website where web scrapers look for emails (e.g. LinkedIn): https://scrapingfish.com/#pricing Paying additional 0.2 cents per request, if it can significantly improve your success rate, is not really that much and some people use LLMs for even simpler parsing tasks to save time on development efforts. - Source: Hacker News / over 1 year ago

• Show HN: I built a dataset of 25k+ Gumroad products to spot market opportunities

  I'm curious too since I'm developing a web scraping API product (https://scrapingfish.com). - Source: Hacker News / over 1 year ago

• Real challenge for web scrapers- Need Help!

  Just tried with https://scrapingfish.com/ and it worked using JavaScript rendering. The best thing is you don’t pay extra credits for JS rendering. Disclaimer: I am a co-founder of Scraping Fish. Source: almost 2 years ago

• Ticketmaster event scraping

  What is the best way to scrape ticketmaster events? I have tried apify and ScrapingFish residential ips and both of them are blocked, apify 100% of my requests fail and on scrapingfish, only 1 out of every 300-ish requests succeed. Any ideas, esp on where I could get better residential IPs or how I can get around the blocking. Source: almost 2 years ago

• Cheapest way to scrape google search results?

  If you are willing to just get the SERPs I believe our solution is cheap. https://scrapingfish.com. You would get just the html though, not a preprocessed JSON. Feel free to DM me if you’ve got any questions. Source: about 2 years ago

• Proxy needed!

  For Google https://scrapingfish.com/ will work very well. Source: about 2 years ago

• Ask HN: Side project of more that $2k monthly revenue what's your project?

  For https://scrapingfish.com/ it took us about 5-6 months from idea to $2k/month. It’s still not our main source of income. It was fun to build especially that it involved working with hardware. - Source: Hacker News / about 2 years ago

• Help with finding proxy provider

  Https://scrapingfish.com/ seems pretty good. Source: about 2 years ago

• Long-polling, API

  Not really, polling is the only option for you. You can add more delay between requests. Test if you get banned if you make one request every 5 minutes instead of 6 seconds. If you’re use case requires checking for new data every few seconds, you can use proxy or some kind of service which does ip rotation for you, like https://scrapingfish.com/. Source: about 2 years ago

• Experimental library for scraping websites using OpenAI's GPT API

  I don’t see how any LLM would help me with a high quality proxy, which is what I actually need in web scraping and I’m using https://scrapingfish.com/ for this. - Source: Hacker News / about 2 years ago

• How to scrape Walmart?

  You could use our Scraping Fish API (https://scrapingfish.com) or one of the other web scraping APIs or good proxies. Otherwise, they most likely will block you eventually. Plain user agents shuffling is unlikely to suffice. Source: about 2 years ago

• Those making $500/month on side projects in 2023 – Show and tell

  Scraping Fish - a web scraping API powered by custom-build, ethical, mobile proxy pool: https://scrapingfish.com/. - Source: Hacker News / over 2 years ago

• Ask HN: How to come up with ideas for micro side projects?

  Here is my story, which may provide some inspiration. My co-founder was searching for an apartment to purchase and found that all the tools he was using had weaknesses and none of them met his needs. We decided to create an aggregator for real estate offers. Initially, we intended to target users looking to buy an apartment, but we later pivoted to focus on real estate agencies and added features around this.... - Source: Hacker News / over 2 years ago

• Do You Have Suggestions About Call-To-Action?

  Some time ago I used https://marketingexamples.com to help me design landing page for [Scraping Fish](https://scrapingfish.com) and it also covers CTA to some extent:. Source: over 2 years ago