Scrapy Reviews

Cracked Reviews

Scrapy mentions (95)

• Analyzing Svenskalag Data using DBT and DuckDB

  Using Scrapy I fetched the data needed (activities and attendance). Scrapy handled authentication using a form request in a very simple way:. - Source: dev.to / 16 days ago

• Scrapy Vs. Crawlee

  Scrapy is an open-source Python-based web scraping framework that extracts data from websites. With Scrapy, you create spiders, which are autonomous scripts to download and process web content. The limitation of Scrapy is that it does not work very well with JavaScript rendered websites, as it was designed for static HTML pages. We will do a comparison later in the article about this. - Source: dev.to / about 2 months ago

• What is SERP? Meaning, Use Cases and Approaches

  While there is no specific library for SERP, there are some web scraping libraries that can do the Google Search Page Ranking. One of them which is quite famous is Scrapy - It is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It offers rich developer community support and has been used by more than 50+ projects. - Source: dev.to / 7 months ago

• Creating an advanced search engine with PostgreSQL

  If you're looking for a turn-key solution, I'd have to dig a little. I generally write a scraper in python that dumps into a database or flat file (depending on number of records I'm hunting). Scraping is a separate subject, but once you write one you can generally reuse relevant portions for many others. If you can get adept at a scraping framework like Scrapy you can do it fairly quickly, but there aren't many... - Source: Hacker News / 12 months ago

• What do .NET devs use for web scraping these days?

  I know this might not be a good answer, as it's not .NET, but we use https://scrapy.org/ (Python). Source: about 1 year ago

Cracked mentions (84)

• If a kid being sent to one of those "kidnap you in the night" bootcamps kills someone during the kidnap, is it self defense?

  Yes. There are a lot of them, and they are popular in Utah, and the Dominican Republic. Its for parents who think their kids is out of control because they take drugs, or hang around the wrong people, or don't want to go to church, or date the wrong person, or aren't getting good enough grades, or are manifesting behaviour because of trauma, or come out as gay (this is a common one, they are usually religious... Source: 7 months ago

• I need a game where you can commit financial fraud.

  Can I interest you in Eve Online? That link takes you to a cracked.com article about how one guy scammed folks out of millions of dollars. Source: 10 months ago

• People hate guns until they find themselves in a situation where they needed one.

  I really had no idea how bad the suicide stat was until cracked.com brought it up years ago (when it was good). It was somethign like nearly half or more gun deaths were straight suicides. Source: about 1 year ago

• Does anyone else feel a lot younger than their peers?

  Like why would I want to watch Breaking Bad or any serious drama when I already lived serious drama all through childhood? Jokes and silliness or I turn it off. Firefly or House MD are about my limit for serious entertainment. And my favorite news channel is one of those old cracked.com comedy writers on YouTube. Source: about 1 year ago

• Did you think you could have survived if project zomboid was real?

  The rotting thing is a point ignored by almost all zombie medium. Of course, getting around the initial "dead thing can walk" is a pretty big leap in itself. There's a hilarious article (or there used to be at least) on cracked.com named something like "10 Reasons a Zombie Apocalypse Would Fail (quickly)" and rotting was reason #1 or 2. Best line from the whole article though was "We (humans) are a zombie's... Source: about 1 year ago