Scrapy Reviews

Metriport Reviews

Scrapy mentions (95)

• Analyzing Svenskalag Data using DBT and DuckDB

  Using Scrapy I fetched the data needed (activities and attendance). Scrapy handled authentication using a form request in a very simple way:. - Source: dev.to / 19 days ago

• Scrapy Vs. Crawlee

  Scrapy is an open-source Python-based web scraping framework that extracts data from websites. With Scrapy, you create spiders, which are autonomous scripts to download and process web content. The limitation of Scrapy is that it does not work very well with JavaScript rendered websites, as it was designed for static HTML pages. We will do a comparison later in the article about this. - Source: dev.to / about 2 months ago

• What is SERP? Meaning, Use Cases and Approaches

  While there is no specific library for SERP, there are some web scraping libraries that can do the Google Search Page Ranking. One of them which is quite famous is Scrapy - It is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It offers rich developer community support and has been used by more than 50+ projects. - Source: dev.to / 7 months ago

• Creating an advanced search engine with PostgreSQL

  If you're looking for a turn-key solution, I'd have to dig a little. I generally write a scraper in python that dumps into a database or flat file (depending on number of records I'm hunting). Scraping is a separate subject, but once you write one you can generally reuse relevant portions for many others. If you can get adept at a scraping framework like Scrapy you can do it fairly quickly, but there aren't many... - Source: Hacker News / 12 months ago

• What do .NET devs use for web scraping these days?

  I know this might not be a good answer, as it's not .NET, but we use https://scrapy.org/ (Python). Source: about 1 year ago

Metriport mentions (24)

• Show HN: Metriport – open-source universal API for health data

  • Cronometer With these initial integrations, we plan to add many more to this list, including Garmin, Apple Health, and Google Fit in the near term. We work very closely with our customers, so if there’s an integration you need that’s not currently on roadmap, we’re more than happy to add it and build it into our API. Because we’re also open-source, developers can fork our code and build their own custom... - Source: Hacker News / over 1 year ago

• An update from the Metriport team

  As some of you may have already saw, over the summer we made the difficult decision to pivot our business, and go after a similar problem in the healthcare space, with the main goal to make healthcare data more accessible. For those interested in finding out more about this, you can check out this recent write up about us, or check out our newly revamped website. Source: over 1 year ago

• My friend and I made a tool for tracking things and we thought it could be useful to those of you looking to track your mushroom experiences to see how they correlate with other factors in your life. Let us know if you'd find this useful!

  Sweet, feel free to check it out here and let us know what you think :). Source: almost 2 years ago

• Whoop vs alternatives

  My friend and I are both Apple Watch owners and we made an app this year to get better insights into our data, but now we're looking at other wearables out there to see what else is possible in terms of unique data and insights. Curious to see hear from those in this community of why they chose to go with Whoop! Source: about 2 years ago

• Update: We got accepted into Y Combinator's S22 batch for our personal data platform

  5 months ago, we made a post here telling the story of what we learned from quitting our jobs to build and release Metriport from scratch in 11 weeks. We wanted to follow up since that post, as a lot has happened since then, including getting featured on TechCrunch and more recently getting accepted into Y Combinator's S22 batch of startups. Source: about 2 years ago