Apache Airflow Reviews

Medium Reviews

Apache Airflow mentions (68)

• How I've implemented the Medallion architecture using Apache Spark and Apache Hdoop

  Instead of the custom orchestrator I used, a proper orchestration tool should replace it like Apache Airflow, Dagster, ..., etc. - Source: dev.to / 17 days ago

• 10 Open Source Tools for Building MLOps Pipelines

  An integral part of an ML project is data acquisition and data transformation into the required format. This involves creating ETL (extract, transform, load) pipelines and running them periodically. Airflow is an open source platform that helps engineers create and manage complex data pipelines. Furthermore, the support for Python programming language makes it easy for ML teams to adopt Airflow. - Source: dev.to / 28 days ago

• AI Strategy Guide: How to Scale AI Across Your Business

  Level 1 of MLOps is when you've put each lifecycle stage and their intefaces in an automated pipeline. The pipeline could be a python or bash script, or it could be a directed acyclic graph run by some orchestration framework like Airflow, dagster or one of the cloud-provider offerings. AI- or data-specific platforms like MLflow, ClearML and dvc also feature pipeline capabilities. - Source: dev.to / about 2 months ago

• The 2024 Web Hosting Report

  For the third, examples here might be analytics plugins in specialized databases like Clickhouse, data-transformations in places like your ETL pipeline using Airflow or Fivetran, or special integrations in your authentication workflow with Auth0 hooks and rules. - Source: dev.to / 5 months ago

• Best ETL Tools And Why To Choose

  Apache Airflow is an open-source platform to programmatically author, schedule, and monitor workflows. The platform features a web-based user interface and a command-line interface for managing and triggering workflows. Source: 8 months ago

Medium mentions (2268)

• Show HN: Parsing books for time expressions with Python

  Https://medium.com/@gabrielcodes/parsing-thousands-of-books-for-time-expressions-with-python-b317dd534911 The website and data both have a lot of bugs, but it works for a lot of times, and it was a fun little project :). - Source: Hacker News / about 15 hours ago

• Ask HN: Who wants to be hired? (July 2024)

  The search engine is still under construction you can try it here: https://cse.google.com/cse?cx=f13dcea58f19d44de#gsc.tab=0 SyriaInfo | https://medium.com/@Syriainfo. - Source: Hacker News / 3 days ago

• Google has been lying about their search results [video]

  SEO "experts" and scammers are salty. Define a metric and people will game it, how will bots and promoted content be filtered out now? A new set of problems. I am slowly replacing Google with ChatGPT: https://medium.com/@trendguardian/a-new-search-engine-1f91a5c05ebb. - Source: Hacker News / 3 days ago

• The EU regulates that by 2027, all phones be equipped with replaceable batteries

  The submission title has almost nothing to do with the meat of the announcement. This is a manufacturer of stainless steel battery cases announcing Apple will use them for the battery in the iPhone 16 [0]. > Sunway is a major supplier of stainless steel battery cases. > Apple uses the stainless steel battery case for the first time as a thermal solution > Looking forward to 2025, if all 2H25 new iPhones adopt this... - Source: Hacker News / 3 days ago

• Polyfill supply chain attack hits 100K+ sites

  Since this is effecting end users of websites directly. So instead of waiting for developer to fix it, this could help you stay protected until then https://medium.com/@wrongsahil/protecting-yourself-from-polyfill-io-malware-as-a-user-7be300ff8b94. - Source: Hacker News / 8 days ago