AIP-83 - Rename execution_date -> logical_date and remove unique constraint
DAG 即將走入歷史
最近要 review 幾個 AIP-83 的 pull requests
重新回來整理一下筆記
避免 review 的時候搞不清楚狀況
AIP-72 - Task Execution Interface aka Task SDK
Airflow 的 task 要支援 Python 以外的語言了!
以後 Flyte 不能再以這點嘴 Airflow 了 😆
移除照片 Exif 中的 GPSInfo
氣息遮斷 A+
最近聽了 Podcast What's on Django TV tonight? 跟 Pre-commit Hooks for Python Devs
發現了 exif-stripper 這個酷東西
Building a Customized Linter
Checking the Default Value of default_deferrable through AST
In the previous article, I mentioned that we can only kindly ask users to add the default value of deferrable correctly. But... the fact is we can do better.
Optimizing Airflow Operators
Converting to Async with default_deferrable Config
In the article series What If...? Running Airflow Tasks without the workers, I introduced one of the new features of Airflow 2.10.0. It's time to introduce a feature in Airflow 2.7.0 (no, it's not).
Dynamic task mapping on operators that can start execution from trigger
This is not the feature you're looking for
As mentioned in the first article of this series, dynamic task mapping was not supported before this PR. However, it's now supported.
Well... partially