AIP-83 - Rename execution_date -> logical_date and remove unique constraint
DAG 即將走入歷史
最近要 review 幾個 AIP-83 的 pull requests
重新回來整理一下筆記
避免 review 的時候搞不清楚狀況
AIP-72 - Task Execution Interface aka Task SDK
Airflow 的 task 要支援 Python 以外的語言了！
以後 Flyte 不能再以這點嘴 Airflow 了 😆
Building a Customized Linter
Checking the Default Value of default_deferrable through AST
In the previous article, I mentioned that we can only kindly ask users to add the default value of deferrable correctly. But... the fact is we can do better.
Optimizing Airflow Operators
Converting to Async with default_deferrable Config
In the article series What If...? Running Airflow Tasks without the workers, I introduced one of the new features of Airflow 2.10.0. It's time to introduce a feature in Airflow 2.7.0 (no, it's not).
Dynamic task mapping on operators that can start execution from trigger
This is not the feature you're looking for
As mentioned in the first article of this series, dynamic task mapping was not supported before this PR. However, it's now supported.
Well... partially
Serialize StartTriggerArgs
That's not how Airflow serialization works!
This article discusses the implementation details of StartTriggerArgs, which may not interest most Airflow users. However, if you're a contributor or simply interested in how Airflow works, let's dive in.
Enhancing Airflow Task Execution with StartTriggerArgs
As mentioned in Starts Airflow task execution directly from the triggerer, the syntax of this feature will change after #39585 merged.
Achieve 200 contributions in Apache Airflow
This is more like a personal reflection, and I really doubt it would benefit anyone. But it's my blog anyway. I can write whatever I want, lol.