Play with the latest Airflow 3.0.0 alpha 1!
I mean alpha 2...
As announcements in the Airflow dev mailing list, 📢 Apache Airflow 3.0.0apha1 is available for testing! 🎉 📢 Apache Airflow 3.0.0apha2 is available for testing! 🎉
AIP-83 - Rename execution_date -> logical_date and remove unique constraint
DAG 即將走入歷史
最近要 review 幾個 AIP-83 的 pull requests
重新回來整理一下筆記
避免 review 的時候搞不清楚狀況
AIP-72 - Task Execution Interface aka Task SDK
Airflow 的 task 要支援 Python 以外的語言了！
以後 Flyte 不能再以這點嘴 Airflow 了 😆
Building a Customized Linter
Checking the Default Value of default_deferrable through AST
In the previous article, I mentioned that we can only kindly ask users to add the default value of deferrable correctly. But... the fact is we can do better.
Optimizing Airflow Operators
Converting to Async with default_deferrable Config
In the article series What If...? Running Airflow Tasks without the workers, I introduced one of the new features of Airflow 2.10.0. It's time to introduce a feature in Airflow 2.7.0 (no, it's not).
Dynamic task mapping on operators that can start execution from trigger
This is not the feature you're looking for
As mentioned in the first article of this series, dynamic task mapping was not supported before this PR. However, it's now supported.
Well... partially
Serialize StartTriggerArgs
That's not how Airflow serialization works!
This article discusses the implementation details of StartTriggerArgs, which may not interest most Airflow users. However, if you're a contributor or simply interested in how Airflow works, let's dive in.