Question

Why running local file system to s3 worked as test and uploaded, but actually running dag failed in Airflow managed server?

score 247 · Answer 1 · 2025-01-02 16:29:38

247

Views

Why running local file system to s3 worked as test and uploaded, but actually running dag failed in Airflow managed server?

Published on 02 January 2025 at 16:29

score 121 · Answer 2 · 2024-12-31 16:53:19

121

Views

Can we Produce Messages to AWS MSK from AWS Managed Airflow DAG?

Published on 31 December 2024 at 16:53

score 163 · Answer 3 · 2025-01-02 16:28:15

163

Views

AWS MWAA Airflow is failing for only some tasks as "Could not read remote logs from log_group"

Published on 02 January 2025 at 16:28

score 273 · Answer 4 · 2025-01-02 16:10:46

273

Views

How to send AWS MWAA cluster metrics to DataDog?

Published on 02 January 2025 at 16:10

score 165 · Answer 5 · 2025-01-02 16:21:07

165

Views

How to recursively evaluate an Airflow macro {{ ds }} passed into DAG params

Published on 02 January 2025 at 16:21

score 616 · Answer 6 · 2025-01-02 16:17:29

616

Views

AWS MWAA Airflow task fails with no log and nonsensical duration

Published on 02 January 2025 at 16:17

score 282 · Answer 7 · 2025-01-02 16:24:11

282

Views

AWS MWAA conflicting dependencies between compatible versions requirements.txt

Published on 02 January 2025 at 16:24

score 67 · Answer 8 · 2025-01-02 16:07:47

67

Views

MWAA not Respecting any Concurrency Limits

Published on 02 January 2025 at 16:07

score 173 · Answer 9 · 2025-01-02 16:23:04

173

Views

Invoke a aws lambda function using MWAA DAG and schedule it for 15 minutes

Published on 02 January 2025 at 16:23

score 147 · Answer 10 · 2025-01-02 16:07:46

147

Views

Speed up backfilling in Airflow (MWAA)

Published on 02 January 2025 at 16:07

score 231 · Answer 11 · 2025-01-02 16:17:29

231

Views

Scheduling Airflow timezone-aware dags based on my local timezone

Published on 02 January 2025 at 16:17

score 123 · Answer 12 · 2025-01-02 16:07:45

123

Views

Amazon MWAA, postgresql connection timeout

Published on 02 January 2025 at 16:07

score 85 · Answer 13 · 2025-01-02 16:17:27

85

Views

In airflow, how to get default value as ds inside jinja template

Published on 02 January 2025 at 16:17

score 905 · Answer 14 · 2025-01-05 12:42:26

905

Views

How to get reason for failure using slack in airflow2.0

Published on 05 January 2025 at 12:42

score 619 · Answer 15 · 2025-01-02 16:09:12

619

Views

MWAA ECSOperator "No task found" but succeeds

Published on 02 January 2025 at 16:09

score 454 · Answer 16 · 2025-01-05 12:42:52

454

Views

How to connect MWAA CLI that is hosted in a public subnet

Published on 05 January 2025 at 12:42

score 2.9k · Answer 17 · 2025-01-02 16:17:26

2.9k

Views

Airflow 2.2 TriggerDagRunOperator wait_for_completion behavior

Published on 02 January 2025 at 16:17

score 1k · Answer 18 · 2025-01-02 16:29:36

1k

Views

I have created an MWAA Cluster using terraform. I am trying to import variables using curl command. But it fails with an 403 Exception

Published on 02 January 2025 at 16:29

score 2.3k · Answer 19 · 2025-01-02 16:07:45

2.3k

Views

Install custom package (wheel) in MWAA

Published on 02 January 2025 at 16:07

score 8.9k · Answer 20 · 2025-01-02 16:23:05

8.9k

Views

ModuleNotFoundError: No module named 'airflow.providers.slack' Airflow 2.0 (MWAA)

Published on 02 January 2025 at 16:23

List Question

Why running local file system to s3 worked as test and uploaded, but actually running dag failed in Airflow managed server?

Can we Produce Messages to AWS MSK from AWS Managed Airflow DAG?

AWS MWAA Airflow is failing for only some tasks as "Could not read remote logs from log_group"

How to send AWS MWAA cluster metrics to DataDog?

How to recursively evaluate an Airflow macro {{ ds }} passed into DAG params

AWS MWAA Airflow task fails with no log and nonsensical duration

AWS MWAA conflicting dependencies between compatible versions requirements.txt

MWAA not Respecting any Concurrency Limits

Invoke a aws lambda function using MWAA DAG and schedule it for 15 minutes

Speed up backfilling in Airflow (MWAA)

Scheduling Airflow timezone-aware dags based on my local timezone

Amazon MWAA, postgresql connection timeout

In airflow, how to get default value as ds inside jinja template

How to get reason for failure using slack in airflow2.0

MWAA ECSOperator "No task found" but succeeds

How to connect MWAA CLI that is hosted in a public subnet

Airflow 2.2 TriggerDagRunOperator wait_for_completion behavior

I have created an MWAA Cluster using terraform. I am trying to import variables using curl command. But it fails with an 403 Exception

Install custom package (wheel) in MWAA

ModuleNotFoundError: No module named 'airflow.providers.slack' Airflow 2.0 (MWAA)

Trending Questions

Popular # Hahtags

Popular Questions