Question

Why running local file system to s3 worked as test and uploaded, but actually running dag failed in Airflow managed server?

score 240 · Answer 1 · 2025-01-02 16:29:38

240

Views

Why running local file system to s3 worked as test and uploaded, but actually running dag failed in Airflow managed server?

Published on 02 January 2025 at 16:29

score 113 · Answer 2 · 2024-12-31 16:53:19

113

Views

Can we Produce Messages to AWS MSK from AWS Managed Airflow DAG?

Published on 31 December 2024 at 16:53

score 155 · Answer 3 · 2025-01-02 16:28:15

155

Views

AWS MWAA Airflow is failing for only some tasks as "Could not read remote logs from log_group"

Published on 02 January 2025 at 16:28

score 265 · Answer 4 · 2025-01-02 16:10:46

265

Views

How to send AWS MWAA cluster metrics to DataDog?

Published on 02 January 2025 at 16:10

score 158 · Answer 5 · 2025-01-02 16:21:07

158

Views

How to recursively evaluate an Airflow macro {{ ds }} passed into DAG params

Published on 02 January 2025 at 16:21

score 607 · Answer 6 · 2025-01-02 16:17:29

607

Views

AWS MWAA Airflow task fails with no log and nonsensical duration

Published on 02 January 2025 at 16:17

score 276 · Answer 7 · 2025-01-02 16:24:11

276

Views

AWS MWAA conflicting dependencies between compatible versions requirements.txt

Published on 02 January 2025 at 16:24

score 59 · Answer 8 · 2025-01-02 16:07:47

59

Views

MWAA not Respecting any Concurrency Limits

Published on 02 January 2025 at 16:07

score 167 · Answer 9 · 2025-01-02 16:23:04

167

Views

Invoke a aws lambda function using MWAA DAG and schedule it for 15 minutes

Published on 02 January 2025 at 16:23

score 140 · Answer 10 · 2025-01-02 16:07:46

140

Views

Speed up backfilling in Airflow (MWAA)

Published on 02 January 2025 at 16:07

score 226 · Answer 11 · 2025-01-02 16:17:29

226

Views

Scheduling Airflow timezone-aware dags based on my local timezone

Published on 02 January 2025 at 16:17

score 120 · Answer 12 · 2025-01-02 16:07:45

120

Views

Amazon MWAA, postgresql connection timeout

Published on 02 January 2025 at 16:07

score 81 · Answer 13 · 2025-01-02 16:17:27

81

Views

In airflow, how to get default value as ds inside jinja template

Published on 02 January 2025 at 16:17

score 896 · Answer 14 · 2025-01-05 12:42:26

896

Views

How to get reason for failure using slack in airflow2.0

Published on 05 January 2025 at 12:42

score 615 · Answer 15 · 2025-01-02 16:09:12

615

Views

MWAA ECSOperator "No task found" but succeeds

Published on 02 January 2025 at 16:09

score 446 · Answer 16 · 2025-01-05 12:42:52

446

Views

How to connect MWAA CLI that is hosted in a public subnet

Published on 05 January 2025 at 12:42

score 2.9k · Answer 17 · 2025-01-02 16:17:26

2.9k

Views

Airflow 2.2 TriggerDagRunOperator wait_for_completion behavior

Published on 02 January 2025 at 16:17

score 1k · Answer 18 · 2025-01-02 16:29:36

1k

Views

I have created an MWAA Cluster using terraform. I am trying to import variables using curl command. But it fails with an 403 Exception

Published on 02 January 2025 at 16:29

score 2.3k · Answer 19 · 2025-01-02 16:07:45

2.3k

Views

Install custom package (wheel) in MWAA

Published on 02 January 2025 at 16:07

score 8.8k · Answer 20 · 2025-01-02 16:23:05

8.8k

Views

ModuleNotFoundError: No module named 'airflow.providers.slack' Airflow 2.0 (MWAA)

Published on 02 January 2025 at 16:23

List Question

Why running local file system to s3 worked as test and uploaded, but actually running dag failed in Airflow managed server?

Can we Produce Messages to AWS MSK from AWS Managed Airflow DAG?

AWS MWAA Airflow is failing for only some tasks as "Could not read remote logs from log_group"

How to send AWS MWAA cluster metrics to DataDog?

How to recursively evaluate an Airflow macro {{ ds }} passed into DAG params

AWS MWAA Airflow task fails with no log and nonsensical duration

AWS MWAA conflicting dependencies between compatible versions requirements.txt

MWAA not Respecting any Concurrency Limits

Invoke a aws lambda function using MWAA DAG and schedule it for 15 minutes

Speed up backfilling in Airflow (MWAA)

Scheduling Airflow timezone-aware dags based on my local timezone

Amazon MWAA, postgresql connection timeout

In airflow, how to get default value as ds inside jinja template

How to get reason for failure using slack in airflow2.0

MWAA ECSOperator "No task found" but succeeds

How to connect MWAA CLI that is hosted in a public subnet

Airflow 2.2 TriggerDagRunOperator wait_for_completion behavior

I have created an MWAA Cluster using terraform. I am trying to import variables using curl command. But it fails with an 403 Exception

Install custom package (wheel) in MWAA

ModuleNotFoundError: No module named 'airflow.providers.slack' Airflow 2.0 (MWAA)

Trending Questions

Popular # Hahtags

Popular Questions