I have a step function with a parallel state that has four branches (A, B, C, D) each with 3 Glue StartJobRun task states. In the case that branch A fails during the 1st task, how can I make sure the other branches continue with their tasks as long as they are successful?
In an AWS Step Function's Parallel state, if one branch fails is there a way to ensure that the other branches continue until completion?
6.1k Views Asked by Hari Kaushik At
1
There are 1 best solutions below
Related Questions in AMAZON-WEB-SERVICES
- "Access Denied" - User's Permissions to S3 Bucket
- Cohort analysis with Amazon Redshift / PostgreSQL
- Using Amazon KMS service on Heroku
- can't ssh in after cloning an EC2 instance on Amazon AWS
- Using HDFS with Apache Spark on Amazon EC2
- How can I access Mule ESB Community edition via browser?
- AWS EC2: Migrating from Windows to Linux Server
- AWS ELB Load Balancer: is it possible to set multiple session cookies?
- AWS Flow Framework: Can we run activity worker and activity task on different EC2 instances
- Unable to access files from public s3 bucket with boto
- Cloudfront stream only part of the video
- s3cmd not working as cron-task when echos/dates are added
- How to deploy django 1.8 on Elastic Beanstalk using Docker
- InstanceProfile is required for creating cluster - create python function to install module
- How to fix WordPress HTTPS issues when behind an Amazon Load Balancer?
Related Questions in BOTO3
- Fetching ElastiCache Tags
- Python Boto3 AWS Multipart Upload Syntax
- Want to access a value in a dictionary which is inside a list inside another dictionary
- boto S3ResponseError: 400 Bad Request
- when using boto3 how to create an aws instance with a custom root volume size
- boto3 searching unused security groups
- How do I upload a file to s3 using boto3 in python on heroku?
- boto3 emr client run_job_flow wants InstanceProfile attribute
- Checking STOP time of EC2 instance with boto3
- Boto3: aws credentials with limited permissions
- boto3 ses InvalidParameterValue error due to unicode characters
- Set or modify an AWS Lambda environment variable with Python boto3
- HTTP Code 400 getting objectfrom AWS S3 bucket with Boto3 in python
- fetch unique values of item from dynamoDB using python
- boto3 request_spot_instances method does not work with "UserData"
Related Questions in AWS-STEP-FUNCTIONS
- How can i call AWS Step Functions by API Gateway?
- AWS Fail Step Function in case of Lambda Failure, and still send Error Object in response
- Can AWS Step Function depend on concurrent Lambdas completing?
- AWS steps parallel state to orchestrate EMR jobs
- In an AWS Step Function's Parallel state, if one branch fails is there a way to ensure that the other branches continue until completion?
- AWS X-Ray and StepFunctions -> can't get TraceHeader
- AWS Step Functions SDK: State type `Choice` does not support method `next`
- How many items can AWS Step Function Map task handle?
- Is there a way to pass file size as an input parameter from an AWS S3 bucket to a StepFunctions state machine?
- How can I define step function execution name from an EventBridge rule?
- Invoking AWS Step Function from API Gateway and returning response?
- Api Gateway Step Functions integration - xml payload problem
- throttle down lambda execution in aws
- Execute SQL query on Redshift using AWS fargate orchestrated by Step Function
- AWS Step Function sfn.ListExecutions not showing executions
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
As you mentioned in AWS Step Functions if one branch fails, the other branches will be immediately terminated and their results ignored. Step Functions will make a best-effort attempt to cancel any .sync tasks that are in progress, and stop executing any further states on any branch. If you want to let those other branches proceed to completion, you have to prevent any branch from failing. You can use Catch blocks on each state and transition to a Succeed (even when it was actually a failure). Then, after the Parallel completes, add a new state to do error handling to check which branches succeeded or failed.