Why use AWS Kinesis, when AWS Lambda can handle the task?

189 Views Asked by At

I am new to AWS and I don't understand the use of AWS Kinesis quite well. I know it is used for processing streaming data, but why not just use AWS Lambda to process the incoming data and possibly store them to DB eventually? As a real case scenario, imagine there is a web crawler that constantly crawls a website for specific activities and sends them in JSON format. Why should I use AWS Kinesis in this case when I can do all my data processing through a lambda function? Is it because Kinesis can handle large amounts of data through auto calling its shards? Also, after using Kinesis to store my data into S3 I realized that my data got stored into S3 bucket with almost 3-4 minutes of delay which is not acceptable. Can anyone help me, please?

0

There are 0 best solutions below