AWS Glue -Add prefix to Job output file name

Question

AWS Glue job default output file name start with jr_. When I refer these logs under Cloud Watch logstream, its very difficult to find specific job.

Anyone know If I can rename these or add prefix/suffix ?

Answer 1

If you know the specific job ID, you can use CloudWatch logs insights to query for that specific job, e.g.

fields @timestamp, @logStream, @message
| filter @logStream like /*job id*/
| sort @timestamp desc
| limit 20

For more information, refer to: https://docs.aws.amazon.com/kinesisanalytics/latest/java/cloudwatch-logs-reading.html