GCP Datastore times out on large download

59 Views Asked by At

I'm using Objectify to access my GCP Datastore set of Entites. I have a full list of around 22000 items that I need to load into the frontend:

List<Record> recs = ofy().load().type(Record.class).order("-sync").list();

The number of records has recently increased and I get an error from the backend: com.google.apphosting.runtime.HardDeadlineExceededError: This request (00000185caff7b0c) started at 2023/01/19 17:06:58.956 UTC and was still executing at 2023/01/19 17:08:02.545 UTC.

I thought that the move to Cloud Firestore in Datastore mode last year would have fixed this problem.

My only solution is to break down the load() into batches using 2 or 3 calls to my Ofy Service. Is there a better way to grab all these Entities in one go? Thanks Tim

0

There are 0 best solutions below