What is the fastest way to order a Django queryset using JSONField?

Question

I have a model which mostly stores data in a JSON field. Its kinda set up as follows:

class Record(models.Model):
    data = JSONField()

Usually, the data field has the following format:

data = {
    "name": "Chad",
    "age": 23
}

Now, in a view, I want to get the first 20 records, but ordered using the format ['-age', 'name']. What are my options for doing this? Right now, the only solution I can think of is getting all the records using Record.objects.all(), and iterating the whole thing while ordering using the data field json. Is there a faster way to do this? Or is this my only solution? Moreover, if I am to solve it this way, how would I go about ordering the records, and would it be a huge performance issue on my database? Thanks.

Edit: I cannot make everything into separate fields. It has to be a JSONField using PostgreSQL Database.