This is a follow up to my previous question in which I indicated CPU and GPU slow training performance. I did another test run on google colab and used wandb to monitor the training and show CPU, GPU utilization and several other metrics, it shows 0% GPU utilization which confirms the GPU is not in use and tensorflow is just ignoring the activation or I don't know.
I activate the GPU using (tf 2.3.1):
physical_devices = tf.config.experimental.list_physical_devices('GPU')
if len(physical_devices) > 0:
tf.config.experimental.set_memory_growth(physical_devices[0], True)
Graphs within a few minutes of training:
