TensorFlow QAT how to get the quantized weights

477 Views Asked by At

How to get the values of the quantized weights or get quantization aware weights after quantization aware training (QAT) of TensorFlow. I want to use integer quantized weights on NumPy for an application. I used as follows so far, which gives float32 values.

import tensorflow.keras.backend as K

for layer in q_aware_model.trainable_weights:
    weights_temp.append(K.get_value(layer))
1

There are 1 best solutions below

0
On

to see the quantized weights you have to convert the model first. See process description and numpy application in this TF example

Note that you may need to use nightly tf build for the quantized functions to work properly.