Load tensorrt model without tensorflow

149 Views Asked by At

I am struggling to find an answer, and every exemple uses tensorflow. I am trying to load a saved_model, optimized with tensorrt, without tensorflow.

I performed training with tensorflow, and optimized and saved the model with tensorrt.

Now, on a different machine, which only have tensorrt installed, I would like to load the model and perform inference. The goal of not having tensorflow on that machine is to save building time, and space.

Is it at least possible? If not, if I convert the model to Onnx, can I load it and run it with only tensorrt ?

Thank you in advance.

1

There are 1 best solutions below

1
On

The requirements of TensorRT contains tensorflow, so no.