Recently, I find that the mlmodel with flexible shapes runs much slower than the same mlmodel with fixed shapes.
Such as a detect mlmodel, the default input shape is 3 x 416 x 416, it takes 20ms on iphoneXS with ANE(ComputeUnitsALL) with fixed shape.
Then, I changes the mlmodel to 3 X 416... X 416... by coremltools, and I also gives the 3 x 416 x416 image as input, but it takes 60ms on iphoneXS with ANE(ComputeUnitsALL).
I am confused with this problem. Has anyone encountered the same problem? Thanks very much.
Coreml's MLModel with flexible shape runs much slower than fixed shape
233 Views Asked by YiZhaoYanBo At
0
There are 0 best solutions below
Related Questions in COREML
- How to use Machine Learning model in objective-C with CoreML
- Alternative to Lambda layer in Keras
- How can I use half floats with CoreML neural nets?
- iOS 11 using vision framework VNDetectRectanglesRequest to do object detection not precisely?
- CoreML output type
- Stanford dataset to CoreML
- How to tap on object from an image and track it from sequence of images using Vision and Core ML framework
- MobileNet vs SqueezeNet vs ResNet50 vs Inception v3 vs VGG16
- Coreml: Model class has not been generated yet
- AVCaptureVideo not showing label
- Object detection from image using vision framework
- How to create an updatable CoreML model?
- how to save a scikit-learn k-means clustering model?
- How to create CoreML MLMultiArray for a 4D data for prediction on iOS with Swift?
- can I use a clustering model written in python in an iOS application?
Related Questions in COREMLTOOLS
- CoreMLTools Keras simple Sequential Linear Regression model export error ('module' object has no attribute 'mobilenet')
- Stanford dataset to CoreML
- Core ML uses too much memory when saving updated model
- how to Implement replication_pad2d layer in to coremltools converters as torch_op
- coreML model converted from pytorch model giving the wrong prediction probabilities
- How to convert from CoreML to ONNX?
- Inconsistent Object Detection Performance Between YOLOv8n PyTorch and Converted CoreML Model
- CoreMLTools converted Tensorflow model completely wrong predictions in Swift
- Update CoreML model on device gives negative MSE loss
- CoreML returning Nan for no reasons
- Is it possible to set/change output sizes in Create ML for style transfer models?
- NSLocalizedDescription = "The size of the output layer 'Identity' in the neural network does not match the number of classes in the classifier."
- CoreML: exception Espresso exception: "Invalid state": Null output blobs
- RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory
- Issue creating MTLBuffer from MTLTexture used as inputs in CoreML Custom Layer for GPU execution
Related Questions in ONNX-COREML
- How do you run a ONNX model on a GPU?
- coreML model converted from pytorch model giving the wrong prediction probabilities
- How to convert from CoreML to ONNX?
- Onnx to coreml model conversion
- converting from yolov4 or yolov5 to coreml
- Missing Weight Vectors when converting from PyTorch to CoreML via ONNX
- Errors converting PyTorch Unet ("tiramisu") into coreml, via onnx
- Object detection on Raspberry PI using customvision.ai/.NET 5
- ONNX object from PyTorch model without exporting
- the results of mlmodel using ANE is wrong, but results of gpu and cpu are correct
- Input dimension reshape when using PyTorch model with CoreML
- xrunc coreml model error for YOLACT onnx with no priors layer and softmax layer
- Shaping input for a coremlmodel
- Coreml model float input for a pytorch model
- Facing issue while converting YOLOV3 Pytorch model to coreml to be in IOS App using ONNX
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?