I am working on a machine learning model for detecting Keypoints for hands using depth image. So far the datasets I have seen includes labels for keypoints/skeletons in world and image view (See Shrec 17 or DHG dataset). I have seen couple of papers and their implementations that learn the world coordinates for keypoint detection. I want to understand how to map the 3D world coordinates to the depth image and check the visualization on the data and possibly extend the trained model for live predictions/visualization on Azure Kinect
How to convert world coordinates to image coordinates for datasets like Shrec 17 and DHG
356 Views Asked by Saurabh Pradhan At
1
There are 1 best solutions below
Related Questions in MACHINE-LEARNING
- How to cluster a set of strings?
- Enforcing that inputs sum to 1 and are contained in the unit interval in scikit-learn
- scikit-learn preperation
- Spark MLLib How to ignore features when training a classifier
- Increasing the efficiency of equipment using Amazon Machine Learning
- How to interpret scikit's learn confusion matrix and classification report?
- Amazon Machine Learning for sentiment analysis
- What Machine Learning algorithm would be appropriate?
- LDA generated topics
- Spectral clustering with Similarity matrix constructed by jaccard coefficient
- Speeding up Viterbi execution
- Memory Error with Classifier fit and partial_fit
- How to find algo type(regression,classification) in Caret in R for all algos at once?
- Difference between weka tool's correlation coefficient and scikit learn's coefficient of determination score
- What are the approaches to the Big-Data problems?
Related Questions in DEEP-LEARNING
- [Caffe]: Check failed: ShapeEquals(proto) shape mismatch (reshape not set)
- Caffe net.predict() outputs random results (GoogleNet)
- Implementation of convolutional sparse coding in deep networks frameworks
- Matlab example code for deep belief network for classification
- Two errors while running Caffe
- How to speed up caffe classifer in python
- Caffe Framework Runtest Core dumped error
- Scan function from Theano replicates non_sequences shared variables
- Why bad accuracy with neural network?
- Word2Vec Sentiment Classification with R and H2O
- What is gradInput and gradOutput in Torch7's 'nn' package?
- Error while drawing net in Caffe
- How does Caffe determine the number of neurons in each layer?
- Conclusion from PCA of dataset
- Google Deep Dream art: how to pick a layer in a neural network and enhance it
Related Questions in COMPUTER-VISION
- OpenCV algorithm of contours searching and creation of bounding rectagle
- How to make sense (handle) when computes logarithm of zero in prior information
- Matlab code crashes and gives error: Dimension of matrices being concatenated are not consistent
- Haar Cascade classifier does not detect faces in simple frontal pictures
- Face cropping using facial landmarks
- qtimer and opencv running slow
- Simple RGB to Gray program crashes
- Estimating pose of one camera given another with known baseline
- dealing with dimensions in scikit-learn tree.decisiontreeclassifier
- converting matlab code to c code readiness error
- MATLAB ConnectedComponentLabeler does not work in for loop
- Finding camera position without calibration
- StereoSGBM cannot handle negative minDisparity
- How to speed up caffe classifer in python
- HOG Feature extraction
Related Questions in KEYPOINT
- OpenCV return keypoints coordinates and area from blob detection, Python
- training data augmentation in caffe along with its multilabel
- Finding hamming distance between ORB feature descriptors
- Display Keypoints on Image in Android - OpenCV
- Key-point Detection and Image Stitching
- OpenCV 2.4.6 SIFT KeyPoints Detection using a lot of memory
- Reshape output dimensions to fit Keras model
- Get the SIFT descriptor for specified point using OpenCV
- Surf feature Extraction
- What is the state-of-art algorithms for planar object recognition?
- Why the coco-annotator I installed doesn't have delete option?
- How To Add Code to Upload image and show image that has keypoint from YoloV8 model?
- convert keypoints to mat or save them to text file opencv
- How to convert world coordinates to image coordinates for datasets like Shrec 17 and DHG
- OpenCV SIFT+FLANN multiple matches for single keypoint
Related Questions in WORLD-COORDINATES
- How to convert world coordinates to image coordinates for datasets like Shrec 17 and DHG
- Halcon - Shift coordinates to a different plane
- How to justify text on an RDLC report on C#
- Want a scene with camera.position.y = 7 to display it in the centre of the canvas
- How to get world coordinates?
- Normalizing android accelerometer data so that x,y,z are always referencing the same orientation regardless of device's orientation
- How do I align SDSS sky images in Python using Astropy?
- How to get the camera's world coordinates by using relative position and orientation?
- Constant World Translations when determining Height above Terrain
- Mapping sensor coordinates to display
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
You have to know the calibration matrices of the camera. The pipeline for this is the following.
3D World Coordinates --> 3D Camera Coordinates --> 2D Camera Coordinates.
The first step is called extrinsic calibration and the second step is the so-called intrinsic calibration and you need it in any case.
Example: Lets say you have a LIDAR for 3D points detection. The world coordinates you have is not with respect to LIDARs' origin. If your camera is not at the very same place as your LIDAR(which is pyhsically impossible but if they pretty close you might ignore), first you have to transform these 3D coordinates so that they are now represented with respect to the cameras' origin. You can do this with rotation and translation transform matrices if you know the position of the camera and the LIDAR.
The second step again goes by transformation matrices. However, you need to know some intrinsic parameters about the camera in use. (E.g focal length, skew) These can be computed with some experiments if you have the camera but in your case, it should rather be that these calibration matrices are provided to you together with the data. So ask for it.
You can read about all these in this link. https://www.mathworks.com/help/vision/ug/camera-calibration.html