I am trying to fit spline on my data having 5700 data samples (with duplicate x values ie. x: horizontal axis) using 'interp1d' function from package 'scipy' in python. I tried with lower order spline (k=1) and with the quadratic spline(k=2), cubic spline (k=3). And I am shocked to witness the weird response of 'spline' on my data.Although spline at 'k=1' made some sense but is ridiculously overfitting it(quadratic and cubic spline performed too bad).In my first trial, I used Polynomial fitting to fit the data and results were encouraging. I was expecting spline fitting will give results better than what I got with polynomial fitting.This is the result with splines. Please suggest me, where am I wrong?
Fitting spline to data with duplicate x using scipy (Python)
3.8k Views Asked by B Singh At
1
There are 1 best solutions below
Related Questions in MACHINE-LEARNING
- How to cluster a set of strings?
- Enforcing that inputs sum to 1 and are contained in the unit interval in scikit-learn
- scikit-learn preperation
- Spark MLLib How to ignore features when training a classifier
- Increasing the efficiency of equipment using Amazon Machine Learning
- How to interpret scikit's learn confusion matrix and classification report?
- Amazon Machine Learning for sentiment analysis
- What Machine Learning algorithm would be appropriate?
- LDA generated topics
- Spectral clustering with Similarity matrix constructed by jaccard coefficient
- Speeding up Viterbi execution
- Memory Error with Classifier fit and partial_fit
- How to find algo type(regression,classification) in Caret in R for all algos at once?
- Difference between weka tool's correlation coefficient and scikit learn's coefficient of determination score
- What are the approaches to the Big-Data problems?
Related Questions in REGRESSION
- Backwards stepwise regression approach in Stata 13
- Determining regression coefficients for data - MATLAB
- For Loop for Regression based on variable name in R
- How to find algo type(regression,classification) in Caret in R for all algos at once?
- Trying to find a best fit line for multiple noisy sine waves
- Why does this model fail?
- Coefficients of my polynomial model in R don't match graph
- glmnet training throws error on x,y dataframe arguments: am I using it wrong?
- An error while looping a linear regression
- How to output "Summary of Stepwise Selection" table from SAS PROC REG into data set?
- SAS RobustReg Procedure output parameter estimates
- How to find an optimal adstock decay factor for an independent variable in panel analysis in R?
- Regression of a complex model in R
- How to get values on testdata in RSNNS
- perl regression without intercept
Related Questions in INTERPOLATION
- Animate custom object variable
- C++: Lagrange Polynomial interpolation to interpolate polynomial defined over a field
- Interpolate HSL Colours
- Integrating Velocity Over a Complex 2-D Surface
- interpolating or fitting spline issues
- x86 assembly fading bmp with linear interpolation
- Limiting interpolation function to NA values
- Loop through categories in a column and perform interpolation on only those records
- AngularJS: Directive with arbitrary start and end symbols
- Using interp1 in an ODE function [MATLAB]
- Given scattered data in three dimensions, need to interpolate data and find functions at a specific point
- Interpolation using dynamic programming
- Pandas interpolate: slinear vs index
- python interpolation and data comparison
- Interpolation for missing values
Related Questions in CURVE-FITTING
- scipy.optimize.curve_fit for a function with complex dependence on variable parameters
- Catmull-Rom interpolation on SVG Paths
- How to fit datasets so that they share some (but not all) parameter values
- How to fit a curve with an optional parameter in the funtion in python
- gnuplot - get errors on fit parameters, get fit output values as variables, print variable to screen
- How can I simulate a Bezier curve out of an image?
- Non-monotonic spline fitting
- Does opencv have Savitzky Golay or Polynomial fit?
- Fitting a periodic graph in python: parameters for scipy.interpolate.splrep, equation of curve?
- Improve Polynomial Curve Fitting using numpy/Scipy in Python Help Needed
- How to find all maximas if x and y values of the function are given as np.array
- Predicting intercept and coefficient for linear regression model for multiple variable
- How to speed up python curve_fit over a 2D array?
- How to show equation in Matlab fitting toolbox?
- Wrong Exponential Power Plot - How to improve curve fit
Related Questions in SPLINE
- Limiting interpolation function to NA values
- Given scattered data in three dimensions, need to interpolate data and find functions at a specific point
- python interpolation and data comparison
- Double integration using experimental data
- Chordal Catmull-Rom Splines
- Adding piecewise polynomials in MATLAB
- Spline regression coefficients for every pair elements in two matrices R
- How to transform a curve in a specific way
- How to show equation in Matlab fitting toolbox?
- Creating DXF Spline programmatically
- Three.js animated bezier curves
- How to compute a spline value from a set of knots and coefficents given by Scipys SmoothBivariateSpline
- lapply() and spline() on two data frames in R , No Merging
- Smoothing Continuous 2D Points
- Fitting spline to data with duplicate x using scipy (Python)
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
If a data set has separate uniquely valued points for each X value, the effective weighting for each data point is 1.0. If however a single data point in that data set is doubled, or copied, once that single data point has an effective weight of 2.0.
If all data points in a data set are copied once, each point then has the same effective weight of 2.0 - that is, all data points will have the same weight.
If some data points in this data set have unique X values and some appear more than once, one approach is to average the Y values for the "duplicate" data points so that each point again has an effective weight of 1.0. This can sometimes work in the specific case I describe.