Can someone give me a high level over view of how gradient descent is used in linear regression? I understand that gradient descent basically finds a local minimum efficiently, but how does that actually help to form a regression to data? Can someone give me an order of events in which the line is actually formed to the data points? i understand how to compute the gradient of a point, just not how that actually helps form the line more efficiently.
What is the role of gradient descent in linear regression?
168 Views Asked by Garrett Huff At
1
There are 1 best solutions below
Related Questions in MACHINE-LEARNING
- How to cluster a set of strings?
- Enforcing that inputs sum to 1 and are contained in the unit interval in scikit-learn
- scikit-learn preperation
- Spark MLLib How to ignore features when training a classifier
- Increasing the efficiency of equipment using Amazon Machine Learning
- How to interpret scikit's learn confusion matrix and classification report?
- Amazon Machine Learning for sentiment analysis
- What Machine Learning algorithm would be appropriate?
- LDA generated topics
- Spectral clustering with Similarity matrix constructed by jaccard coefficient
- Speeding up Viterbi execution
- Memory Error with Classifier fit and partial_fit
- How to find algo type(regression,classification) in Caret in R for all algos at once?
- Difference between weka tool's correlation coefficient and scikit learn's coefficient of determination score
- What are the approaches to the Big-Data problems?
Related Questions in LINEAR-REGRESSION
- using apply with an anonymous function which uses specific locations in the row
- writing a wrapper for a linear modeling function [MASS::lm.gls()]
- Create a graph to display observed and fitted values
- How to weight station to Order Least Squares in python?
- How does "statsmodels.regression.linear_model. WLS" work?
- Calling R function within SQL - HANA database
- use common math library in java
- How to use multiple data to train a linear regression model in R
- Format of R's lm() Formula with a Transformation
- perl regression without intercept
- How to avoid float values in regression models
- Linear regression in R: invalid type (list) for variable?
- Regression column in pandas
- Spark's LinearRegressionWithSGD is very sensitive to feature scaling
- Python stats.linregress syntax error
Related Questions in GRADIENT-DESCENT
- Python implementation of Gradient Descent Algorithm isn't working
- Basic Machine Learning: Linear Regression and Gradient Descent
- Theano stochastic gradient descent NaN output
- Comparing the accuracies of different numerical gradients?
- Gradient Descent on a logarithmic decline curve in Python
- Slow Adagrad Convergence
- Does Stochastic Gradient Descent even work with TensorFlow?
- Implementing naive gradient descent in python
- Increasing and wide spreading cost function with Stochastic Gradient Descent
- Wouldn't setting the first derivative of Cost function J to 0 gives the exact Theta values that minimize the cost?
- What is the role of gradient descent in linear regression?
- Counterintuitive results on multi-armed bandit exercise
- Set variable list for gradient descent in TensorFlow
- Neural network always predicts the same class
- Why deep NN can't approximate simple ln(x) function?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
I found a solid answer here: https://spin.atomicobject.com/2014/06/24/gradient-descent-linear-regression/
The trick to understanding this is knowing that you must compute the m and b value of y = mx+b to develop a cost function, but that gives you a new data set of the best and worst fitting lines. You then use gradient decent to basically find the lowest error line which contains your actual m and b values for the line. This link has a really good graph (in my non professional machine learning opinion) of what the error graph looks like and if you understand gradient decent you can see how it can travel down the graph to find the lowest error. Sorry for jumping the gun on this question but hopefully it can help some others who are new to machine learning!