Margaret Rouse is an award-winning technical writer and teacher known for her ability to explain complex technical subjects simply to a non-technical, business audience. Over…
The gradient descent algorithm is a strategy that helps to refine machine learning operations. The gradient descent algorithm works toward adjusting the input weights of neurons in artificial neural networks and finding local minima or global minima in order to optimize a problem.
The gradient descent algorithm is also known simply as gradient descent.
To understand how gradient descent works, first think about a graph of predicted values alongside a graph of actual values that may not conform to a strictly predictable path. Gradient descent is about shrinking the prediction error or gap between the theoretical values and the observed actual values, or in machine learning, the training set, by adjusting the input weights. The algorithm calculates the gradient or change and gradually shrinks that predictive gap to refine the output of the machine learning system. Gradient descent is a popular way to refine the outputs of ANNs as we explore what they can do in all sorts of software areas.
Techopedia’s editorial policy is centered on delivering thoroughly researched, accurate, and unbiased content. We uphold strict sourcing standards, and each page undergoes diligent review by our team of top technology experts and seasoned editors. This process ensures the integrity, relevance, and value of our content for our readers.
Margaret is an award-winning technical writer and teacher known for her ability to explain complex technical subjects to a non-technical business audience. Over the past twenty years, her IT definitions have been published by Que in an encyclopedia of technology terms and cited in articles by the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine, and Discovery Magazine. She joined Techopedia in 2011. Margaret's idea of a fun day is helping IT and business professionals learn to speak each other’s highly specialized languages.
What is Turnitin AI Checker? The Turnitin AI checker is an advanced tool aimed at maintaining the integrity of school...
Maria WebbTechnology journalist
What is ISO/IEC 42001? ISO/IEC 42001 is an international standard that provides a governance framework for implementing and continually improving...
Margaret RouseTechnology Expert
What are Physical Resource Networks (PRNs)? The definition of Physical Resource Networks (PRNs) is that they are a type of...
Nicole WillingTechnology Journalist
Trending NewsLatest GuidesReviewsTerm of the Day