https://sailingdatalakes.com/tags/gradient-descent/Recent content in Gradient Descent on SailingDataLakesHugo -- gohugo.ioenSat, 04 Jul 2026 00:00:00 +0000https://sailingdatalakes.com/posts/gradient-descent/Sat, 04 Jul 2026 00:00:00 +0000https://sailingdatalakes.com/posts/gradient-descent/Purpose Link to heading In linear regression, we were able to solve for the optimal parameters directly, in closed form, using ordinary least squares. Most models we care about don’t afford us that luxury. Gradient descent is the general purpose optimization algorithm that lets us fit a model’s parameters iteratively, whenever we can’t (or don’t want to) solve for them directly. In this article, we’ll cover what gradient descent is, the math and algorithm behind it, and an example implementation, building on the linear regression problem to check our work against a known answer.