What is the difference between gradient descent and gradient ascent?

user2714423 picture user2714423 · Mar 23, 2014 · Viewed 21.4k times · Source

I am not able to find anything about gradient ascent. Any good link about gradient ascent demonstrating how it is different from gradient descent would help.

Answer

Sean Owen picture Sean Owen · Mar 23, 2014

It is not different. Gradient ascent is just the process of maximizing, instead of minimizing, a loss function. Everything else is entirely the same. Ascent for some loss function, you could say, is like gradient descent on the negative of that loss function.