Blog Directory
Top level » Machine learning » Optimization ADADELTA: An Adaptive Learning Rate Method  Matthew D. Zeiler Adaptive subgradient methods for online learning and stochastic optimization  John Duchi, Elad Hazan, Yoram Singer An overview of gradient descent optimization algorithms  Sebastian Ruder Identifying and attacking the saddle point problem in high-dimensional non-convex optimization  Razvan Pascanu, Yann N Dauphin, Surya Ganguli, Yoshua Bengio Parallel Boosting with Momentum  Indraneel Mukherjee, Kevin Canini, Rafael Frongillo, Yoram Singer