tiny_dnn::momentum Struct Reference

SGD with momentum. More...

#include <optimizer.h>

Inheritance diagram for tiny_dnn::momentum:

Collaboration diagram for tiny_dnn::momentum:

Public Member Functions
void	update (const vec_t &dW, vec_t &W, bool parallelize)
Public Member Functions inherited from tiny_dnn::stateful_optimizer< 1 >
void	reset () override
Public Member Functions inherited from tiny_dnn::optimizer
	optimizer (const optimizer &)=default
	optimizer (optimizer &&)=default
optimizer &	operator= (const optimizer &)=default
optimizer &	operator= (optimizer &&)=default

Public Attributes
float_t	alpha
float_t	lambda
float_t	mu

Additional Inherited Members
Protected Member Functions inherited from tiny_dnn::stateful_optimizer< 1 >
vec_t &	get (const vec_t &key)
Protected Attributes inherited from tiny_dnn::stateful_optimizer< 1 >
std::unordered_map< const vec_t *, vec_t >	E_ [N]

Detailed Description

SGD with momentum.

B T Polyak, Some methods of speeding up the convergence of iteration methods USSR Computational Mathematics and Mathematical Physics, 4(5):1-17, 1964.

Member Function Documentation

update()

void tiny_dnn::momentum::update ( const vec_t &  dW, vec_t &  W, bool  parallelize  )

inlinevirtual

Implements tiny_dnn::optimizer.

---

The documentation for this struct was generated from the following file:

• tiny_dnn/optimizers/optimizer.h