Structure containing the optimization options for hyperparameter-tuning. More...
#include <GaussianProcess.h>
Public Member Functions | |
| GPOptimizerOptions () | |
| Default constructor. More... | |
| GPOptimizerOptions (const bool show_every_nth_iteration=1, const unsigned int num_iter=1000, const unsigned int batch_size=0, const Real learning_rate=1e-3, const Real b1=0.9, const Real b2=0.999, const Real eps=1e-7, const Real lambda=0.0) | |
| Construct a new GPOptimizerOptions object using input parameters that will control the optimization. More... | |
Public Attributes | |
| const unsigned int | show_every_nth_iteration = false |
| Switch to enable verbose output for parameter tuning at every n-th iteration. More... | |
| const unsigned int | num_iter = 1000 |
| The number of iterations for Adam optimizer. More... | |
| const unsigned int | batch_size = 0 |
| The batch isize for Adam optimizer. More... | |
| const Real | learning_rate = 1e-3 |
| The learning rate for Adam optimizer. More... | |
| const Real | b1 = 0.9 |
| Tuning parameter from the paper. More... | |
| const Real | b2 = 0.999 |
| Tuning parameter from the paper. More... | |
| const Real | eps = 1e-7 |
| Tuning parameter from the paper. More... | |
| const Real | lambda = 0.0 |
| Tuning parameter from the paper. More... | |
Structure containing the optimization options for hyperparameter-tuning.
Definition at line 47 of file GaussianProcess.h.
| StochasticTools::GaussianProcess::GPOptimizerOptions::GPOptimizerOptions | ( | ) |
Default constructor.
| StochasticTools::GaussianProcess::GPOptimizerOptions::GPOptimizerOptions | ( | const bool | show_every_nth_iteration = 1, |
| const unsigned int | num_iter = 1000, |
||
| const unsigned int | batch_size = 0, |
||
| const Real | learning_rate = 1e-3, |
||
| const Real | b1 = 0.9, |
||
| const Real | b2 = 0.999, |
||
| const Real | eps = 1e-7, |
||
| const Real | lambda = 0.0 |
||
| ) |
Construct a new GPOptimizerOptions object using input parameters that will control the optimization.
| show_every_nth_iteration | To show the loss value at every n-th iteration, if set to 0, nothing is displayed |
| num_iter | The number of iterations we want in the optimization of the GP |
| batch_size | The number of samples in each batch |
| learning_rate | The learning rate for parameter updates |
| b1 | Tuning constant for the Adam algorithm |
| b2 | Tuning constant for the Adam algorithm |
| eps | Tuning constant for the Adam algorithm |
| lambda | Tuning constant for the Adam algorithm |
Definition at line 27 of file GaussianProcess.C.
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b1 = 0.9 |
Tuning parameter from the paper.
Definition at line 82 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b2 = 0.999 |
Tuning parameter from the paper.
Definition at line 84 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::batch_size = 0 |
The batch isize for Adam optimizer.
Definition at line 78 of file GaussianProcess.h.
Referenced by GaussianProcessTrainer::GaussianProcessTrainer(), and StochasticTools::GaussianProcess::setupCovarianceMatrix().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::eps = 1e-7 |
Tuning parameter from the paper.
Definition at line 86 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::lambda = 0.0 |
Tuning parameter from the paper.
Definition at line 88 of file GaussianProcess.h.
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::learning_rate = 1e-3 |
The learning rate for Adam optimizer.
Definition at line 80 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::num_iter = 1000 |
The number of iterations for Adam optimizer.
Definition at line 76 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::show_every_nth_iteration = false |
Switch to enable verbose output for parameter tuning at every n-th iteration.
Definition at line 74 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
1.8.14