Structure containing the optimization options for hyperparameter-tuning. More...
#include <GaussianProcess.h>
Public Member Functions | |
GPOptimizerOptions () | |
Default constructor. More... | |
GPOptimizerOptions (const bool show_every_nth_iteration=1, const unsigned int num_iter=1000, const unsigned int batch_size=0, const Real learning_rate=1e-3, const Real b1=0.9, const Real b2=0.999, const Real eps=1e-7, const Real lambda=0.0) | |
Construct a new GPOptimizerOptions object using input parameters that will control the optimization. More... | |
Public Attributes | |
const unsigned int | show_every_nth_iteration = false |
Switch to enable verbose output for parameter tuning at every n-th iteration. More... | |
const unsigned int | num_iter = 1000 |
The number of iterations for Adam optimizer. More... | |
const unsigned int | batch_size = 0 |
The batch isize for Adam optimizer. More... | |
const Real | learning_rate = 1e-3 |
The learning rate for Adam optimizer. More... | |
const Real | b1 = 0.9 |
Tuning parameter from the paper. More... | |
const Real | b2 = 0.999 |
Tuning parameter from the paper. More... | |
const Real | eps = 1e-7 |
Tuning parameter from the paper. More... | |
const Real | lambda = 0.0 |
Tuning parameter from the paper. More... | |
Structure containing the optimization options for hyperparameter-tuning.
Definition at line 47 of file GaussianProcess.h.
StochasticTools::GaussianProcess::GPOptimizerOptions::GPOptimizerOptions | ( | ) |
Default constructor.
StochasticTools::GaussianProcess::GPOptimizerOptions::GPOptimizerOptions | ( | const bool | show_every_nth_iteration = 1 , |
const unsigned int | num_iter = 1000 , |
||
const unsigned int | batch_size = 0 , |
||
const Real | learning_rate = 1e-3 , |
||
const Real | b1 = 0.9 , |
||
const Real | b2 = 0.999 , |
||
const Real | eps = 1e-7 , |
||
const Real | lambda = 0.0 |
||
) |
Construct a new GPOptimizerOptions object using input parameters that will control the optimization.
show_every_nth_iteration | To show the loss value at every n-th iteration, if set to 0, nothing is displayed |
num_iter | The number of iterations we want in the optimization of the GP |
batch_size | The number of samples in each batch |
learning_rate | The learning rate for parameter updates |
b1 | Tuning constant for the Adam algorithm |
b2 | Tuning constant for the Adam algorithm |
eps | Tuning constant for the Adam algorithm |
lambda | Tuning constant for the Adam algorithm |
Definition at line 27 of file GaussianProcess.C.
const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b1 = 0.9 |
Tuning parameter from the paper.
Definition at line 82 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b2 = 0.999 |
Tuning parameter from the paper.
Definition at line 84 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::batch_size = 0 |
The batch isize for Adam optimizer.
Definition at line 78 of file GaussianProcess.h.
Referenced by GaussianProcessTrainer::GaussianProcessTrainer(), and StochasticTools::GaussianProcess::setupCovarianceMatrix().
const Real StochasticTools::GaussianProcess::GPOptimizerOptions::eps = 1e-7 |
Tuning parameter from the paper.
Definition at line 86 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
const Real StochasticTools::GaussianProcess::GPOptimizerOptions::lambda = 0.0 |
Tuning parameter from the paper.
Definition at line 88 of file GaussianProcess.h.
const Real StochasticTools::GaussianProcess::GPOptimizerOptions::learning_rate = 1e-3 |
The learning rate for Adam optimizer.
Definition at line 80 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::num_iter = 1000 |
The number of iterations for Adam optimizer.
Definition at line 76 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::show_every_nth_iteration = false |
Switch to enable verbose output for parameter tuning at every n-th iteration.
Definition at line 74 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().