Structure containing the optimization options for hyperparameter-tuning. More...
#include <GaussianProcess.h>
Public Member Functions | |
| GPOptimizerOptions (const unsigned int show_every_nth_iteration=0, const unsigned int num_iter=1000, const unsigned int batch_size=0, const Real learning_rate=1e-3, const Real b1=0.9, const Real b2=0.999, const Real eps=1e-7, const Real lambda=1e-4, const OptimizerType optimizer_type=OptimizerType::Adam) | |
| Construct a new GPOptimizerOptions object using input parameters that will control the optimization. More... | |
Public Attributes | |
| const unsigned int | show_every_nth_iteration = 0 |
| Switch to enable verbose output for parameter tuning at every n-th iteration. More... | |
| const unsigned int | num_iter = 1000 |
| The number of iterations for Adam optimizer. More... | |
| const unsigned int | batch_size = 0 |
| The batch size for Adam optimizer. More... | |
| const Real | learning_rate = 1e-3 |
| The learning rate for Adam optimizer. More... | |
| const Real | b1 = 0.9 |
| Tuning parameter from the paper. More... | |
| const Real | b2 = 0.999 |
| Tuning parameter from the paper. More... | |
| const Real | eps = 1e-7 |
| Tuning parameter from the paper. More... | |
| const Real | lambda = 1e-4 |
| Legacy MOOSE shrink parameter. More... | |
| const OptimizerType | optimizer_type = OptimizerType::Adam |
| Adam optimizer mode to use. More... | |
Structure containing the optimization options for hyperparameter-tuning.
Definition at line 57 of file GaussianProcess.h.
| StochasticTools::GaussianProcess::GPOptimizerOptions::GPOptimizerOptions | ( | const unsigned int | show_every_nth_iteration = 0, |
| const unsigned int | num_iter = 1000, |
||
| const unsigned int | batch_size = 0, |
||
| const Real | learning_rate = 1e-3, |
||
| const Real | b1 = 0.9, |
||
| const Real | b2 = 0.999, |
||
| const Real | eps = 1e-7, |
||
| const Real | lambda = 1e-4, |
||
| const OptimizerType | optimizer_type = OptimizerType::Adam |
||
| ) |
Construct a new GPOptimizerOptions object using input parameters that will control the optimization.
| show_every_nth_iteration | To show the loss value at every n-th iteration, if set to 0, nothing is displayed |
| num_iter | The number of iterations we want in the optimization of the GP |
| batch_size | The number of samples in each batch |
| learning_rate | The learning rate for parameter updates |
| b1 | Tuning constant for the Adam algorithm |
| b2 | Tuning constant for the Adam algorithm |
| eps | Tuning constant for the Adam algorithm |
| lambda | Legacy MOOSE shrink constant for the Adam algorithm |
| optimizer_type | The Adam optimizer mode to use |
Definition at line 108 of file GaussianProcess.C.
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b1 = 0.9 |
Tuning parameter from the paper.
Definition at line 92 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b2 = 0.999 |
Tuning parameter from the paper.
Definition at line 94 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::batch_size = 0 |
The batch size for Adam optimizer.
Definition at line 88 of file GaussianProcess.h.
Referenced by GaussianProcessTrainer::GaussianProcessTrainer(), and StochasticTools::GaussianProcess::setupCovarianceMatrix().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::eps = 1e-7 |
Tuning parameter from the paper.
Definition at line 96 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::lambda = 1e-4 |
Legacy MOOSE shrink parameter.
Definition at line 98 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const Real StochasticTools::GaussianProcess::GPOptimizerOptions::learning_rate = 1e-3 |
The learning rate for Adam optimizer.
Definition at line 90 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::num_iter = 1000 |
The number of iterations for Adam optimizer.
Definition at line 86 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const OptimizerType StochasticTools::GaussianProcess::GPOptimizerOptions::optimizer_type = OptimizerType::Adam |
Adam optimizer mode to use.
Definition at line 100 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
| const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::show_every_nth_iteration = 0 |
Switch to enable verbose output for parameter tuning at every n-th iteration.
Definition at line 84 of file GaussianProcess.h.
Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().
1.8.14