https://mooseframework.inl.gov
Public Member Functions | Public Attributes | List of all members
StochasticTools::GaussianProcess::GPOptimizerOptions Struct Reference

Structure containing the optimization options for hyperparameter-tuning. More...

#include <GaussianProcess.h>

Public Member Functions

 GPOptimizerOptions (const unsigned int show_every_nth_iteration=0, const unsigned int num_iter=1000, const unsigned int batch_size=0, const Real learning_rate=1e-3, const Real b1=0.9, const Real b2=0.999, const Real eps=1e-7, const Real lambda=1e-4, const OptimizerType optimizer_type=OptimizerType::Adam)
 Construct a new GPOptimizerOptions object using input parameters that will control the optimization. More...
 

Public Attributes

const unsigned int show_every_nth_iteration = 0
 Switch to enable verbose output for parameter tuning at every n-th iteration. More...
 
const unsigned int num_iter = 1000
 The number of iterations for Adam optimizer. More...
 
const unsigned int batch_size = 0
 The batch size for Adam optimizer. More...
 
const Real learning_rate = 1e-3
 The learning rate for Adam optimizer. More...
 
const Real b1 = 0.9
 Tuning parameter from the paper. More...
 
const Real b2 = 0.999
 Tuning parameter from the paper. More...
 
const Real eps = 1e-7
 Tuning parameter from the paper. More...
 
const Real lambda = 1e-4
 Legacy MOOSE shrink parameter. More...
 
const OptimizerType optimizer_type = OptimizerType::Adam
 Adam optimizer mode to use. More...
 

Detailed Description

Structure containing the optimization options for hyperparameter-tuning.

Definition at line 57 of file GaussianProcess.h.

Constructor & Destructor Documentation

◆ GPOptimizerOptions()

StochasticTools::GaussianProcess::GPOptimizerOptions::GPOptimizerOptions ( const unsigned int  show_every_nth_iteration = 0,
const unsigned int  num_iter = 1000,
const unsigned int  batch_size = 0,
const Real  learning_rate = 1e-3,
const Real  b1 = 0.9,
const Real  b2 = 0.999,
const Real  eps = 1e-7,
const Real  lambda = 1e-4,
const OptimizerType  optimizer_type = OptimizerType::Adam 
)

Construct a new GPOptimizerOptions object using input parameters that will control the optimization.

Parameters
show_every_nth_iterationTo show the loss value at every n-th iteration, if set to 0, nothing is displayed
num_iterThe number of iterations we want in the optimization of the GP
batch_sizeThe number of samples in each batch
learning_rateThe learning rate for parameter updates
b1Tuning constant for the Adam algorithm
b2Tuning constant for the Adam algorithm
epsTuning constant for the Adam algorithm
lambdaLegacy MOOSE shrink constant for the Adam algorithm
optimizer_typeThe Adam optimizer mode to use

Definition at line 108 of file GaussianProcess.C.

121  b1(b1),
122  b2(b2),
123  eps(eps),
124  lambda(lambda),
126 {
127 }
const Real lambda
Legacy MOOSE shrink parameter.
const unsigned int show_every_nth_iteration
Switch to enable verbose output for parameter tuning at every n-th iteration.
const Real eps
Tuning parameter from the paper.
const unsigned int batch_size
The batch size for Adam optimizer.
const Real b2
Tuning parameter from the paper.
const OptimizerType optimizer_type
Adam optimizer mode to use.
const Real b1
Tuning parameter from the paper.
const unsigned int num_iter
The number of iterations for Adam optimizer.
const Real learning_rate
The learning rate for Adam optimizer.

Member Data Documentation

◆ b1

const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b1 = 0.9

Tuning parameter from the paper.

Definition at line 92 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ b2

const Real StochasticTools::GaussianProcess::GPOptimizerOptions::b2 = 0.999

Tuning parameter from the paper.

Definition at line 94 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ batch_size

const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::batch_size = 0

The batch size for Adam optimizer.

Definition at line 88 of file GaussianProcess.h.

Referenced by GaussianProcessTrainer::GaussianProcessTrainer(), and StochasticTools::GaussianProcess::setupCovarianceMatrix().

◆ eps

const Real StochasticTools::GaussianProcess::GPOptimizerOptions::eps = 1e-7

Tuning parameter from the paper.

Definition at line 96 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ lambda

const Real StochasticTools::GaussianProcess::GPOptimizerOptions::lambda = 1e-4

Legacy MOOSE shrink parameter.

Definition at line 98 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ learning_rate

const Real StochasticTools::GaussianProcess::GPOptimizerOptions::learning_rate = 1e-3

The learning rate for Adam optimizer.

Definition at line 90 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ num_iter

const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::num_iter = 1000

The number of iterations for Adam optimizer.

Definition at line 86 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ optimizer_type

const OptimizerType StochasticTools::GaussianProcess::GPOptimizerOptions::optimizer_type = OptimizerType::Adam

Adam optimizer mode to use.

Definition at line 100 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().

◆ show_every_nth_iteration

const unsigned int StochasticTools::GaussianProcess::GPOptimizerOptions::show_every_nth_iteration = 0

Switch to enable verbose output for parameter tuning at every n-th iteration.

Definition at line 84 of file GaussianProcess.h.

Referenced by StochasticTools::GaussianProcess::tuneHyperParamsAdam().


The documentation for this struct was generated from the following files: