Step size adaptation based on the success of the new population compared to the old. More...
#include <shark/Algorithms/DirectSearch/Operators/TwoPointStepSizeAdaptation.h>
Public Member Functions  
TwoPointStepSizeAdaptation ()  
double  stepSize () const 
void  setAlphaStep (double alphaStep) 
void  setLearningRate (double learningRate) 
void  init (double initialStepSize) 
Initializes a new trial by setting the initial step size and resetting the internal values. More...  
void  setStepSize (double stepSize) 
void  update (SingleObjectiveFunction const &f, RealVector const &point, RealVector const &direction) 
updates the step size using the newly sampled population More...  
Step size adaptation based on the success of the new population compared to the old.
This is the step size adaptation algorithm as proposed in Ilya Loshchilov, "A Computationally Efficient Limited Memory CMAES for Large Scale Optimization"
It ranks the old and new population together and checks whether the mean rank of the new population is lower than the old one in this combined population. If this is true, the step size is increased in an exponential fashion. More formally, let \( r_t(i) \) be the rank of the ith individual in the current population in the combined ranking and \( r_{t1}(i) \) the rank of the ith previous individual. Then we have
\[ z_t \leftarrow \frac 1 {\lamba^2} \sum_i^{\lambda} r_{t1}(i)  r_t(i)  z*\]
where \( z* \) is a target success value, which defaults to 0.25 this statistic is stabilised using an exponential average:
\[ s_t \leftarrow (1c)*s_{t1} + c*z_t \]
where the learning rate c defaults to 0.3 finally we adapt the step size sigma by
\[ \sigma_t = \sigma_{t1} exp(s_t/d) \]
where the damping factor d defaults to 1
Definition at line 53 of file TwoPointStepSizeAdaptation.h.

inline 
Definition at line 55 of file TwoPointStepSizeAdaptation.h.

inline 
Initializes a new trial by setting the initial step size and resetting the internal values.
Definition at line 70 of file TwoPointStepSizeAdaptation.h.

inline 
Definition at line 61 of file TwoPointStepSizeAdaptation.h.

inline 
Definition at line 65 of file TwoPointStepSizeAdaptation.h.

inline 
Definition at line 75 of file TwoPointStepSizeAdaptation.h.
References stepSize().

inline 
Definition at line 57 of file TwoPointStepSizeAdaptation.h.
Referenced by setStepSize().

inline 
updates the step size using the newly sampled population
The offspring is assumed to be ordered in ascending order by their penalizedFitness (this is the same as ordering by the unpenalized fitness in an unconstrained setting)
Definition at line 83 of file TwoPointStepSizeAdaptation.h.
References shark::AbstractObjectiveFunction< PointType, ResultT >::eval().