step_functions

This is summary documentation for hippynn.experiment.step_functions module. Click here for full documentation.

Links to Full Documentation:

This file implements various stepping protocols used by different optimizer APIs.

In particular:

  • The “standard” step function which only requires that backwards has been called.

  • The “closure” step function for when line search is required (currently only active on LBFGS)

  • The “two step” style of Sharpness Aware Minimization algorithms

The main output function here is get_step_function(optimizer)-> callable.

The various step functions are provided as classes that act with staticmethods. This is to provide for the possibility of extension, for example, to schemes with stepping schemes that require additional state, or for the possibility to specifiy the step function explicitly within the controller.

Functions

closure_step_fn(optimizer, model, loss, ...)

get_step_function(optimizer)

standard_step_fn(optimizer, model, loss, ...)

twostep_step_fn(optimizer, model, loss, ...)

Classes

ClosureStep()

StandardStep()

StepFn()

TwoStep()