jax_sgmc.scheduler.cyclic_temperature

jax_sgmc.scheduler.cyclic_temperature(beta=1.0, k=1)[source]

Cyclic switch of the temperature between 0.0 and 1.0.

Switches temperature form 0.0 (SGD) to 1.0 (SGLD) when ratio of initial step size and current step size drops below beta. This scheduler is intended to be used with the cyclic step size scheduler.

Parameters:

  • beta (Array) – Ratio of current step size to initial step size when transition to SGLD

  • k (int) – Number of cycles

Return type:

specific_scheduler

Returns:

Returns a triplet as described above