Skip to main content

Function: getLearningRate()

getLearningRate(options, iteration): number

Cosine learning-rate annealing, decaying from options.learningRate down toward (not quite) zero over options.iterations, floored at options.cosineAnnealingScale of the initial rate.

Parameters​

options​

cosineAnnealingScale​

number

iterations​

number

learningRate​

number

iteration​

number

Returns​

number