Adam

Adam optimizer implementation.

nabla.nn.optim.adam.adam_step(*args)

nabla.nn.optim.adam.init_adam_state(params)

Initialize Adam optimizer states.

Parameters:

params (list[Array]) – List of parameter arrays

Returns:

Tuple of (m_states, v_states) - zero-initialized moment estimates

Return type:

tuple[list[Array], list[Array]]