Adamw

AdamW optimizer implementation.

nabla.nn.optim.adamw.init_adamw_state(params)

Initialize AdamW optimizer state.

Parameters:

params (list[Array]) – List of parameter arrays

Returns:

Tuple of (m_states, v_states) - first and second moment estimates

Return type:

tuple[list[Array], list[Array]]