There are several v4 Optimizers that are based on the gradient descent optimizer, that should maintain consistent behavior before them.
IMHO, the next step to to write a test which checks/demonstrates the expected behavior. Likely this will need a mock metric class. If the test is written generically it could be used to test the other optimizers too.