In pull request #2509 when using the RemoveControllerReference the function checks if ann owner exists but only removes the owner passed in which may not be the owner reference with controlled = true.
Update the function to ensure that the owner is in fact the controller reference to be removed.
/kind bug
/assign @troy0820