[3.12] gh-100227: Lock Around Use of the Global "atexit" State (gh-105514) (gh-105517)

The risk of a race with this state is relatively low, but we play it safe anyway.
(cherry picked from commit 7799c8e)

Co-authored-by: Eric Snow <[email protected]>

Author: miss-islington