Now that Beam is making great progress on python3 support, we should update our code to be python3 compatible as well. Once Beam is done with the migration, we can see whether we can run the unit + integration tests in python3.
See:
https://issues.apache.org/jira/browse/BEAM-1251
and https://s.apache.org/beam-python-3