Unknown encoding: 65001

[PetaPetaPeta]

I am attempting to run docker-compose.exe from Windows in BashOnWindows. Specifically I am running docker-compose.exe --version to verify that it can correctly output data. When doing this I am receiving the following error:

~ # docker-compose.exe --version                                                                                                                                                                                                  
Traceback (most recent call last):
  File "docker-compose", line 3, in <module>
  File "compose\cli\main.py", line 66, in main
  File "compose\cli\main.py", line 98, in dispatch
  File "compose\cli\docopt_command.py", line 25, in parse
  File "compose\cli\docopt_command.py", line 12, in docopt_full_help
  File "site-packages\docopt.py", line 575, in docopt
  File "site-packages\docopt.py", line 484, in extras
LookupError: unknown encoding: cp65001
Failed to execute script docker-compose
------------------------------------------------------------

I can see that codepage 65001 is the Windows codepage for UTF-8 encoding, but that this is not supported in Unix systems. A solution to this is to run the command chcp.com 437 to change to a different codepage. This solution is however not good as it removes the support for UTF-8 in the terminal.
The issue should be persistent across different Windows applications that attempt to output any text in encoding 65001.

Windows build number: Microsoft Windows [Version 10.0.15063]

[sunjoong]

This looks like python problem in Windows side; See http://stackoverflow.com/questions/35176270/python-2-7-lookuperror-unknown-encoding-cp65001 and http://stackoverflow.com/questions/878972/windows-cmd-encoding-change-causes-python-crash .

[sgtoj]

Now that we understand the problem is encoding related. I am not sure if this an issue with the Windows Console, WSL, Python, or Docker Compose (which is compiled Py 2/3 code)?

[CherryDT]

This issue also causes display issues with Windows programs run from within bash.

See missing/incorrect umlauts below:

My codepage is 850, but the inner cmd.exe's (ran from bash) is 65001.

Running chcp 850 in the inner cmd fixes it.

What is strange though is the following, why is it like that?

• Open cmd
  • Run chcp - output: 850
  • Run bash
    • Run cmd.exe /c chcp - output: 65001 (expected because of this issue, albeit not good)
    • Run cmd.exe
      • Run chcp - output: 65001 (expected)
      • Run chcp 437
      • Run chcp - output: 437 (expected)
      • Run exit (back to bash)
    • Run cmd.exe /c chcp - output: 437 (why did the chcp inside the Windows child process have an effect on future child processes spawned by its Linux parent?)
    • Run exit (back to outer cmd)
  • Run chcp - output: 850 (looking at the previous 437 output, why is it not changed here as well?)

[sgtoj]

Oddly, it says cmd.exe doesn't exists on Windows 10.0.16179.

[sunjoong]

@sgtoj - cmd.exe shoud exist, but stragne if not exist!! Check with ls command; "ls /mnt/c/Windows/System32/cmd.exe".

[PetaPetaPeta]

@sgtoj From my investigations the issue is that the Python installed in WSL does not support the code page 65001. You can see this if you dig around a bit in /usr/lib/python2.7/encodings/.

I am using cmder and the program can be run in the same terminal if I set it to use powershell. It is thus not isolated to docker-compose and I suspect it will be like this for any program that is compiled using codepage 65001.
That leaves it to whether it is a thing that should be supported in WSL. My opinion on this matter is that it should as one of the features of WSL is running Windows programs in bash.

[MZAWeb]

+1 here with the same issue

[sunjoong]

From my investigations the issue is that the Python installed in WSL does not support the code page 65001.

@PetaPetaPeta - No. Python within docker-compose does not support code page 65001 makes this problem, not python in WSL.
@MZAWeb - Command after cmd.exe /C chcp 437 or other code page.

[BennettStaley]

+1 here with the same issue. Cant compose anything.

[sunjoong]

I had shown you can run docker-compose.exe --version on WSL on the previous comment. I'm not a docker user, so I did not go further, but I'm curious that works for you and why you do not use https://github.com/docker/compose/releases/download/1.14.0/docker-compose-Linux-x86_64 .

[wclr]

I run such thing using custom linux executables that contain code like this:
cmd.exe /c "chcp 850 >> nul && docker-compose $@"

The same thing goed for multipe python based apps

[wclr]

Yes, was mistype, thanks.