Lint error: hGetContents: invalid argument (invalid byte sequence) (Win10 + Atom)

[andregpss]

HIE is not working.

When i open an ".hs" file on Atom, the following error happens:

lint: C:\Users\Gostavo\AppData\Local\Temp\haskell-lsp15648\ComponentsMonitor.hs-00000-1623753167.hs: hGetContents: invalid argument (invalid byte sequence)

When i open the same project on VS Code, the error is:

The Haskell HIE (FirmMT) server crashed 5 times in the last

On HIE log, the last lines are:

2020-01-06 17:58:15.1511117 [ThreadId 3] - ---> {"jsonrpc":"2.0","id":6,"method":"textDocument/hover","params":{"textDocument":{"uri":"file:///C:/Users/Gostavo/Dropbox/MyP/src/Configuration/ComponentsMonitor.hs"},"position":{"line":0,"character":19}}}
2020-01-06 17:58:15.1511117 [ThreadId 31] - ****** reactor: got message number:13
2020-01-06 17:58:15.1511117 [ThreadId 31] - reactor:got HoverRequest:RequestMessage {_jsonrpc = "2.0", _id = IdInt 6, _method = TextDocumentHover, _params = TextDocumentPositionParams {_textDocument = TextDocumentIdentifier {_uri = Uri {getUri = "file:///C:/Users/Gostavo/Dropbox/MyP/src/Configuration/ComponentsMonitor.hs"}}, _position = Position {_line = 0, _character = 19}, _workDoneToken = Nothing}}
2020-01-06 17:58:15.1521097 [ThreadId 31] - reactor:HoverRequest done
2020-01-06 17:58:15.1521097 [ThreadId 37] - ideDispatcher: got request 13 with id: IdInt 6
2020-01-06 17:58:15.1521097 [ThreadId 31] - ****** reactor: top of loop
2020-01-06 17:58:15.1531533 [ThreadId 37] - newTypeCmd: (Position {_line = 0, _character = 19},Uri {getUri = "file:///C:/Users/Gostavo/Dropbox/MyP/src/Configuration/ComponentsMonitor.hs"})
2020-01-06 17:58:15.1571106 [ThreadId 37] - ideDispatcher: top of loop
2020-01-06 17:58:15.1571106 [ThreadId 4] - <--2--{"result":{"contents":{"kind":"markdown","value":""}},"jsonrpc":"2.0","id":6}
2020-01-06 17:58:18.4547533 [ThreadId 3] - ---> {"jsonrpc":"2.0","method":"textDocument/didClose","params":{"textDocument":{"uri":"file:///C:/Users/Gostavo/Dropbox/MyP/src/Configuration/ComponentsMonitor.hs"}}}
2020-01-06 17:58:18.4547533 [ThreadId 3] - Closed: Uri {getUri = "file:///C:/Users/Gostavo/Dropbox/MyP/src/Configuration/ComponentsMonitor.hs"}
2020-01-06 17:58:18.4557512 [ThreadId 3] - ---> {"jsonrpc":"2.0","id":7,"method":"shutdown","params":null}
2020-01-06 17:58:18.4557512 [ThreadId 31] - ****** reactor: got message number:14
2020-01-06 17:58:18.4557512 [ThreadId 31] - ****** reactor: processing NotDidCloseTextDocument
2020-01-06 17:58:18.4557512 [ThreadId 31] - ****** reactor: top of loop
2020-01-06 17:58:18.4557512 [ThreadId 4] - <--2--{"result":null,"jsonrpc":"2.0","id":7}
2020-01-06 17:58:18.4557512 [ThreadId 36] - ghcDispatcher:got request 14 with id: Nothing

I am using Atom 1.42.0 on Windows 10.

[fendor]

@andregpss All logs would be more interesting to see if some thread crashed, whether you were using stack or cabal, etc...
Does your file contain any unicode characters, maybe?

[andregpss]

@fendor I do not know whats happening, but when i openned Atom again, the error message changed.
The error now is:

"gcc.exe' failed in phase C pre-processor'. (Exit code: 1)"

Here it goes the full HIE log:
hie.log

[jneira]

When i open the same project on VS Code, the error is:

The Haskell HIE (FirmMT) server crashed 5 times in the last...

There is a bug in the vscode extension prior to 0.34 so i would recommend to update it.

[andregpss]

There is a bug in the vscode extension prior to 0.34 so i would recommend to update it.

@jneira I am already using 0.34 version of Haskell Language Server extension on VS Code.

The error messages on VS Code are now the same as those that appear in Atom:

• Got error while processing diagnostics: gcc.exe' failed in phase C pre-processor'. (Exit code: 1)

• lint: C:\Users\Gostavo\AppData\Local\Temp\haskell-lsp14376\ServerMain.hs-00000-643698865.hs: hGetContents: invalid argument (invalid byte sequence)

Does your file contain any unicode characters, maybe?

@fendor I do not think i am using unicode characters. That message pops up for every hs files i open.

[fendor]

Weird, can you share the project? The error message is unfortunately not very helpful.
EDIT: Maybe a subset of the project, if it is confedential? Or does any stack project yield this behaviour for you?

[andregpss]

EDIT: Maybe a subset of the project, if it is confedential? Or does any stack project yield this behaviour for you?

My project is relatively confidential.

I also installed HIE on Ubuntu Linux using Windows Subsystem, but the error persists.
I used the following tutorial: http://marco-lopes.com/articles/Vim-and-Haskell-in-2019/
Here it goes an screenshot (the error is on the bottom):

[fendor]

In the comment there is some non-ascii character é.
While hie should not crash on that, would you mind trying to remove that character, and any other such character in the comments?

[andregpss]

While hie should not crash on that, would you mind trying to remove that character, and any other such character in the comments?

I removed the é character but the error persists.

I openned now a very simple code file, but HIE still did not work.
Here is the screenshot:

[fendor]

Ok, I tried myself on windows 10, latest master, hie 8.6.5:

module Marshaller where 

import Data.Binary (decode, encode, Binary)
import Data.ByteString (ByteString)
import Data.ByteString.Lazy (fromStrict, toStrict)

marshall :: Binary a => a -> [ByteString]
marshall d = [(toStrict . encode) d]

unmarshall :: Binary a => [ByteString] -> a
unmarshall = decode . fromStrict . head

And everything seems to work, although there are some suspicous log messages.

Well, some semi-random debug ideas: would you mind trying to use cabal? You are using cabal if you add a cabal.project file and have cabal installed. Is the problem still the same?

Can you run hie in debug mode, e.g. hie --lsp --debug instead of only hie --lsp?

If your project is simple enough (only one exe and lib), you can also try the explicit project configuration, to do that, add a file named hie.yaml to your porject root with the contents:

cradle:
  stack:

Or, more complex:

cradle:
  stack:
    component: "project:lib"

Where project:lib is the library component of your project. You can find the available components with stack ide targets.

Last idea, not sure if it is important, did you maybe install hie over WSL and are using it without WSL?

[andregpss]

I openned an hs file external to my project and HIE worked! It really is an amazing tool! It was on neo-vim over WSL.
But the error continues with files from my project.
So, i think the problem is really with the configuration of my project.

Well, some semi-random debug ideas: would you mind trying to use cabal? You are using cabal if you add a cabal.project file and have cabal installed. Is the problem still the same?

I have a .cabal file, but not a cabal.project. Is it really necessary? How can i create it?

Can you run hie in debug mode, e.g. hie --lsp --debug instead of only hie --lsp?

How can i do that on linux with neo-vim?

add a file named hie.yaml to your porject root

Is it really necessary when using a .cabal file?

did you maybe install hie over WSL and are using it without WSL?

I have two scenarios on the same computer:

1. Over WSL: hie on neo-vim
2. Without WSL: hie on Atom

Here is the .cabal and the stack.yaml files i use on my project:
Proje.zip

[fendor]

I have a .cabal file, but not a cabal.project. Is it really necessary? How can i create it?

That or delete your local stack.yaml. Just something like echo "packages: ./" > cabal.project is enough, iirc.

Can you run hie in debug mode, e.g. hie --lsp --debug instead of only hie --lsp?

I dont know, sorry, not using neovim :(

Is it really necessary when using a .cabal file?

It is not, it is an experiment.

I have two scenarios on the same computer:

Ok, so probably not the culprit.

[fendor]

Are you maybe running into #1519?
Try to build your project by hand before opening it.

[andregpss]

HIE now works on my project, using Neo Vim on Ubuntu+WSL!
I noticed that Coc plugin configuration was different between the tutorial mentioned above and HIE README.md. I was using the tutorial version.
I noticed that on rootPatterns section, there was not *.cabal. When i put it, HIE worked! My packages are all declared on a Cabal file.
As also mentioned by @fendor , the project must have been build.
Almost everything works fine, except for the LanguageClient-neovim plugin, but i think this is another issue.
I am going to continue to try to make HIE work on Atom to answer the main issue.