Home → Problems →

utf-8 characters in powershell log

• Edit

Steven Vachon

21 Nov, 2014 04:04 AM

cmd.exe's log displays them fine, but powershell does not.

Compare the two in this log: https://ci.appveyor.com/project/stevenvachon/nopter/build/job/qk06x...
The first is powershell and the checkmark character (√) is displayed as √.

This is a minor issue in my case, but it may not be so for others. Perhaps it is my fault for not configuring properly?: https://github.com/stevenvachon/nopter/blob/master/appveyor.yml

1. Support Staff 1 Posted by Feodor Fitsner on 21 Nov, 2014 04:34 AM

   

   I'm afraid this is PowerShell issue.

   From what I've found there is no way to set encoding for process output redirection:
   https://connect.microsoft.com/PowerShell/feedback/details/738558/se...
   http://stackoverflow.com/questions/22349139/utf8-output-from-powers...

   • Edit

2. 2 Posted by Cameron Taggart on 15 Apr, 2015 03:41 AM

   

   The characters that are showing up appear to be UTF8 bytes encoded using CodePage 437. Specifically the example listed in http://www.appveyor.com/docs/lang/nodejs-iojs can be reproduced with this F#:

   let s = "├──"
   let utf8 = System.Text.Encoding.UTF8
   let ibm437 = System.Text.Encoding.GetEncoding 437
   printfn "%s" (utf8.GetBytes s |> ibm437.GetString)

   Not surprising, that is the default Console.OutputEncoding in PowerShell.

   For completeness, the other code pages that matched the error text were 861 and 865, but I bet it is probably 437.

   If you want to email me how you are launching PowerShell, I can try out fixes for it. I just need a locally reproducible test case.

   • Screen_Shot_2015-04-14_at_8.36.16_PM.png 21.3 KB
   • Screen_Shot_2015-04-14_at_8.37.44_PM.png 22.7 KB
   • Edit

3. Support Staff 3 Posted by Feodor Fitsner on 15 Apr, 2015 04:33 AM

   

   Sure, AppVeyor implements custom PowerShell host with UI, something like that:
   https://msdn.microsoft.com/en-us/library/ee706570(v=vs.85).aspx

   However, there is a trick when running some external process in that sample - if the process has a handle to the console all output will be redirected right to the console and won't be caught by Write methods. Use Windows forms or WPF app to host your custom PS host to suppress console output.

   If you can solve that puzzle that would be awesome! :)

   • Edit

4. 4 Posted by Cameron Taggart on 15 Apr, 2015 06:11 PM

   

   I put that code in a solution that builds here:
   https://github.com/ctaggart/AppVeyor

   The next steps are to reproduce the issue locally. Help with that in the form of a pull request would be very welcome. I will also try again when I get through a few other higher priority issues. :)

   • Edit

5. Support Staff 5 Posted by Feodor Fitsner on 15 Apr, 2015 06:22 PM

   

   yeah, the host should be not a console app, but windows forms or WPF.

   • Edit

6. Ilya Finkelshteyn closed this discussion on 25 Aug, 2018 01:55 AM.