raw.githubusercontent.com gives "Server Unavailable" sporadically
Sometimes (but not always), we get errors like this one:
appveyor DownloadFile "https://raw.githubusercontent.com/symengine/dependencies/5cff7d1736877336cf9fb58267111beea4fa152f/x86_64-4.9.1-release-posix-seh-rt_v3-rev1.7z" -FileName mw64.7z
Error downloading file: The remote server returned an error: (503) Server Unavailable.
Here is a full log: https://ci.appveyor.com/project/certik/symengine/build/117/job/uiq1j1yiw7lwttkc
It is not reproducible, it only happens sometimes. But it happened already several times.
Do you know how to best debug this issue? Should we for example write a special download script, that will try to download the file several times (with some timeout)?
Another solution would be to just restart this particular build, but it seems AppVeyor only supports rebuilding the whole PR, so if the PR has 8 builds (jobs), and 7 pass, one fails due to this issue, then it is a waste to be rebuilding everything (and still risking that one of the 8 jobs will fail to download the file).
Let me know what the best way forward is.
Thanks,
Ondrej Certik
Comments are currently closed for this discussion. You can start a new one.
Keyboard shortcuts
Generic
| ? | Show this help |
|---|---|
| ESC | Blurs the current field |
Comment Form
| r | Focus the comment reply box |
|---|---|
| ^ + ↩ | Submit the comment |
You can use Command ⌘ instead of Control ^ on Mac
Support Staff 1 Posted by Feodor Fitsner on 08 Aug, 2015 02:52 PM
When did it start happening? How many times did it happen?
2 Posted by Ondřej Čertík on 08 Aug, 2015 04:18 PM
I went into our history and here are all the failures due to this:
https://ci.appveyor.com/project/certik/symengine/build/117/job/uiq1j1yiw7lwttkc
https://ci.appveyor.com/project/certik/symengine/build/110/job/5fdlk0xfhur50nh4
https://ci.appveyor.com/project/certik/symengine/build/95/job/ywlq8n1swld1kvl9
https://ci.appveyor.com/project/certik/symengine/build/92/job/0ed4p915y2ougsr8
https://ci.appveyor.com/project/certik/symengine/build/89/job/b36fxmwdk6yw573y
https://ci.appveyor.com/project/certik/symengine/build/86/job/4fjbxejh5cwapimh
https://ci.appveyor.com/project/certik/symengine/build/73/job/xknteggc3v14wh3x
There are probably more. So it's been a few weeks. It's definitely not a one time thing.
As an example of a one time thing, I found this error:
https://ci.appveyor.com/project/certik/symengine/build/105/job/14vw4i3cq6ol0tny
where the Python code failed to download something. It only happened once, so it's a one time thing. The above is very regular --- it doesn't happen every build, but it happened at least 8x (all the links above), possibly more.
Support Staff 3 Posted by Feodor Fitsner on 11 Aug, 2015 01:09 AM
For serving content from
raw.githubusercontent.comGitHub uses 3rd-party CDN provider. There wereraw.githubusercontent.comconnectivity issues before, but that time it looked like routing problem and the error was client-side, kind of "Unable to connect raw.githubusercontent.com server".The error you are getting is server-side meaning we were able to contact the server but it returns 503 (server unavailable). My guess is that some of CDN edge servers serving that file is either permanently or temporary down. We'll report to GitHub about that.
In the meantime, I think the way to workaround this is retry strategy. You can either wrap
appveyor downloadcommand in a batch doing retries or implement file download in PowerShell.Ilya Finkelshteyn closed this discussion on 25 Aug, 2018 01:58 AM.