raw.githubusercontent.com gives "Server Unavailable" sporadically

Ondřej Čertík's Avatar

Ondřej Čertík

08 Aug, 2015 02:28 PM

Sometimes (but not always), we get errors like this one:

appveyor DownloadFile "https://raw.githubusercontent.com/symengine/dependencies/5cff7d1736877336cf9fb58267111beea4fa152f/x86_64-4.9.1-release-posix-seh-rt_v3-rev1.7z" -FileName mw64.7z
Error downloading file: The remote server returned an error: (503) Server Unavailable.

Here is a full log: https://ci.appveyor.com/project/certik/symengine/build/117/job/uiq1j1yiw7lwttkc

It is not reproducible, it only happens sometimes. But it happened already several times.

Do you know how to best debug this issue? Should we for example write a special download script, that will try to download the file several times (with some timeout)?

Another solution would be to just restart this particular build, but it seems AppVeyor only supports rebuilding the whole PR, so if the PR has 8 builds (jobs), and 7 pass, one fails due to this issue, then it is a waste to be rebuilding everything (and still risking that one of the 8 jobs will fail to download the file).

Let me know what the best way forward is.

Thanks,
Ondrej Certik

  1. Support Staff 1 Posted by Feodor Fitsner on 08 Aug, 2015 02:52 PM

    Feodor Fitsner's Avatar

    When did it start happening? How many times did it happen?

  2. 2 Posted by Ondřej Čertík on 08 Aug, 2015 04:18 PM

    Ondřej Čertík's Avatar

    I went into our history and here are all the failures due to this:

    https://ci.appveyor.com/project/certik/symengine/build/117/job/uiq1j1yiw7lwttkc
    https://ci.appveyor.com/project/certik/symengine/build/110/job/5fdlk0xfhur50nh4
    https://ci.appveyor.com/project/certik/symengine/build/95/job/ywlq8n1swld1kvl9
    https://ci.appveyor.com/project/certik/symengine/build/92/job/0ed4p915y2ougsr8
    https://ci.appveyor.com/project/certik/symengine/build/89/job/b36fxmwdk6yw573y
    https://ci.appveyor.com/project/certik/symengine/build/86/job/4fjbxejh5cwapimh
    https://ci.appveyor.com/project/certik/symengine/build/73/job/xknteggc3v14wh3x

    There are probably more. So it's been a few weeks. It's definitely not a one time thing.

    As an example of a one time thing, I found this error:

    https://ci.appveyor.com/project/certik/symengine/build/105/job/14vw4i3cq6ol0tny

    where the Python code failed to download something. It only happened once, so it's a one time thing. The above is very regular --- it doesn't happen every build, but it happened at least 8x (all the links above), possibly more.

  3. Support Staff 3 Posted by Feodor Fitsner on 11 Aug, 2015 01:09 AM

    Feodor Fitsner's Avatar

    For serving content from raw.githubusercontent.com GitHub uses 3rd-party CDN provider. There were raw.githubusercontent.com connectivity issues before, but that time it looked like routing problem and the error was client-side, kind of "Unable to connect raw.githubusercontent.com server".

    The error you are getting is server-side meaning we were able to contact the server but it returns 503 (server unavailable). My guess is that some of CDN edge servers serving that file is either permanently or temporary down. We'll report to GitHub about that.

    In the meantime, I think the way to workaround this is retry strategy. You can either wrap appveyor download command in a batch doing retries or implement file download in PowerShell.

  4. Ilya Finkelshteyn closed this discussion on 25 Aug, 2018 01:58 AM.

Comments are currently closed for this discussion. You can start a new one.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac