Unable to connect to web.archive.org on Ubuntu images

DDoSolitary's Avatar

DDoSolitary

02 Sep, 2018 06:34 AM

appveyor@av-0209-060743-294nqt84bw8tt9jk:~$ nslookup web.archive.org
Server:         169.254.169.254
Address:        169.254.169.254#53

Non-authoritative answer:
web.archive.org canonical name = wwwb-front3.us.archive.org.
Name:   wwwb-front3.us.archive.org
Address: 207.241.225.186

appveyor@av-0209-060743-294nqt84bw8tt9jk:~$ curl -L https://web.archive.org/web/20150802061047/http://support.wdc.com/download/archive/pciscsi.exe -v
*   Trying 207.241.225.186...
* connect to 207.241.225.186 port 443 failed: Connection timed out
* Failed to connect to web.archive.org port 443: Connection timed out
* Closing connection 0
curl: (7) Failed to connect to web.archive.org port 443: Connection timed out
  1. Support Staff 1 Posted by Owen McDonnell on 04 Sep, 2018 09:20 PM

    Owen McDonnell's Avatar

    I haven't seen any problem on other curl commands in Ubuntu builds. Are you able to run this exact curl command on a local Ubuntu machine?

  2. 2 Posted by DDoSolitary on 05 Sep, 2018 04:09 AM

    DDoSolitary's Avatar

    Yes, other curl commands work well, the timeout error only occurs when trying to connect to web.archive.org

    Output when running on a Vultr VPS:

    [root@vultr ~]# curl -L https://web.archive.org/web/20150802061047/http://support.wdc.com/download/archive/pciscsi.exe -v > /dev/null
      % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                     Dload  Upload   Total   Spent    Left  Speed
      0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying 207.241.225.186...
    * TCP_NODELAY set
    * Connected to web.archive.org (207.241.225.186) port 443 (#0)
    * ALPN, offering h2
    * ALPN, offering http/1.1
    * successfully set certificate verify locations:
    *   CAfile: /etc/ssl/certs/ca-certificates.crt
      CApath: none
    } [5 bytes data]
    * TLSv1.2 (OUT), TLS handshake, Client hello (1):
    } [213 bytes data]
    * TLSv1.2 (IN), TLS handshake, Server hello (2):
    { [102 bytes data]
    * TLSv1.2 (IN), TLS handshake, Certificate (11):
    { [4765 bytes data]
    * TLSv1.2 (IN), TLS handshake, Server key exchange (12):
    { [333 bytes data]
    * TLSv1.2 (IN), TLS handshake, Server finished (14):
    { [4 bytes data]
    * TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
    } [70 bytes data]
    * TLSv1.2 (OUT), TLS change cipher, Client hello (1):
    } [1 bytes data]
    * TLSv1.2 (OUT), TLS handshake, Finished (20):
    } [16 bytes data]
    * TLSv1.2 (IN), TLS handshake, Finished (20):
    { [16 bytes data]
    * SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
    * ALPN, server accepted to use h2
    * Server certificate:
    *  subject: OU=Domain Control Validated; CN=*.archive.org
    *  start date: Dec 19 20:59:01 2016 GMT
    *  expire date: Feb 21 22:56:08 2020 GMT
    *  subjectAltName: host "web.archive.org" matched cert's "*.archive.org"
    *  issuer: C=US; ST=Arizona; L=Scottsdale; O=GoDaddy.com, Inc.; OU=http://certs.godaddy.com/repository/; CN=Go Daddy Secure Certificate Authority - G2
    *  SSL certificate verify ok.
    * Using HTTP2, server supports multi-use
    * Connection state changed (HTTP/2 confirmed)
    * Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
    } [5 bytes data]
    * Using Stream ID: 1 (easy handle 0x55d0d4b77ff0)
    } [5 bytes data]
    > GET /web/20150802061047/http://support.wdc.com/download/archive/pciscsi.exe HTTP/2
    > Host: web.archive.org
    > User-Agent: curl/7.61.0
    > Accept: */*
    >
    { [5 bytes data]
    * Connection state changed (MAX_CONCURRENT_STREAMS == 10)!
    } [5 bytes data]
      0     0    0     0    0     0      0      0 --:--:--  0:00:04 --:--:--     0< HTTP/2 200
    < server: nginx/1.13.11
    < date: Wed, 05 Sep 2018 04:07:20 GMT
    < content-type: application/octet-stream
    < x-archive-orig-x-cnection: close
    < x-archive-orig-x-powered-by: ASP.NET
    < x-archive-orig-set-cookie: BIGipServersupport_wdc_com.app~support_wdc_com_pool=3440378890.20480.0000; path=/, TS012ad883=01c2bc90a15cac7f6f44f2deaf23aaefd128f662be2e222d70353119b00432ab4e6708b4bd0b60c1c4c665d68fd44e0811b9ffbc4c; Path=/
    < x-archive-orig-accept-ranges: bytes
    < x-archive-orig-content-length: 510478
    < x-archive-orig-last-modified: Fri, 15 Feb 2002 22:44:00 GMT
    < x-archive-orig-etag: "0386c4272b6c11:0"
    < x-archive-orig-date: Sun, 02 Aug 2015 06:10:44 GMT
    < cache-control: max-age=1800
    < x-archive-guessed-content-type: application/x-dosexec
    < memento-datetime: Sun, 02 Aug 2015 06:10:47 GMT
    < link: <http://support.wdc.com/download/archive/pciscsi.exe>; rel="original", <https://web.archive.org/web/timemap/link/http://support.wdc.com/download/archive/pciscsi.exe>; rel="timemap"; type="application/link-format", <https://web.archive.org/web/http://support.wdc.com/download/archive/pciscsi.exe>; rel="timegate", <https://web.archive.org/web/20020607031935/http://support.wdc.com:80/download/archive/pciscsi.exe>; rel="first memento"; datetime="Fri, 07 Jun 2002 03:19:35 GMT", <https://web.archive.org/web/20070803180841/http://support.wdc.com/download/archive/pciscsi.exe>; rel="prev memento"; datetime="Fri, 03 Aug 2007 18:08:41 GMT", <https://web.archive.org/web/20150802061047/http://support.wdc.com/download/archive/pciscsi.exe>; rel="memento"; datetime="Sun, 02 Aug 2015 06:10:47 GMT", <https://web.archive.org/web/20180829133333/http://support.wdc.com/download/archive/pciscsi.exe>; rel="next memento"; datetime="Wed, 29 Aug 2018 13:33:33 GMT", <https://web.archive.org/web/20180829133335/https://support.wdc.com/download/archive/pciscsi.exe/>; rel="last memento"; datetime="Wed, 29 Aug 2018 13:33:35 GMT"
    < content-security-policy: default-src 'self' 'unsafe-eval' 'unsafe-inline' data: blob: archive.org web.archive.org analytics.archive.org
    < x-archive-src: archiveteam_archivebot_go_20150802120002/aur.archlinux.org-inf-20150801-012832-5w33j-00019.warc.gz
    < x-app-server: wwwb-app103
    < x-ts: ----
    < x-location: All
    < x-cache-key: httpsweb.archive.org/web/20150802061047/http://support.wdc.com/download/archive/pciscsi.exeJP
    < x-page-cache: MISS
    <
    { [14652 bytes data]
    100  498k    0  498k    0     0  97345      0 --:--:--  0:00:05 --:--:--  134k
    * Connection #0 to host web.archive.org left intact
    
  3. 3 Posted by DDoSolitary on 05 Sep, 2018 04:17 AM

    DDoSolitary's Avatar

    MTR reports generated on the build server

    appveyor@av-0509-040503-3jhacx5dr6ylshpk:~$ mtr -rw web.archive.org
    Start: Wed Sep  5 04:13:32 2018
    HOST: av-0509-040503-3jhacx5dr6ylshpk          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- router-central1-b.c.appveyor-ci.internal  0.0%    10    0.3   0.4   0.2   1.7   0.0
      2.|-- 216.239.58.214                            0.0%    10   36.5  36.7  36.5  37.8   0.0
      3.|-- 108.170.242.249                           0.0%    10   36.5  36.9  36.4  38.0   0.5
      4.|-- ???                                      100.0    10    0.0   0.0   0.0   0.0   0.0
      5.|-- cr1-200p-b-hu-0-7-0-21-0.bb.as11404.net   0.0%    10   37.9  38.1  37.9  38.8   0.0
      6.|-- agg2-200p-a-be-5.as11404.net              0.0%    10   38.0  38.1  37.8  38.7   0.0
      7.|-- archive.org-BE.demarc.spectrumnet.us      0.0%    10   37.8  37.9  37.7  38.9   0.0
      8.|-- ???                                      100.0    10    0.0   0.0   0.0   0.0   0.0
    
    appveyor@av-0509-040503-3jhacx5dr6ylshpk:~$ mtr -rw --tcp -P 443 web.archive.org
    Start: Wed Sep  5 04:14:35 2018
    HOST: av-0509-040503-3jhacx5dr6ylshpk          Loss%   Snt   Last   Avg  Best  Wrst StDev
      1.|-- router-central1-b.c.appveyor-ci.internal  0.0%    10    0.3   0.5   0.3   1.4   0.0
      2.|-- 72.14.237.146                             0.0%    10   37.1  36.8  36.2  37.9   0.0
      3.|-- 108.170.242.89                            0.0%    10   37.3  37.1  36.4  37.9   0.3
      4.|-- ???                                      100.0    10    0.0   0.0   0.0   0.0   0.0
      5.|-- cr1-200p-b-hu-0-7-0-21-0.bb.as11404.net   0.0%    10   38.0  38.2  37.9  39.0   0.0
      6.|-- agg2-200p-a-be-5.as11404.net              0.0%    10   38.1  38.0  37.7  38.6   0.0
      7.|-- archive.org-BE.demarc.spectrumnet.us      0.0%    10   37.8  37.9  37.8  38.4   0.0
      8.|-- ???
    
  4. Support Staff 4 Posted by Wasa Pleshakov on 06 Sep, 2018 11:12 AM

    Wasa Pleshakov's Avatar

    It looks like misconfiguration in one of our clouds. We trying to pin the root cause now.

  5. 5 Posted by DDoSolitary on 19 Sep, 2018 02:44 AM

    DDoSolitary's Avatar

    Any updates on this? Thanks.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac