Appveyor Cache Not Updated

Owen Arnold's Avatar

Owen Arnold

17 Dec, 2019 01:44 PM

I have what looks like a bug in the caching mechanism of appveyor. I'm using clcache to improve build times, and I request in my appveyor.yaml that the clcache directory is stored https://github.com/scipp/scipp/blob/master/appveyor.yml. For each build, I print clcache statistics before and after, so I can see that the clcache is hot after use. However, when the next build begins the cache seems to revert to its previous state implying it has not been correctly updated or restored. The build output indicates that both restoration and updating events of the caching happen, but I can't get any further output to tell me what's going on. Is it possible that the checksum is failing? Are there any other diagnostic approaches I might be able to take?

  1. Support Staff 1 Posted by Feodor Fitsner on 17 Dec, 2019 06:23 PM

    Feodor Fitsner's Avatar

    Hi Owen,

    Could you please drop links to a build where the cache is updated and then the build where the cache is used?

  2. 2 Posted by Owen Arnold on 17 Dec, 2019 10:06 PM

    Owen Arnold's Avatar

    Should have been updated here (you can see the clcache statistics before and after build) see output from clcache.exe -l https://ci.appveyor.com/project/Scipp/scipp-l7qf3/builds/29569631?fullLog=true

    When cache is restored it does not look to have been updated https://ci.appveyor.com/project/Scipp/scipp-l7qf3/builds/29589174?fullLog=true

    Not sure what i'm missing.

  3. Support Staff 3 Posted by Feodor Fitsner on 20 Dec, 2019 12:07 AM

    Feodor Fitsner's Avatar

    Try listing the files in the cached directory after the cache is restored, to see what's there. Are there any hidden files in the original directory?

  4. 4 Posted by Owen Arnold on 13 Jan, 2020 08:17 AM

    Owen Arnold's Avatar

    I don't believe there are any hidden directories. Creating my own checksum of the files and using the checksum to create a new file (checksum as name) within cache directory root resolves the problems, so I suspect that issue relates the the way that the appveyor is performing the check, perhaps it's not inspecting file contents or isn't recursive?

    My solution above has provided a work around fo the time being.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac

Recent Discussions

07 Jul, 2020 06:21 PM
07 Jul, 2020 03:15 PM
05 Jul, 2020 02:33 AM
03 Jul, 2020 07:29 PM
03 Jul, 2020 03:53 AM

 

02 Jul, 2020 09:09 PM
02 Jul, 2020 03:24 PM
01 Jul, 2020 01:12 PM
30 Jun, 2020 04:26 PM
25 Jun, 2020 05:54 PM
24 Jun, 2020 08:11 AM