How to optimize a project to reduce the running time

Filipe's Avatar

Filipe

12 Dec, 2016 12:32 PM

Hi there,

I need some advice on how to optimize a project to get a few extra minutes so I can build it within the 1-hour limit.

As you can see 3 out of 6 are OK, and the remaining 3 are very close to completion:

https://ci.appveyor.com/project/conda-forge/qt-feedstock/build/1.0.5

This projects is building Qt for the conda package manager. it is a very important package with many other packages downstream depending on it. Any advice to achieve a successful build is welcomed! Thanks in advance! !

  1. 1 Posted by Ilya Finkelshte... on 12 Dec, 2016 06:19 PM

    Ilya Finkelshteyn's Avatar

    Hi Filipe,
    I see that you are downloading dependencies from internet during a build. Can you try to keep them in the build cache?

    Also can you please estimate specific amount of minutes you are above one hour?

    --ilya.

  2. 2 Posted by Filipe on 14 Dec, 2016 06:36 PM

    Filipe's Avatar

    I'll take a look at caching but I am not sure it will work b/c we need up-to-date dependencies and the cache will probably go over the 100 MB limit.

    Regarding the amount of minutes, it is hard to say we have 6 items in that matrix and 3 ends below the 1 hours limit while the remaining 3 fail due to time. I would guess that maybe +15 minutes would do. Not sure... Locally, in my machine, that build takes > 3 hours!

  3. 3 Posted by Ilya Finkelshte... on 15 Dec, 2016 01:49 AM

    Ilya Finkelshteyn's Avatar

    Hi Filipe,

    1. We changed your account time limit to 90 minutes, hope this helps.

    2. Build cache limit for free plan is 1GB, not 100Mb

    3. I see that successful jobs here are actually very quick, less than 2 minutes, so I suspect that they do not do all what you expect them to do. You probably need to re-examine your config.

    Thanks!
    Ilya.

  4. 4 Posted by Filipe Pires Al... on 15 Dec, 2016 12:51 PM

    Filipe Pires Alvarenga Fernandes's Avatar

    Thanks for looking into this Ilya!

    That log is not the right one because I skipped the successful builds and
    test a single one.

    Here is the correct one:

    https://ci.appveyor.com/project/conda-forge/qt-feedstock/build/1.0.4

    I just removed all the skips and triggered a new build here"

    https://ci.appveyor.com/project/conda-forge/qt-feedstock/build/1.0.9

    However, all of our builds on AppVeyor are stuck for many days.

    See https://ci.appveyor.com/projects?p=34

    With the exception of the staged-recipes repository all others are stuck :-(

    PS: Not sure if you expanded the time limit in my account (ocefpaf) or in
    the conda-forge account.
    I personally don't need that. We only need it for the conda-forge qt
    account.
    But it does not hurt to get it for all of conda-forge repos ;-)

    Thanks again,

    -Filipe

  5. 5 Posted by Ilya Finkelshte... on 16 Dec, 2016 02:14 AM

    Ilya Finkelshteyn's Avatar

    Hi Filipe,

    We fixed your queue. Please cancel your builds or start new one. Sorry.

    Longer build time is assigned to the conda-forge account.

    Also I just noticed that for your account build cache limit is actually 20Gb.

    Thanks!
    Ilya.

  6. 6 Posted by Filipe Pires Al... on 16 Dec, 2016 09:33 AM

    Filipe Pires Alvarenga Fernandes's Avatar

    Thanks! Our builds are already starting!!

    Qt, and some other feedstocks, will benefit from the extra time!

    Thanks again in the name all of the conda-forge community and Windows conda
    users!

    Best,

    -Filipe

  7. Ilya Finkelshteyn closed this discussion on 25 Aug, 2018 02:10 AM.

Comments are currently closed for this discussion. You can start a new one.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac