tag:help.appveyor.com,2012-11-13:/discussions/problems/6301-test-instabilitiesAppVeyor: Discussion 2018-08-25T02:15:47Ztag:help.appveyor.com,2012-11-13:Comment/421901042017-03-20T10:23:40Z2017-03-20T10:23:43ZTest instabilities<div><p>Hi,</p>
<p>a couple of weeks ago I reported that our end-to-end tests would be rather instable with image VS 2017 RC (at that time). Feodor seemed to have fixed that problem, but now I'm seeing instable tests again.</p>
<p>The following two builds do build the same commit, but with different outcomes:<br>
* <a href="https://ci.appveyor.com/project/csoltenborn/googletestadapter-u1cxh/build/0.9.1.708">709</a> * <a href="https://ci.appveyor.com/project/csoltenborn/googletestadapter-u1cxh/build/0.9.1.708">710</a></p>
<p>Interestingly, the 710 build job on the VS 2017 image failed due to some weird VS exceptions:</p>
<pre>
<code>System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
at Microsoft.VisualStudio.Telemetry.TelemetryContext.FlushPostedProperties()
at Microsoft.VisualStudio.Telemetry.TelemetryTaskTimer.<>c__DisplayClass11_0.<Start>b__0(Task previousTask)
at System.Threading.Tasks.ContinuationTaskFromTask.InnerInvoke()</code>
</pre>
<p>Would you be so kind to check out once more what's going on there?</p>
<p>Thanks in advance<br>
Christian</p></div>Christian Soltenborntag:help.appveyor.com,2012-11-13:Comment/421901042017-03-20T13:28:39Z2017-03-20T13:28:40ZTest instabilities<div><p>In case you haven't seen build <a href="https://ci.appveyor.com/project/csoltenborn/googletestadapter-u1cxh/build/0.9.1.711">711</a>: Same commit, build passed this time, leaving us with three builds and three different build results...</p></div>Christian Soltenborntag:help.appveyor.com,2012-11-13:Comment/421901042017-03-20T14:21:18Z2017-03-20T14:21:18ZTest instabilities<div><p>I see "Visual Studio 2015" job is failing. So you see instability on VS 2015 image or VS 2017 - could you please clarify? Also, when was the last good build?</p></div>Feodor Fitsnertag:help.appveyor.com,2012-11-13:Comment/421901042017-03-21T10:38:25Z2017-03-21T10:38:25ZTest instabilities<div><p>Sorry, that was indeed a bit confusing... I've looked closely at our build results once more:</p>
<ul>
<li>Main cause for failing builds is the test that checks whether our adapter's SettingsProvider has been registered successfully. This is very comparable to the test which used to fail last time and got fixed by your patch. However, this happens also on VS2015 (although mostly on VS2017) Builds: 710, 709, 706, 705, 697, 683</li>
<li>Some builds are failing due to a failed timing test (I suspect that this happens if the build machine we are running on is rather busy - probably not much we can do about that despite increasing the test's timing tolerance)</li>
<li>weird AccessViolationException exception on VS 2017 as described above (build 710)</li>
<li>last good build was (after a couple of failed builds) build 711 (same commit as 706, 708-710)</li>
</ul>
<p>Thus, it looks like nothing has changed from your side - sorry for wasting your time. We still have no idea why our SettingsProvider test currently fails regularly (and this never happens on our local machines), but it's not a very new problem.</p>
<p>If we get more AccessViolationExceptions, I'll let you know.</p></div>Christian Soltenborntag:help.appveyor.com,2012-11-13:Comment/421901042017-03-21T22:20:51Z2017-03-21T22:20:51ZTest instabilities<div><p>Sure, is there anything we could (should) do on VS 2017 to make your tests work please let us know. Also, looking via RDP into build worker could help you troubleshoot many issues - RDP works for VS 2017 image now.</p></div>Feodor Fitsner