Commit Graph

41 Commits

Author SHA1 Message Date
Hao Kung 1bd2b5f19e
[Helix] Only run flaky tests on quarantine runs (#18937)
* Only run flaky tests on quaratine run

* Only run flaky tests on quarantine run

* Rename to QUARANTINE

* Rename to QUARANTINE
2020-02-11 22:29:02 +00:00
Brennan 060657113c
Workaround to possibly fix flaky tests? (#18926)
Locally this seems to fix some unknown issue that is causing the dotnet test process to stop running for a few seconds which can result in test failures.
2020-02-10 14:43:27 -08:00
Stephen Halter 602f4678c1
Capture file-backed mappings in Linux core dumps (#18897) 2020-02-08 02:33:44 +00:00
Andrew Stanton-Nurse 91219a655b
[Helix] Add more metadata (#18719) 2020-01-31 12:47:32 -08:00
Andrew Stanton-Nurse 26b9e60dc6
Add build metadata to Helix Job (#18703) 2020-01-31 08:40:06 -08:00
Hao Kung e8363b1cc9
[Helix] Split flaky helix tests into separate yml (#18597) 2020-01-29 09:18:05 -08:00
Hao Kung 9501874f3a
Use vstest xml logger for helix (#18491) 2020-01-24 09:38:16 -08:00
Hao Kung f1dba10a34
[Helix] Better logging (flaky tests, logged tests) (#18274) 2020-01-21 14:03:01 -08:00
Kevin Pilch 0517745c08 aspnet/AspNetCore -> dotnet/aspnet
Except aspnet/AspNetCore-Internal.
2020-01-08 16:40:11 -08:00
Matt Galbraith a438e221bf
Add -Force to Expand-Archive
As noted in the console spew of this test:  https://helix.dot.net/api/2019-06-17/jobs/82bbddae-4a56-4002-b3ee-a8768311a92b/workitems/Microsoft.AspNetCore.SpaServices.Extensions.Tests-netcoreapp3.0/console it's quite possible for Node to be unpacked, but not on the path (generally on a helix machine it's because your parent process was created before the previous guy who unzipped Node and put it on the path ran, so only after reboot would you see the effect you want.
2019-09-05 16:52:23 -07:00
Hao Kung 6dc65b1673
[Helix] run on arm queues (#11422) 2019-06-30 01:04:53 -07:00
Nate McMaster 4fde84a7ad Replace KoreBuild with Arcade (#11122)
* Replace usages of $(CI) with $(ContinuousIntegrationBuild)

* Move RepoTasks to eng/tools/

* Remove dead code

* Update build.sh/ps1 to invoke Arcade instead of KoreBuild

* build/repo.props => eng/Build.props

* build/CodeSign.{props,targets} => eng/Signing.props

* build/repo.targets => eng/Build.props, eng/CodeGen.proj, and eng/AfterSolutionBuild.targets

* Remove AddAllProjectRefsToSolution.ps1

* Put selenium process tracking into artifacts/tmp/

* build/docker => eng/docker

* Move content from korebuild.json to global.json

* Remove cibuild.{sh,cmd} and update ci.yml

* Ensure vswhere detects BuildTools installations

* Remove sign check exclusions (Arcade does not support)

* list VS required components in global.json

* Update CodeCheck.ps1

* Update arcade (#11143)

* Fixups to broken build

* capture test results in xunit form
* attempt to fix code check
* restore before linux build
* remove duplicate signinfos

* More build fixes

* exclude node_modules from unique project check
* fixup signing props

* More build fixes

* Remove unused NoWarns
* Skip building site extension
* Suppress xunit color in console output
* Install x86 runtime

* Run KillProcesses.ps1 at end of build on CI

* activate env vars in codecheck.ps1

* Fix signing and generate build manifests

* Fixup code check and linux installers build

* Remove custom restore targets

* Import flaky test props

* Restore original manifest generation code and set warnAsErrors=false

* Alwasy restore the toolset

* More attempts at build fixes

* run restore before building deb/rpm packages
* pre-install Yarn.MSBuild
* Remove WIX workaround

* Attempt to fix RPM installers and x86 build

* Fix helix tests, java auto-detection, and code gen steps

* Globally disable MSBuild node resuse and capture MSbuild crash logs

* Cleanup build invocation for installers

* Set max time on xunit tests to 15 min

* Update helix-test.yml

* Fix Hosting tests

* Fix TestHost

* Fix Negotiate.Test

* Fix Mvc tests

* Capture results

* Fix Hosting tests

* Fix Kestrel tests

* Fix ServerComparison tests

* Fix DefaultBuilder functional tests

* Skip template tests

Need to run pack before running tests on mac/linux now

* Fix Identity test

* Fix ServerComparison tests

* Verify nginx installation on ubuntu

* Verify nginx installation?

* Try adding to path

* Try symlink

* Sudo?

* Woot it works

* Disable timeout

Template tests require more than 15 mins

* list env vars

* Use correct dotnet_home

* Prepent path instead

* Fix npmproj tests

* Fix CORS tests

* Debug signalr tests

* Debug signalr

* Capture bin

* Try building templates sequentially

* Debug signalr

* Cleanup

* Disable signalr npm tests

* Debug template test

* Try to fix templates again and make steps more reliable

* Cleanup

* Feedback
2019-06-19 10:03:38 -07:00
John Luo 24eb5e61d5 Use Envvar 2019-06-06 10:56:56 -07:00
= 8719736282 Try again 2019-06-05 13:55:14 -07:00
John Luo 264ab5252f Try again 2019-06-05 13:55:14 -07:00
= 1129c8982f Make it so Helix runs can be rerun and preserve history R2 2019-06-05 13:55:14 -07:00
Hao Kung 0b54783877
[Helix] Try running node services tests on helix again (#9046) 2019-05-29 21:15:29 -07:00
= 3f9f406301 Revert "Make it so Helix runs can be rerun and preserve history (#10457)"
This reverts commit 166851df32.
2019-05-23 18:04:26 -07:00
John Luo 166851df32
Make it so Helix runs can be rerun and preserve history (#10457)
* Make it so Helix runs can be rerun and preserve history

Addresses https://github.com/aspnet/AspNetCore/issues/8235

* Update eng/helix/helix.proj

Co-Authored-By: Nate McMaster <natemcmaster@users.noreply.github.com>
2019-05-23 17:53:11 -07:00
Nate McMaster 52133ac431
React to deprecation of Fedora.28.Amd64.Open (#10409) 2019-05-22 10:59:04 -07:00
John Luo e925df6a85
Disable test reporting for flaky tests on Helix (#10352) 2019-05-21 15:03:39 -07:00
Nate McMaster 194b0b4523
Update install JDK script an instructions to make it easier to use for local development (#10306) 2019-05-20 08:48:54 -07:00
Nate McMaster ae4157d086
Enable Windows 7 IIS Express tests (#10168)
* Enable Windows 7 IIS tests
* Detect if localdb is already installed
2019-05-16 08:58:49 -07:00
Nate McMaster b744814f06
Enhancements to Helix testing (#10007)
* Add Windows 7 and 8.1 testing on Helix
* Install SQL Server on-demand in Helix test queues
* Only install mssql on Windows runs
* Use exit /b
* Add targets to better support running helix locally
* Set maxretrycount to 2
* Handle IIS issues on win7/win8
* Make HelixPreCommand's fail the workitem
* Add a pre-generated test cert of IIS Express
* Update helix doc and ignore netsh script failures
* Fix bug in detecting Windows queues and disable Win 7 until we have queues ready
* Fix HttpSys functional tests on Helix
2019-05-10 15:04:16 -07:00
Justin Kotalik c22de8f39c
Add retries to helix failures and re-enable helix as a required workload (#9221) 2019-05-08 08:21:44 -07:00
Pavel Krymets fa239f20a5 EnableAzurePipelinesReporter for helix (#8094)
* EnableAzurePipelinesReporter for helix

* Update Helix SDK

* Revert a fix that broke things even more

* Try publishing test assets

* Try fixing Kestrel tests on Helix

* Try a temp file in the working directory

* Skip Http2Spec tests on Debian 8

* Missed update

* Try a different format

* Disable failing test on Fedora

* Mark flaky test
2019-05-05 22:15:10 -07:00
Nate McMaster 0b7458cc98
Update Helix queues and enable dependency-update automation for the Helix SDK (#9867) 2019-04-30 15:28:01 -07:00
Andrew Stanton-Nurse 706778d4de
Add a separate test pass to run flaky tests that doesn't fail the build (#8486)
Similar to https://github.com/aspnet/Extensions/pull/1239.
2019-03-18 18:21:14 -07:00
Hao Kung a591a7cd78
Stop waiting for helix work item completion (#8483) 2019-03-13 15:02:03 -07:00
Hao Kung d818126c4d
Ignore mission control test failures for helix (#8464) 2019-03-13 12:53:57 -07:00
Hao Kung 435867e8c5
Add ability to skip tests on specific helix queues (#8231) 2019-03-06 23:53:18 -08:00
Hao Kung 3652b7a927
Helix tests should fail if exceptions thrown during test discovery (#8107) 2019-03-04 14:15:37 -08:00
Pavel Krymets 01ce2836c8
Publish helix tests in release (#8104)
Fixes: https://github.com/aspnet/AspNetCore/issues/8103
2019-03-01 15:48:48 -08:00
Pavel Krymets b6216b6101
Disable parallel publish for Helix (#8004) 2019-02-27 13:28:54 -08:00
Pavel Krymets 783131a750
Re-enable full IIS tests on Windows.10.Amd64.EnterpriseRS3.ASPNET.Open (#7959) 2019-02-27 11:03:41 -08:00
Pavel Krymets 78bc2a10b9
Reenable IISExpress on helix (#7586) 2019-02-25 09:05:19 -08:00
Nate McMaster 3a785e0045
Temporarily disable Ubuntu and Debian ARM queues for distributed testing (#7747)
Helix tests is failing for everyone because these queues are not functioning. Tests timeout after several hours of waiting for agents.

Tracking https://github.com/dotnet/core-eng/issues/5261 to re-enable these agents.
2019-02-20 08:55:19 -08:00
Hao Kung 63a8b14619
Fix helix.proj warnings (#7373) 2019-02-15 19:40:10 -08:00
Hao Kung a1490bac35
Adding arm and fedora helix queues (#7543) 2019-02-15 19:37:05 -08:00
Nate McMaster 0b0d5b98dc
Disable helix tests on Fedora.28 and 27 (#7399)
Something is wrong with the machines. All tests fail. Disabling to allow time for investigation without blocking PR checks.
2019-02-08 14:53:19 -08:00
Hao Kung 26acbc3861
Reorganize helix files (#7353) 2019-02-07 16:27:48 -08:00