Commit Graph

63 Commits

Author SHA1 Message Date
Brennan ca5cd91d68
Replace RunTests scripts with .NET app (#20337) 2020-04-01 09:01:34 -07:00
Brennan cc2f5497e8
Avoid modifying global machine state on Helix (#20315) 2020-03-30 15:34:02 -07:00
David Fowler 619e2025f1
Enable the blame data collector (#20318)
- This should dump out which tests were incomplete on
the test runner crashing.
2020-03-30 11:16:17 -07:00
David Fowler c7d4d7c270
Add console logger to test command (#20273) 2020-03-28 12:20:24 -07:00
David Fowler 796cf9649b
Trying things out (#20264) 2020-03-28 08:08:53 -07:00
Brennan 2766f202a2
Fix Helix log upload (#20258) 2020-03-27 23:15:56 -07:00
Doug Bunting 3dfd5f28c1 nit: Mark shell scripts as executable 2020-03-25 11:04:25 -07:00
John Luo 6912dda560
Add gRPC interop tests (again) (#20069)
* Revert "Revert "Add gRPC interop tests (#17040)" (#20047)"

This reverts commit 236dcd9fbe.

* Fix daily and quarantine Helix runs

* Cleanup
2020-03-23 13:29:50 -07:00
Kevin Pilch 236dcd9fbe
Revert "Add gRPC interop tests (#17040)" (#20047)
This reverts commit 8afb78fb95.
2020-03-21 06:04:28 +00:00
James Newton-King 8afb78fb95
Add gRPC interop tests (#17040)
* WIP add interop tests

* Clean up

* Move test project into build infrastructure

* Clean up

* Remove hardcoded paths

* Clean up

* Fix build

* Add copyright notices

* Update azure template

* Fix build

* Fix build?

* Fix build?

* Add gRPC interop tests to CI

- Convert to using references managed by build infrastructure
- Use produced AspNetCore.App shared framework
- Save server logs
- Dynamically bind to ports
- Ensure InteropWebsite is built in the same configuration as the test project

* Cleanup

* Rebase fix

* Include tests assets in build directory for Helix

* Incorporate changes in ProcessEx

* Include Grpc test in regular build

* Fixup

* Test

* exe doesn't always exist

* Capture logs on helix

* Maybe this will work

* There are two application started messages

* Derp

* Cleanup

* Update directory

* Add interop tests to more pipelines

* mkdir

Co-authored-by: John Luo <johluo@microsoft.com>
2020-03-20 19:32:45 -07:00
Hao Kung b4220d5c23
[Helix] Also upload logs from windows queues (#20005) 2020-03-20 15:17:39 -07:00
Brennan 78fce45039
Remove global xunit max thread setting (#19944) 2020-03-18 10:39:25 -07:00
Brennan f5a2245957
Use xunit.runner.json in Helix runs (#19922) 2020-03-17 12:26:40 -07:00
Hao Kung 124a0b6b38
[Helix] Reenable some template tests again (#19520) 2020-03-08 14:05:06 -07:00
Brennan 56fb4b4d2f
Rename Flaky attribute (#19469) 2020-03-04 08:10:18 -08:00
Hao Kung 46460f0070
Revert "[Helix] Reenable some Templates tests 2.0 (#19383)" (#19519)
This reverts commit 5e2a7726c6.
2020-03-03 04:43:48 +00:00
Hao Kung 5e2a7726c6
[Helix] Reenable some Templates tests 2.0 (#19383) 2020-03-02 11:43:34 -08:00
Hao Kung 4498058343
[Helix] Shared framework support + Templates tests (#19177) 2020-02-26 12:55:41 -08:00
Brennan b125c76d5f
Fix watch tests again (#19155) 2020-02-20 16:03:48 -08:00
Brennan e3a5f03e24
Run Java tests on Helix (#18938) 2020-02-19 13:18:12 -08:00
Hao Kung 853d8f02e7
Use dotnet-helixapi-access token for internal helix builds 2020-02-18 15:51:13 -08:00
Brennan b6d433c4b6
Run helix tests locally (#19031) 2020-02-14 14:22:23 -08:00
Hao Kung 1bd2b5f19e
[Helix] Only run flaky tests on quarantine runs (#18937)
* Only run flaky tests on quaratine run

* Only run flaky tests on quarantine run

* Rename to QUARANTINE

* Rename to QUARANTINE
2020-02-11 22:29:02 +00:00
Brennan 060657113c
Workaround to possibly fix flaky tests? (#18926)
Locally this seems to fix some unknown issue that is causing the dotnet test process to stop running for a few seconds which can result in test failures.
2020-02-10 14:43:27 -08:00
Stephen Halter 602f4678c1
Capture file-backed mappings in Linux core dumps (#18897) 2020-02-08 02:33:44 +00:00
Andrew Stanton-Nurse 91219a655b
[Helix] Add more metadata (#18719) 2020-01-31 12:47:32 -08:00
Andrew Stanton-Nurse 26b9e60dc6
Add build metadata to Helix Job (#18703) 2020-01-31 08:40:06 -08:00
Hao Kung e8363b1cc9
[Helix] Split flaky helix tests into separate yml (#18597) 2020-01-29 09:18:05 -08:00
Hao Kung 9501874f3a
Use vstest xml logger for helix (#18491) 2020-01-24 09:38:16 -08:00
Hao Kung f1dba10a34
[Helix] Better logging (flaky tests, logged tests) (#18274) 2020-01-21 14:03:01 -08:00
Kevin Pilch 0517745c08 aspnet/AspNetCore -> dotnet/aspnet
Except aspnet/AspNetCore-Internal.
2020-01-08 16:40:11 -08:00
Matt Galbraith a438e221bf
Add -Force to Expand-Archive
As noted in the console spew of this test:  https://helix.dot.net/api/2019-06-17/jobs/82bbddae-4a56-4002-b3ee-a8768311a92b/workitems/Microsoft.AspNetCore.SpaServices.Extensions.Tests-netcoreapp3.0/console it's quite possible for Node to be unpacked, but not on the path (generally on a helix machine it's because your parent process was created before the previous guy who unzipped Node and put it on the path ran, so only after reboot would you see the effect you want.
2019-09-05 16:52:23 -07:00
Hao Kung 6dc65b1673
[Helix] run on arm queues (#11422) 2019-06-30 01:04:53 -07:00
Nate McMaster 4fde84a7ad Replace KoreBuild with Arcade (#11122)
* Replace usages of $(CI) with $(ContinuousIntegrationBuild)

* Move RepoTasks to eng/tools/

* Remove dead code

* Update build.sh/ps1 to invoke Arcade instead of KoreBuild

* build/repo.props => eng/Build.props

* build/CodeSign.{props,targets} => eng/Signing.props

* build/repo.targets => eng/Build.props, eng/CodeGen.proj, and eng/AfterSolutionBuild.targets

* Remove AddAllProjectRefsToSolution.ps1

* Put selenium process tracking into artifacts/tmp/

* build/docker => eng/docker

* Move content from korebuild.json to global.json

* Remove cibuild.{sh,cmd} and update ci.yml

* Ensure vswhere detects BuildTools installations

* Remove sign check exclusions (Arcade does not support)

* list VS required components in global.json

* Update CodeCheck.ps1

* Update arcade (#11143)

* Fixups to broken build

* capture test results in xunit form
* attempt to fix code check
* restore before linux build
* remove duplicate signinfos

* More build fixes

* exclude node_modules from unique project check
* fixup signing props

* More build fixes

* Remove unused NoWarns
* Skip building site extension
* Suppress xunit color in console output
* Install x86 runtime

* Run KillProcesses.ps1 at end of build on CI

* activate env vars in codecheck.ps1

* Fix signing and generate build manifests

* Fixup code check and linux installers build

* Remove custom restore targets

* Import flaky test props

* Restore original manifest generation code and set warnAsErrors=false

* Alwasy restore the toolset

* More attempts at build fixes

* run restore before building deb/rpm packages
* pre-install Yarn.MSBuild
* Remove WIX workaround

* Attempt to fix RPM installers and x86 build

* Fix helix tests, java auto-detection, and code gen steps

* Globally disable MSBuild node resuse and capture MSbuild crash logs

* Cleanup build invocation for installers

* Set max time on xunit tests to 15 min

* Update helix-test.yml

* Fix Hosting tests

* Fix TestHost

* Fix Negotiate.Test

* Fix Mvc tests

* Capture results

* Fix Hosting tests

* Fix Kestrel tests

* Fix ServerComparison tests

* Fix DefaultBuilder functional tests

* Skip template tests

Need to run pack before running tests on mac/linux now

* Fix Identity test

* Fix ServerComparison tests

* Verify nginx installation on ubuntu

* Verify nginx installation?

* Try adding to path

* Try symlink

* Sudo?

* Woot it works

* Disable timeout

Template tests require more than 15 mins

* list env vars

* Use correct dotnet_home

* Prepent path instead

* Fix npmproj tests

* Fix CORS tests

* Debug signalr tests

* Debug signalr

* Capture bin

* Try building templates sequentially

* Debug signalr

* Cleanup

* Disable signalr npm tests

* Debug template test

* Try to fix templates again and make steps more reliable

* Cleanup

* Feedback
2019-06-19 10:03:38 -07:00
John Luo 24eb5e61d5 Use Envvar 2019-06-06 10:56:56 -07:00
= 8719736282 Try again 2019-06-05 13:55:14 -07:00
John Luo 264ab5252f Try again 2019-06-05 13:55:14 -07:00
= 1129c8982f Make it so Helix runs can be rerun and preserve history R2 2019-06-05 13:55:14 -07:00
Hao Kung 0b54783877
[Helix] Try running node services tests on helix again (#9046) 2019-05-29 21:15:29 -07:00
= 3f9f406301 Revert "Make it so Helix runs can be rerun and preserve history (#10457)"
This reverts commit 166851df32.
2019-05-23 18:04:26 -07:00
John Luo 166851df32
Make it so Helix runs can be rerun and preserve history (#10457)
* Make it so Helix runs can be rerun and preserve history

Addresses https://github.com/aspnet/AspNetCore/issues/8235

* Update eng/helix/helix.proj

Co-Authored-By: Nate McMaster <natemcmaster@users.noreply.github.com>
2019-05-23 17:53:11 -07:00
Nate McMaster 52133ac431
React to deprecation of Fedora.28.Amd64.Open (#10409) 2019-05-22 10:59:04 -07:00
John Luo e925df6a85
Disable test reporting for flaky tests on Helix (#10352) 2019-05-21 15:03:39 -07:00
Nate McMaster 194b0b4523
Update install JDK script an instructions to make it easier to use for local development (#10306) 2019-05-20 08:48:54 -07:00
Nate McMaster ae4157d086
Enable Windows 7 IIS Express tests (#10168)
* Enable Windows 7 IIS tests
* Detect if localdb is already installed
2019-05-16 08:58:49 -07:00
Nate McMaster b744814f06
Enhancements to Helix testing (#10007)
* Add Windows 7 and 8.1 testing on Helix
* Install SQL Server on-demand in Helix test queues
* Only install mssql on Windows runs
* Use exit /b
* Add targets to better support running helix locally
* Set maxretrycount to 2
* Handle IIS issues on win7/win8
* Make HelixPreCommand's fail the workitem
* Add a pre-generated test cert of IIS Express
* Update helix doc and ignore netsh script failures
* Fix bug in detecting Windows queues and disable Win 7 until we have queues ready
* Fix HttpSys functional tests on Helix
2019-05-10 15:04:16 -07:00
Justin Kotalik c22de8f39c
Add retries to helix failures and re-enable helix as a required workload (#9221) 2019-05-08 08:21:44 -07:00
Pavel Krymets fa239f20a5 EnableAzurePipelinesReporter for helix (#8094)
* EnableAzurePipelinesReporter for helix

* Update Helix SDK

* Revert a fix that broke things even more

* Try publishing test assets

* Try fixing Kestrel tests on Helix

* Try a temp file in the working directory

* Skip Http2Spec tests on Debian 8

* Missed update

* Try a different format

* Disable failing test on Fedora

* Mark flaky test
2019-05-05 22:15:10 -07:00
Nate McMaster 0b7458cc98
Update Helix queues and enable dependency-update automation for the Helix SDK (#9867) 2019-04-30 15:28:01 -07:00
Andrew Stanton-Nurse 706778d4de
Add a separate test pass to run flaky tests that doesn't fail the build (#8486)
Similar to https://github.com/aspnet/Extensions/pull/1239.
2019-03-18 18:21:14 -07:00