Commit Graph

80 Commits

Author SHA1 Message Date
Brennan 15015d5162
Remove temp SDK on Helix (#22475) 2020-06-02 19:34:13 +00:00
Doug Bunting 256045729a
Add `SuccessfulTests` to ensure something runs in every non-Helix run (#22406)
* Remove extra `[SkipOnHelix]` attribute
- only need the one compiled into Microsoft.AspNetCore.Testing
- update the documentation to reflect this
  - nit: address Markdown warnings that VS Code showed

* Add `SuccessfulTests` to ensure something runs in every non-Helix runs
- #22241
- cleans up hundreds of warnings but leaves a couple for the Blazor tests assembly
  - see comments about xUnit runner command line in the new class
2020-06-02 12:19:28 -07:00
Doug Bunting d2b3eecedb Provide an `$(OutputPath)` setting in helix.proj
- #22246
2020-06-01 11:49:30 -07:00
Hao Kung a806ae62c3
Add helix-matrix.yml and windows arm 64 helix queue (#22002) 2020-05-23 17:08:18 -07:00
Brennan 4e2584a04a
Install dotnet-dump first (#22068) 2020-05-20 23:31:22 -07:00
dotnet-maestro[bot] d5849f3534
[master] Update dependencies from dotnet/arcade dotnet/aspnetcore-tooling (#21630)
* Update dependencies from https://github.com/dotnet/arcade build 20200511.9
- Microsoft.DotNet.Arcade.Sdk: 5.0.0-beta.20228.4 => 5.0.0-beta.20261.9
- Microsoft.DotNet.GenAPI: 5.0.0-beta.20228.4 => 5.0.0-beta.20261.9
- Microsoft.DotNet.Helix.Sdk: 5.0.0-beta.20228.4 => 5.0.0-beta.20261.9

* Update dependencies from https://github.com/dotnet/aspnetcore-tooling build 20200514.6

Microsoft.AspNetCore.Mvc.Razor.Extensions , Microsoft.AspNetCore.Razor.Language , Microsoft.CodeAnalysis.Razor , Microsoft.NET.Sdk.Razor
 From Version 5.0.0-preview.5.20261.4 -> To Version 5.0.0-preview.6.20264.6

* Pre-emptively take -nobl change

* Disable binlogs in CI

* Fix build.sh to know about -nobl

* Align build.ps1|sh with latest Arcade parameters
- do not enable binary logs by default in CI builds
- leave `-binaryLog` and `-excludeCIBinaryLog` handling to eng/common/tools.ps1|sh
  - was unnecessary since `-bl /bl:{some name}` worked fine, ignoring OOMs

nit: document `-excludeCIBinarylog` a bit more

* Do not pass unknown options into CodeCheck.ps1

* Pass `-ci -nobl` into remaining CI build jobs

* Switch default TFM to `net5.0`

* Update missing project templates tfms

* Add more `-ci -nobl`
- needed because _all_ builds in the pipeline are implicitly CI builds
  - default-build.yml adds `-ci` when script wasn't explicit

* Default templates to net5.0

* PR feedback

* Update TFMs in explicit .nuspec files

* Update TFMs in test projects

* Update TFMs in test C# code

* Update TFMs in infrastructure files

* Future-proof a check for `net5.0` or later
- avoid comparisons involving `$(TargetFramework)` in .targets files
  - fine to compare it with `''` or `$(DefaultNetCoreTargetFramework)`

* !fixup! Undo a couple of earlier fixes
- remove a duplicate `$()` setting
- correct the one remaining versioned `#if` define
  - did not make it `#if NETCOREAPP` because benchmarks test numerous .NET Core TFMs

* Disable binary logs in CodeCheck.ps1

* Specify `-ci -nobl` just once when using `parameters.buildArgs`

* Restore `$binaryLog` default logic

Co-authored-by: Doug Bunting <6431421+dougbu@users.noreply.github.com>
Co-authored-by: Will Godbe <wigodbe@microsoft.com>
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2020-05-15 00:17:02 +00:00
Brennan f56c61b812
Capture dump of hanging test process in Helix (#21659) 2020-05-12 13:55:09 -07:00
Hao Kung 4434cf43ce
Don't throw on dotnet exit codes (#21639)
Operation can succeed for purposes of the tests, the tests will fail if things aren't setup properly, so we can safely ignore the errors
2020-05-11 15:08:42 -07:00
Hao Kung f86eb17fb4
[Helix] Install ef tool to work item root instead of globally (#21025) 2020-04-20 19:33:02 -07:00
Hao Kung 02bb671d15
[Helix] Don't fail fast on ef tool install issues (may be already installed) (#20958) 2020-04-18 01:58:02 -07:00
Hao Kung f3c2c1c5b3
[Helix] Capture more output/errors in test runner (#20919) 2020-04-16 22:30:55 -07:00
Hao Kung 698ab1518d
[Helix] Force overwrite when installing app runtime (#20803) 2020-04-13 22:24:02 -07:00
Hao Kung c16d3364d4
[Helix] Install aspnet runtime as part of test runner (#20693) 2020-04-11 10:47:56 -07:00
Hao Kung 200f2c49be
Reenable sharedfx with arm64 queue skipped (#20659) 2020-04-09 12:24:03 -07:00
Hao Kung 1bbca1502b
Revert "Reenable framework unit tests on helix (#19975)" (#20657)
This reverts commit 9a792f2a27.
2020-04-09 05:00:26 +00:00
Hao Kung 9a792f2a27
Reenable framework unit tests on helix (#19975) 2020-04-07 23:39:27 -07:00
Hao Kung fba6e94c4f
Helix add some more prints (#20463) 2020-04-03 01:37:21 -07:00
Brennan ca5cd91d68
Replace RunTests scripts with .NET app (#20337) 2020-04-01 09:01:34 -07:00
Brennan cc2f5497e8
Avoid modifying global machine state on Helix (#20315) 2020-03-30 15:34:02 -07:00
David Fowler 619e2025f1
Enable the blame data collector (#20318)
- This should dump out which tests were incomplete on
the test runner crashing.
2020-03-30 11:16:17 -07:00
David Fowler c7d4d7c270
Add console logger to test command (#20273) 2020-03-28 12:20:24 -07:00
David Fowler 796cf9649b
Trying things out (#20264) 2020-03-28 08:08:53 -07:00
Brennan 2766f202a2
Fix Helix log upload (#20258) 2020-03-27 23:15:56 -07:00
Doug Bunting 3dfd5f28c1 nit: Mark shell scripts as executable 2020-03-25 11:04:25 -07:00
John Luo 6912dda560
Add gRPC interop tests (again) (#20069)
* Revert "Revert "Add gRPC interop tests (#17040)" (#20047)"

This reverts commit 236dcd9fbe.

* Fix daily and quarantine Helix runs

* Cleanup
2020-03-23 13:29:50 -07:00
Kevin Pilch 236dcd9fbe
Revert "Add gRPC interop tests (#17040)" (#20047)
This reverts commit 8afb78fb95.
2020-03-21 06:04:28 +00:00
James Newton-King 8afb78fb95
Add gRPC interop tests (#17040)
* WIP add interop tests

* Clean up

* Move test project into build infrastructure

* Clean up

* Remove hardcoded paths

* Clean up

* Fix build

* Add copyright notices

* Update azure template

* Fix build

* Fix build?

* Fix build?

* Add gRPC interop tests to CI

- Convert to using references managed by build infrastructure
- Use produced AspNetCore.App shared framework
- Save server logs
- Dynamically bind to ports
- Ensure InteropWebsite is built in the same configuration as the test project

* Cleanup

* Rebase fix

* Include tests assets in build directory for Helix

* Incorporate changes in ProcessEx

* Include Grpc test in regular build

* Fixup

* Test

* exe doesn't always exist

* Capture logs on helix

* Maybe this will work

* There are two application started messages

* Derp

* Cleanup

* Update directory

* Add interop tests to more pipelines

* mkdir

Co-authored-by: John Luo <johluo@microsoft.com>
2020-03-20 19:32:45 -07:00
Hao Kung b4220d5c23
[Helix] Also upload logs from windows queues (#20005) 2020-03-20 15:17:39 -07:00
Brennan 78fce45039
Remove global xunit max thread setting (#19944) 2020-03-18 10:39:25 -07:00
Brennan f5a2245957
Use xunit.runner.json in Helix runs (#19922) 2020-03-17 12:26:40 -07:00
Hao Kung 124a0b6b38
[Helix] Reenable some template tests again (#19520) 2020-03-08 14:05:06 -07:00
Brennan 56fb4b4d2f
Rename Flaky attribute (#19469) 2020-03-04 08:10:18 -08:00
Hao Kung 46460f0070
Revert "[Helix] Reenable some Templates tests 2.0 (#19383)" (#19519)
This reverts commit 5e2a7726c6.
2020-03-03 04:43:48 +00:00
Hao Kung 5e2a7726c6
[Helix] Reenable some Templates tests 2.0 (#19383) 2020-03-02 11:43:34 -08:00
Hao Kung 4498058343
[Helix] Shared framework support + Templates tests (#19177) 2020-02-26 12:55:41 -08:00
Brennan b125c76d5f
Fix watch tests again (#19155) 2020-02-20 16:03:48 -08:00
Brennan e3a5f03e24
Run Java tests on Helix (#18938) 2020-02-19 13:18:12 -08:00
Hao Kung 853d8f02e7
Use dotnet-helixapi-access token for internal helix builds 2020-02-18 15:51:13 -08:00
Brennan b6d433c4b6
Run helix tests locally (#19031) 2020-02-14 14:22:23 -08:00
Hao Kung 1bd2b5f19e
[Helix] Only run flaky tests on quarantine runs (#18937)
* Only run flaky tests on quaratine run

* Only run flaky tests on quarantine run

* Rename to QUARANTINE

* Rename to QUARANTINE
2020-02-11 22:29:02 +00:00
Brennan 060657113c
Workaround to possibly fix flaky tests? (#18926)
Locally this seems to fix some unknown issue that is causing the dotnet test process to stop running for a few seconds which can result in test failures.
2020-02-10 14:43:27 -08:00
Stephen Halter 602f4678c1
Capture file-backed mappings in Linux core dumps (#18897) 2020-02-08 02:33:44 +00:00
Andrew Stanton-Nurse 91219a655b
[Helix] Add more metadata (#18719) 2020-01-31 12:47:32 -08:00
Andrew Stanton-Nurse 26b9e60dc6
Add build metadata to Helix Job (#18703) 2020-01-31 08:40:06 -08:00
Hao Kung e8363b1cc9
[Helix] Split flaky helix tests into separate yml (#18597) 2020-01-29 09:18:05 -08:00
Hao Kung 9501874f3a
Use vstest xml logger for helix (#18491) 2020-01-24 09:38:16 -08:00
Hao Kung f1dba10a34
[Helix] Better logging (flaky tests, logged tests) (#18274) 2020-01-21 14:03:01 -08:00
Kevin Pilch 0517745c08 aspnet/AspNetCore -> dotnet/aspnet
Except aspnet/AspNetCore-Internal.
2020-01-08 16:40:11 -08:00
Matt Galbraith a438e221bf
Add -Force to Expand-Archive
As noted in the console spew of this test:  https://helix.dot.net/api/2019-06-17/jobs/82bbddae-4a56-4002-b3ee-a8768311a92b/workitems/Microsoft.AspNetCore.SpaServices.Extensions.Tests-netcoreapp3.0/console it's quite possible for Node to be unpacked, but not on the path (generally on a helix machine it's because your parent process was created before the previous guy who unzipped Node and put it on the path ran, so only after reboot would you see the effect you want.
2019-09-05 16:52:23 -07:00
Hao Kung 6dc65b1673
[Helix] run on arm queues (#11422) 2019-06-30 01:04:53 -07:00