Commit Graph
86 Commits
Author SHA1 Message Date
Mike Baum 55af9f3072 [QT-516] Add a step to the enos run workflow to automatically upload application logs when a scenario fails (#3137) 2023-04-03 14:42:30 -04:00
Timothy Messier e4fbc0281a chore(ci): Update and pin actions steps 2023-03-29 18:39:01 +00:00
Michael Li 8c796d0fc9 chore(enos): Use docker image generated from code (#3100) 2023-03-22 10:47:17 -04:00
Michael Li 05eb6fba63 Revert "chore(enos): Pin terraform to 1.3.9 to mitigate bug (#3087)" (#3094) 2023-03-16 16:54:47 -04:00
Michael Li 4e697d4dd5 chore(enos): Pin terraform to 1.3.9 to mitigate bug (#3087) 2023-03-15 14:09:35 -04:00
Michael LiandJohan Brandhorst-Satzkorn acda0c3892 chore(enos): Add scenario that uses docker containers for infrastructure (#3073)
Co-authored-by: Johan Brandhorst-Satzkorn <johan.brandhorst@gmail.com>
2023-03-15 10:07:36 -04:00
Michael Li e0b50af7c3 chore(enos): Use cache for tparse (#3057) 2023-03-08 10:03:11 -05:00
dependabot[bot] 4819d17ee8 chore(deps): bump aws-actions/configure-aws-credentials (#3060)
Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 023daa7fe5f7f817faa31fc0fc4a8d0fb6224ed0 to e1e17a757e536f70e52b5a12b2e8d1d1c60e04ef.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws-actions/configure-aws-credentials/compare/023daa7fe5f7f817faa31fc0fc4a8d0fb6224ed0...e1e17a757e536f70e52b5a12b2e8d1d1c60e04ef)

---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-03-07 15:16:06 -05:00
Michael Li 1f55136d87 chore(enos): Use node16 version of action (#3051) 2023-03-02 16:45:22 -05:00
Michael Li 420952f6b8 chore(enos): Add scenario for e2e UI tests (#2813) 2023-03-02 14:32:53 -05:00
Timothy Messier 236d7ca872 ci: Additional githubaction configuration (#3034)
- Pin action versions
- Dependabot to notify about action updates
- Update codeowners
2023-03-01 08:00:46 -05:00
Timothy Messier 18b0bcb395 chore(ci): Revert some permission settings
These workflows seemed to break with these permission changes.
2023-02-23 21:14:53 +00:00
Timothy Messier 2a47e9ddf8 ci: Set permissions in workflows (#3011) 2023-02-23 15:50:26 -05:00
Michael Li 7733677e34 chore(enos): Modify destroy condition (#3001)
Sometimes, the workflow can fail before enos is even installed, which causes this step to fail due enos not existing.
This change makes it such that this step only runs if the Retry step fails.
2023-02-23 11:58:43 -05:00
Michael Li 9512b524f2 chore(enos): Always destroy enos infrastructure (#3000)
When the `Run Enos scenario` and `Retry Enos scenario` steps fail, the Destroy command does not get run since the `Retry` step marks the workflow as failed. This leaves some infrastructure hanging around.
2023-02-22 17:42:19 -05:00
Michael Li 235ded684b chore(enos): Update test suite slack bot with different messages (#2993)
* chore(enos): Update slack bot to post different messages when retry succeeds

* Remove unused variables
2023-02-22 13:38:46 -05:00
Mike Baum e1d078fa9f [QT-444] Use repo isolated AWS account for enos CI tests (#2727)
* [QT-444] Use repo isolated AWS account for enos CI tests
2023-02-16 17:07:30 -05:00
Timothy Messier 876b25fead ci: Use variable for runner (#2981) 2023-02-16 16:17:04 -05:00
Michael Li bb6d1cad58 chore(enos): Reset status on job retry (#2954) 2023-02-13 14:00:23 -05:00
Michael Li 9dcf605251 chore: Add slack notifications when e2e or bats tests fail (#2946) 2023-02-10 09:27:26 -05:00
Michael Li 62e7335c54 chore: Update deprecated set-output command (#2879)
GitHub is deprecating `set-output`. Updating these commands to their new recommended approach.
2023-02-09 17:08:40 -05:00
Michael Li d1429a40df chore(enos): Remove bats test from running in enos (#2929)
* chore(enos): Remove bats tests from enos

* chore(enos): Update cache name to match vault version
2023-02-07 16:30:38 -05:00
Michael Li 2f9727e8cf chore(enos): Upload e2e test output (#2863)
* chore(enos): Upload e2e go test output

* chore(enos): Add retention period
2023-01-31 17:28:54 -05:00
Michael Li 5fd66b8d88 chore(enos): Remove unused skip_failing_bats_tests variable (#2844) 2023-01-25 12:44:04 -05:00
Michael Li 74f7ce93bc chore(e2e): Update to use Vault 1.12.2 (#2726) 2022-12-19 14:29:25 -05:00
Michael Li 26a85ef61b chore(e2e): Better output formatting (#2719)
Updating the `go test` command to include a table summary of test results at the end. This is the same command used by unit tests.
2022-12-15 14:57:24 -05:00
Michael Li 1596b02e53 test(e2e): Add database migration test (#2627)
* test(e2e): Add database migration test

* chore(enos): Add enos scenario for migration test

* chore(enos): Update go test command to use count option

* doc(e2e): Update readme with migration test details

* Fix: Typo

* CR: Use different library

* CR: Add additional context in comment

* CR: Move some code from test into functions

* doc(e2e): Add instructions to more easily retrieve environment variables

* refact(e2e): Create some more methods to increase test readability
2022-12-13 17:00:50 -05:00
Michael Li c20bd8a37e chore(e2e): Update to use latest version of Vault CLI (#2585) 2022-11-01 13:13:00 -04:00
Michael Li 0424d379cf refact(e2e): Reorganize test directory
Rearranges the directory structure to align better with the enos scenarios. Tests will now be added in the `tests` directory, with a folder in the directory corresponding to an enos scenario.
2022-10-27 17:40:13 -04:00
Michael Anthony b5ef8a516b QT-351 - Output Terraform and provider version information in Enos workflows (#2564)
* Add tf core and module version output step

* Add generate step before getting versions
2022-10-26 11:48:17 -06:00
Michael Li 5365b29007 refact(e2e): Port enos smoke test into e2e test suite
This adds a test case to the e2e test suite and unifies where testing is located.
2022-10-12 09:49:08 -04:00
871cf0b963 chore: Add workflow for e2e tests
This adds a github actions workflow to run the new e2e test suite

Co-authored-by: Michael Anthony <manthony@hashicorp.com>
Co-authored-by: Josh Brand <jbrand@hashicorp.com>
2022-10-06 18:35:23 -04:00
Ryan Cragun 6983bb7d41 enos: don't fail fast in enos integration matrix (#2416)
Disable the fail-fast feature for the matrix strategy. This prevents a
single failure to cascade to all jobs in the matrix. This prevents cases
where other jobs fail before they're able to clean up resources.

Signed-off-by: Ryan Cragun <me@ryan.ec>
2022-09-01 13:16:56 -06:00
Johan Brandhorst-Satzkorn d4fce6fbe1 fix: Move enos job attribute into enos-run workflow (#2374)
Maybe this will fix it? This doesn't make any sense.
2022-08-17 20:39:12 -04:00
Jaymala 369f818f4c Update Enos run (#2326)
* Rotate the credential used for the Enos SSH Key
* Use the enos provider from TFC

Signed-off-by: Jaymala Sinha <jaymala@hashicorp.com>
2022-08-16 11:07:19 -06:00
9169c6bacb [QTI-220] Add infrastructure integration testing (#2282)
* [QTI-275] Add infrastructure integration testing

On pull requests that originate from branches of the `hashicorp/boundary`
repo, we now conditionally dispatch infrastructure integration tests using
the Enos framework. The `integration` Enos scenario includes two `builder`
variants which allow developers or CI to deploy a Boundary cluster in AWS
using either a local `boundary` install bundle or that which is produced
in the `build` workflow for CRT. The `test` variants determine which type
of infrastructure integration test to run. At present those options are
`cli_ui` (Bats CLI tests) or `smoke` (creates target instances and a
target host catalog and verifies that `boundary` works).

In addition to the new workflow and quality scenarios, we simplified the
some `build` workflow steps and added Go module caching to speed up the
build pipeline.

See the [enos/README.md](https://github.com/hashicorp/boundary/blob/main/enos/README.md)
for a detailed explanation on how to configure and execute Enos scenarios
from your machine.

Signed-off-by: Ryan Cragun <me@ryan.ec>
Co-authored-by: Rebecca Willett <rwillett@hashicorp.com>
Co-authored-by: Josh Branch <jbrand@hashicorp.com>
2022-07-28 14:48:51 -06:00