* ci: Initial Terraform configurations (Work in Progress) * ci: Add Terraform scripts and configurations for java-accessapproval, java-bigqueryconnection, and java-container * fix: Remove hardcoded project prefix, and replace with environment variable. * fix: Ensure 'set-quota-project' is set to the created GCP project. Despite generating an error, it works and is necessary. * fix: Workaround set-quota-project not working when previous quota project has been deleted. Remove unused required provider. * chore: Add 'auto_create_subnetworks' to container network configuration. * fix: Add predestroy stage. Remove container network from tfstate to avoid destroy failure. * chore: Refactor script to split project and module provisioning. Support persistent and single-use project use cases. See ./.terraform/README.md * chore: Add java-compute terraform config * chore: Add java-containeranalysis terraform config * chore: Add java-datacatalog terraform config * chore: Add java-datalabeling terraform config * chore: Add java-errorreporting terraform config * chore: Add java-game-servers terraform config * chore: Add java-iot terraform config * chore: Add java-kms terraform config * chore: Add java-monitoring terraform config * chore: Add java-resourcemanager terraform config * chore: Add java-secretmanager terraform config * chore: Add java-speech terraform config * chore: Add java-trace terraform config * chore: Add java-translate terraform config * chore: Add java-video-intelligence terraform config * chore: Add java-vision terraform config * chore: Refactor solution to use single generated Terraform root module for all provisioning. Separate 'destroy' stage. Support module-specific output variables, environment variables, and predestroy scripts. Add java-redis, java-dataflow. * chore: Add java-asset * chore: Add java-iam-admin * chore: Add java-notebooks * chore: Add java-texttospeech * chore: Add java-dataproc * chore: Add java-tasks * fix: Remove unintentional .kokoro/build.sh modification. * fix: Ensure compute API is enabled prior to requesting compute default service account. * chore: Create and Impersonate a Service Account on the Terraform-created Project * chore: Add java-dns terraform configuration * chore: Add java-dialogflow and java-dialogflow-cx terraform configurations * fix: Ensure environment variables are correctly added when performing full build. * fix: Fail fast if terraform apply fails. * chore: Rework module output and env.sh design to eliminate need for file parsing. * chore: Add java-notification support * fix: Ensure environment variables are set with script if not already available. * fix: Add time delay to allow role/permissions to apply to service account prior to using those privileges. * fix: Relocate invocation of generated-env.sh to ensure consistent application. * chore: Support 'y' argument to destroy.sh to destroy the project non-interactively. * fix: Destroy modules before project to ensure clean starting point for next iteration. * chore: Add test-individually.sh, which iterates through each terraform configuration with a fresh project each time. * fix: Apply predestroy.sh to <root>/.terraform state. * chore: Add java-scheduler, although not yet reliable. * chore: Add java-oslogin. Not currently working. * fix: Rework of Terraform logic to use single root module. Project and service account are now optionally created with gcloud CLI. * fix: cleanup * fix: Ensure cloudresourcemanager.googleapis.com is enabled prior to starting terraform. * fix: Workaround for 'Resource Exhausted' error given first time running Scheduler job. * fix: Re-enable job and topic deletions during Scheduler IT clean up. * fix: Re-enable application-default login and add delay after enabling cloudresourcemanager.googleapis.com * fix: Apply retry to v1beta1 Scheduler IT * fix: Sleep immediately after gcloud project creation to allow default Cloud APIs time to be enabled. * fix: Add 10s delay after creating service account and before assigning roles to it. * fix: Replace compound assertion statement with fine-grain assertions to diagnose intermittent failure. * fix: Add delay to allow service account permissions to settle. * chore: Handle generated-outputs.template.tf same as generated-main+variables.template.tf(s) * fix: Assign gcloud_account local variable before using it. Comment improvements. * fix: Synchronize environment using common script when entering individual stages. * fix: Fail ITHeadersTest if server does not respond to request, rather than later NPE. * fix: Sleep syntax, and no longer sync environment before apply.sh * fix: DRY and remove unnecessary resources from template. * Revert "fix: Fail ITHeadersTest if server does not respond to request, rather than later NPE." This reverts commit 68e6e14. * chore: Explicit error when headers is null. * chore: Make API enabling and disabling behaviors variables, following Google best practices https://cloud.google.com/docs/terraform/best-practices-for-terraform#activate-apis * fix: Increase retries and retry delay in Scheduler IT to ensure enough time is allowed for the Scheduler API's queue to be initialized. * fix: Add region to submodule input object. Fix typo. * fix: When running ITs with terraform, ignore os-login, recommender, and talent libraries. * chore: DRY friendly output module name, and module output value parsing. * fix: Randomize Dialogflow Agent name. * fix: Randomize Container Network name. * fix: Attempt to refresh Terraform's state if no project ID is in its output. * chore: Add java-recommender Terraform configuration, and adjust IT to support skipping the 'count' test. * chore: Improve ./.terraform/README.md * fix: Only invoke predestroy.sh for active modules. * chore: Refactor all Terraform project setup steps into setup.sh * chore: Add java-talent Terraform configuration * chore: Simplify * fix: Consistent application of variable rename * fix: Wait 60s after service account creation to mitigate errors due to initialization timing. * chore: Slightly lengthen initialization waiting time for service account. Remove project creation waiting time. * fix: Additional delay and comment around scheduler retry. * chore: Remove ./.terraform/README.md while offline review continues. * fix: Don't prepend "serviceAccount:" when using member "allAuthenticatedUsers" * chore: Change module delimiter from ':' to ',' for consistency with .kokoro scripts. * ci: Initial investigation of Terraform in Kokoro integration tests * chore: Use Terraform during Kokoro integration test. * chore: Split 'gcloud' steps from 'terraform' steps in preparation for Kokoro invocations which will already have a GCP project and service account available. * fix: Return to previous working directory after plan.sh * chore: Use set -eo pipefail rather than explicit "|| exit" * chore: Use set -eo pipefail rather than explicit "|| exit" * chore: Remove 'test-individually.sh' * fix: Ignore 'java-recommender' IT rather than modifying logic. * chore: release main (#8610) * chore: release main * chore: manual fix Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: ddixit14 <deepankardixit@google.com> * build: have release-please tag releases (#8615) * ci: Change project from gcloud-devel to cloud-java-ci-tests * ci: Update kokoro credential to cloud-java-ci-it-service-account * fix: Revert ITHeadersTest changes to same as main * fix: Remove unused import * fix: Apply mvn com.coveo:fmt-maven-plugin:format * ci: Terraform now used in Kokoro integration tests * ci: Temporarily disable Terraform in integration tests * ci: Echo shell commands to console for debugging. * fix: Remove random suffix from Dialogflow Agent label, as only one agent can exist per project per region. * chore: Convert Terraform configs from using project-services module to google_project_service resources * fix: Correct input variable syntax * fix: Unset IFS prior to command invocation * chore: Disable -x flag to reduce scripting noise. * fix: Use 'trap' to ensure Terraform destroys provisioned resources on failed builds. * chore: Disable predestroy scripts for java-container and java-redis to test deletabliity of the VPC networks * chore: Measure Terraform setup and teardown time * Revert "chore: Disable predestroy scripts for java-container and java-redis to test deletabliity of the VPC networks" This reverts commit 37ba287. * chore: mvn install all modules * fix: Don't suppress exception in ITKmsTest * fix: Disable random suffix on Redix and Container integration test networks. * fix: Add variable to optionally create networks for ITs. Default is false. * fix: Automatically create new network or use existing network for redis and container ITs. * chore: Temporary log output for Kokoro debugging. * fix: Ensure 'destroy' occurs if failure during 'apply'. * fix: Set gcloud project in Kokoro before performing init. * fix: Revert destroy invocation change * fix: Add java-redis preplan.sh * chore: @ignore java-notification integration test * fix: Run formatter * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * fix: Only forget resource if Terraform knows about it. * fix: Retry on empty landmark result from Vision API * fix: Lint formatting * chore: Simplify java-container.ITSystemTest.getContainerNetworkName() * fix: Shell script case-statement indentation * fix: Don't let Terraform destroy the Dialogflow Agent. * fix: Don't let Terraform unassign permissions from default service agent. * fix: Re-enable notification system test with lesser permissions on pubsub topic. * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * fix: Disable notification system test * ci: Add terraform-integration Kokoro build config. Maintain gcloud-devel non-terraform build. * fix: Rename .terraform folders to .cloud * chore: Add .cloud/README.md * fix: Correct name of run_integration_tests * fix: Additional .terraform rename locations. * fix: Add .terraform.lock.hcl file Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: ddixit14 <deepankardixit@google.com> Co-authored-by: Jeff Ching <chingor@google.com> Co-authored-by: Lawrence Qiu <lawrenceqiu@google.com> Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

Breadcrumbs

User selector

Commit History

Commits on Nov 8, 2022

ci: Initial investigation of Terraform in Kokoro integration tests (#8555)