Adding AutoScaling for cks + CKS CoreOS EOL update + systemvmtemplate improvements #4329

davidjumani · 2020-09-16T06:04:55Z

Description

Adding AutoScaling support for cks
Kubernetes PR : kubernetes/autoscaler#3629
Also replaces CoreOS with Debian
Fixes #4198

TODO: Remove the templateid and template name from KubernetesClusterResponse and DB since the templates can vary after acs upgrades

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)

How Has This Been Tested?

TODO

davidjumani · 2020-09-21T06:21:52Z

@blueorangutan package

blueorangutan · 2020-09-21T06:23:05Z

@davidjumani a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-09-21T06:54:41Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2053

davidjumani · 2020-10-20T06:33:04Z

@blueorangutan package

blueorangutan · 2020-10-20T06:33:54Z

@davidjumani a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-10-20T07:06:23Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2209

davidjumani · 2020-10-21T11:33:14Z

@blueorangutan package

blueorangutan · 2020-10-21T11:33:59Z

@davidjumani a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2020-10-21T12:26:14Z

Packaging result: ✔centos7 ✔centos8 ✔debian. JID-2251

davidjumani · 2021-09-29T03:48:10Z

@blueorangutan package

blueorangutan · 2021-09-29T03:50:02Z

@davidjumani a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2021-09-29T05:04:31Z

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 1429

blueorangutan · 2021-09-29T05:06:16Z

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 1430

vladimirpetrov · 2021-09-29T07:52:20Z

@blueorangutan test matrix

blueorangutan · 2021-09-29T07:53:03Z

@vladimirpetrov a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

blueorangutan · 2021-09-29T18:06:13Z

Trillian test result (tid-2233)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35293 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4329-t2233-kvm-centos7.zip
Smoke tests completed. 89 look OK, 0 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File

blueorangutan · 2021-09-29T18:28:45Z

Trillian test result (tid-2232)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36825 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4329-t2232-xenserver-71.zip
Smoke tests completed. 88 look OK, 1 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_04_extract_template	`Failure`	128.33	test_templates.py

blueorangutan · 2021-09-29T18:29:43Z

Trillian test result (tid-2234)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36943 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4329-t2234-vmware-65u2.zip
Smoke tests completed. 88 look OK, 1 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_live_migrate_VM_with_two_data_disks	`Error`	67.74	test_vm_life_cycle.py

rohityadavcloud · 2021-09-30T04:55:39Z

@blueorangutan test centos7 vmware-67u3

blueorangutan · 2021-09-30T04:57:02Z

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-67u3) has been kicked to run smoke tests

blueorangutan · 2021-09-30T15:50:38Z

Trillian test result (tid-2252)
Environment: vmware-67u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 37957 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr4329-t2252-vmware-67u3.zip
Smoke tests completed. 88 look OK, 1 have errors
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_03_live_migrate_VM_with_two_data_disks	`Error`	63.03	test_vm_life_cycle.py

rohityadavcloud · 2021-10-03T09:22:38Z

The vmware failure is same as in the health check PR, so not caused by this PR. Tests LGTM.

alexandremattioli · 2021-10-04T13:33:12Z

LGTM

vladimirpetrov

LGTM based on manual testing.

SystemVM template improvements:
Tested fresh deployments with KVM (CentOS 7), VMWare 67u3 and XCP-NG 8.2.
Tested upgrades from:

ACS version: 4.15
Hypervisor: KVM CentOS 8
Mgmt OS: CentOS 8

ACS version: 4.15
Hypervisor: VMWare 65u2
Mgmt OS: CentOS 7

ACS version: 4.15
Hypervisor: XenServer 7.2
Mgmt OS: Ubuntu 18

ACS version: 4.15
Hypervisor: VMWare 67u3
Mgmt OS: CentOS 7

ACS version: 4.14
Hypervisor: KVM CentOS 7
Mgmt OS: CentOS 7

ACS version: 4.15
Hypervisor: XCP-NG 8.2
Mgmt OS: CentOS 8

ACS version: 4.15.2
Hypervisor: KVM CentOS 8
Mgmt OS: CentOS 8

ACS version: 4.15.2
Hypervisor: VMWare 67u3
Mgmt OS: CentOS 7

ACS version: 4.15.2
Hypervisor: XCP-NG 8.2
Mgmt OS: Ubuntu 20

Kubernetes Cluster auto-scaling

Tested scenarios:

Deploy a v1.20 kubernetes cluster (not HA), setup scaling (min 1, max 2 worker nodes), increase the load, make sure the cluster scales up, stop the load, make sure the cluster scales down.

Deploy a v1.21 kubernetes cluster (not HA), setup scaling (min 1, max 2 worker nodes), increase the load, make sure the cluster scales up, stop the load, make sure the cluster scales down.

Deploy a v1.20 kubernetes cluster (not HA), setup scaling (min 1, max 2 worker nodes), increase the load, make sure the cluster scales up, stop the load, make sure the cluster scales down, upgrade the cluster to v.1.21 and repeat the procedure.

Deploy a v1.21 kubernetes cluster (not HA), setup scaling (min 1, max 3 worker nodes), increase the load, make sure the cluster scales up, change the scaling parameters to min 1, max 2 worker nodes, make sure the cluster scales down to 2 worker nodes, stop the load, make sure the cluster scales down to 1 worker node.

Deploy a v1.20 kubernetes cluster (HA enabled), setup scaling (min 1, max 2 worker nodes), increase the load, make sure the cluster scales up, stop the load, make sure the cluster scales down.

Deploy a v1.21 kubernetes cluster (HA enabled), setup scaling (min 1, max 2 worker nodes), increase the load, make sure the cluster scales up, stop the load, make sure the cluster scales down.

rohityadavcloud · 2021-10-05T05:15:42Z

Ping @alexandremattioli or @andrijapanicsb are you lgtm on this as well?

Pearl1594 · 2021-10-05T05:17:28Z

@rhtyd - @alexandremattioli has already provided their review - #4329 (comment)

rohityadavcloud · 2021-10-05T07:53:02Z

Ah okay thanks @Pearl1594; just a note to @alexandremattioli - please use Github's review -> LGTM that way it's easy to track approvals.
Let's wait for @andrijapanicsb to confirm as well.

nvazquez · 2021-10-05T19:01:02Z

@andrijapanicsb @alexandremattioli please advise after your tests/review, thanks

andrijapanicsb · 2021-10-06T06:54:52Z

Alex is reviewing this, so I will not. Thx

alexandremattioli · 2021-10-06T15:37:54Z

@nvazquez all good with tests. I've used this for some customer demos and worked very well, retested this week and all good. LGTM

rohityadavcloud added this to the 4.16.0.0 milestone Sep 17, 2020

davidjumani force-pushed the add-cks-autoscaling branch 2 times, most recently from 2d14b4d to 8784cc8 Compare September 21, 2020 06:21

davidjumani force-pushed the add-cks-autoscaling branch 2 times, most recently from a155864 to d4e9a9b Compare October 1, 2020 07:24

davidjumani mentioned this pull request Oct 9, 2020

Adding autoscaling for cks apache/cloudstack-primate#733

Draft

davidjumani force-pushed the add-cks-autoscaling branch 2 times, most recently from a1bb7ae to d0569c7 Compare October 21, 2020 11:31

DaanHoogland added the type:new-feature label Oct 21, 2020

davidjumani force-pushed the add-cks-autoscaling branch 2 times, most recently from 5309354 to 90ff19d Compare October 22, 2020 09:26

DaanHoogland added the component:cks label Oct 22, 2020

davidjumani force-pushed the add-cks-autoscaling branch 9 times, most recently from ff1e0fd to 4f00c51 Compare October 28, 2020 05:14

rohityadavcloud approved these changes Sep 30, 2021

View reviewed changes

vladimirpetrov approved these changes Oct 4, 2021

View reviewed changes

rohityadavcloud marked this pull request as ready for review October 5, 2021 07:53

rohityadavcloud requested review from DaanHoogland, Pearl1594 and sureshanaparti October 5, 2021 07:53

rohityadavcloud removed the status:needs-testing label Oct 5, 2021

rohityadavcloud merged commit 6ac834a into apache:main Oct 6, 2021

Pearl1594 mentioned this pull request Oct 11, 2021

Add details for CoreOS replacement with Debian (SystemVM template) + Cluster Autoscaler apache/cloudstack-documentation#168

Merged

weizhouapache mentioned this pull request Dec 30, 2022

system vms agent initialization goes wrong (main branch) #6837

Closed

Adding AutoScaling for cks + CKS CoreOS EOL update + systemvmtemplate improvements #4329

Adding AutoScaling for cks + CKS CoreOS EOL update + systemvmtemplate improvements #4329

Uh oh!

Conversation

davidjumani commented Sep 16, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Types of changes

How Has This Been Tested?

Uh oh!

davidjumani commented Sep 21, 2020

Uh oh!

blueorangutan commented Sep 21, 2020

Uh oh!

blueorangutan commented Sep 21, 2020

Uh oh!

davidjumani commented Oct 20, 2020

Uh oh!

blueorangutan commented Oct 20, 2020

Uh oh!

blueorangutan commented Oct 20, 2020

Uh oh!

davidjumani commented Oct 21, 2020

Uh oh!

blueorangutan commented Oct 21, 2020

Uh oh!

blueorangutan commented Oct 21, 2020

Uh oh!

davidjumani commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

vladimirpetrov commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

blueorangutan commented Sep 29, 2021

Uh oh!

rohityadavcloud commented Sep 30, 2021

Uh oh!

blueorangutan commented Sep 30, 2021

Uh oh!

blueorangutan commented Sep 30, 2021

Uh oh!

rohityadavcloud commented Oct 3, 2021

Uh oh!

alexandremattioli commented Oct 4, 2021

Uh oh!

vladimirpetrov left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rohityadavcloud commented Oct 5, 2021

Uh oh!

Pearl1594 commented Oct 5, 2021

Uh oh!

rohityadavcloud commented Oct 5, 2021

Uh oh!

nvazquez commented Oct 5, 2021

Uh oh!

andrijapanicsb commented Oct 6, 2021

Uh oh!

alexandremattioli commented Oct 6, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

15 participants

davidjumani commented Sep 16, 2020 •

edited

Loading

vladimirpetrov left a comment •

edited

Loading