systemvmtemplate: reduce template by using cloud kernel #5070

rohityadavcloud · 2021-06-03T10:50:41Z

This switches the systemvmtemplate to use the default linux-image-cloud
kernel from Debian backports (v5.10), we don't really need many of the
kernel modules such as sound drivers etc in the systemvm. This reduces
the space consumed from a whooping 270+MB to just ~70MB by the kernel.

Types of changes

Breaking change (fix or feature that would cause existing functionality to change)
New feature (non-breaking change which adds functionality)
Bug fix (non-breaking change which fixes an issue)
Enhancement (improves an existing feature and functionality)
Cleanup (Code refactoring and cleanup, that may add test cases)

This switches the systemvmtemplate to use the default linux-image-cloud kernel from Debian backports (v5.10), we don't really need many of the kernel modules such as sound drivers etc in the systemvm. This reduces the space consumed from a whooping 270+MB to just ~70MB by the kernel. Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

rohityadavcloud · 2021-06-03T10:52:05Z

experimental PR to just have the cloud kernel as new default cc @weizhouapache - would be a good win if smoketests pass, from notes I see cloud-kernel ships will all the necessary features the systemvmtemplate/VR needs
@blueorangutan package

blueorangutan · 2021-06-03T10:53:03Z

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

blueorangutan · 2021-06-03T11:17:44Z

Packaging result: ✔️ centos7 ✔️ centos8 ✔️ debian. SL-JID 154

rohityadavcloud · 2021-06-03T12:40:26Z

(manually kicked smoketest with systemvmtemplate built from this PR)

…e-4.19.0-16-cloud-amd64 Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

blueorangutan · 2021-06-03T16:45:05Z

Trillian Build Failed (tid-846)

rohityadavcloud · 2021-06-03T16:53:15Z

Unfortunately it doesn't work with 4.9 based linux-image-cloud kernel on Vmware cc @weizhouapache

…th Debian 11 Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

rohityadavcloud · 2021-06-03T17:29:34Z

Closing this in favour of #5073

blueorangutan · 2021-06-03T17:40:23Z

Trillian Build Failed (tid-847)

blueorangutan · 2021-06-04T03:37:39Z

Trillian test result (tid-836)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 51159 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5070-t836-xenserver-71.zip
Intermittent failure detected: /marvin/tests/smoke/test_domain_vpc_offerings.py
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_ssvm.py
Intermittent failure detected: /marvin/tests/smoke/test_volumes.py
Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
Smoke tests completed. 85 look OK, 2 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	3604.65	test_kubernetes_clusters.py
test_02_deploy_and_upgrade_kubernetes_cluster	`Failure`	3613.62	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	0.12	test_kubernetes_clusters.py
test_04_basic_lifecycle_kubernetes_cluster	`Failure`	0.12	test_kubernetes_clusters.py
test_05_delete_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_08_deploy_and_upgrade_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	0.05	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	106.10	test_kubernetes_clusters.py
test_03_ssvm_internals	`Failure`	0.42	test_ssvm.py

blueorangutan · 2021-06-04T05:22:55Z

Trillian test result (tid-834)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 57835 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5070-t834-kvm-centos7.zip
Intermittent failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_password_server.py
Intermittent failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_router_nics.py
Smoke tests completed. 84 look OK, 3 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	3607.85	test_kubernetes_clusters.py
test_02_deploy_and_upgrade_kubernetes_cluster	`Failure`	3611.78	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_04_basic_lifecycle_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_05_delete_kubernetes_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_08_deploy_and_upgrade_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	0.04	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	84.68	test_kubernetes_clusters.py
test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true	`Failure`	318.20	test_routers_network_ops.py
test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false	`Failure`	315.41	test_routers_network_ops.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	`Failure`	499.97	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	`Failure`	503.57	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Failure`	467.98	test_vpc_redundant.py

weizhouapache · 2021-06-04T05:52:16Z

Unfortunately it doesn't work with 4.9 based linux-image-cloud kernel on Vmware cc @weizhouapache

@rhtyd ok...
would it be good if we ship template with cloud kernel for xenserver/kvm, and template with backported kernel for vmware (#5073)?

weizhouapache · 2021-06-04T06:36:47Z

test results on kvm-ubuntu18

Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
Smoke tests completed. 84 look OK, 3 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	3610.56	test_kubernetes_clusters.py
test_02_deploy_and_upgrade_kubernetes_cluster	`Failure`	3601.70	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	0.09	test_kubernetes_clusters.py
test_04_basic_lifecycle_kubernetes_cluster	`Failure`	0.06	test_kubernetes_clusters.py
test_05_delete_kubernetes_cluster	`Failure`	0.07	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	0.08	test_kubernetes_clusters.py
test_08_deploy_and_upgrade_kubernetes_ha_cluster	`Failure`	0.07	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	0.07	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	97.95	test_kubernetes_clusters.py
test_01_migrate_VM_and_root_volume	`Error`	70.32	test_vm_life_cycle.py
test_02_migrate_VM_with_two_data_disks	`Error`	51.98	test_vm_life_cycle.py
test_01_secure_vm_migration	`Error`	107.59	test_vm_life_cycle.py
test_02_unsecure_vm_migration	`Error`	169.95	test_vm_life_cycle.py
test_08_migrate_vm	`Error`	47.26	test_vm_life_cycle.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	`Failure`	511.11	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	`Failure`	436.15	test_vpc_redundant.py

blueorangutan · 2021-06-04T06:47:08Z

Trillian test result (tid-837)
Environment: kvm-ubuntu18 (x2), Advanced Networking with Mgmt server u18
Total time taken: 62287 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5070-t837-kvm-ubuntu18.zip
Intermittent failure detected: /marvin/tests/smoke/test_kubernetes_clusters.py
Intermittent failure detected: /marvin/tests/smoke/test_network.py
Intermittent failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermittent failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
Intermittent failure detected: /marvin/tests/smoke/test_vm_snapshots.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermittent failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Intermittent failure detected: /marvin/tests/smoke/test_host_maintenance.py
Smoke tests completed. 83 look OK, 4 have error(s)
Only failed tests results shown below:

Test	Result	Time (s)	Test File
test_01_invalid_upgrade_kubernetes_cluster	`Failure`	3612.42	test_kubernetes_clusters.py
test_02_deploy_and_upgrade_kubernetes_cluster	`Failure`	3613.50	test_kubernetes_clusters.py
test_03_deploy_and_scale_kubernetes_cluster	`Failure`	0.07	test_kubernetes_clusters.py
test_04_basic_lifecycle_kubernetes_cluster	`Failure`	0.07	test_kubernetes_clusters.py
test_05_delete_kubernetes_cluster	`Failure`	0.07	test_kubernetes_clusters.py
test_07_deploy_kubernetes_ha_cluster	`Failure`	0.06	test_kubernetes_clusters.py
test_08_deploy_and_upgrade_kubernetes_ha_cluster	`Failure`	0.06	test_kubernetes_clusters.py
test_09_delete_kubernetes_ha_cluster	`Failure`	0.06	test_kubernetes_clusters.py
ContextSuite context=TestKubernetesCluster>:teardown	`Error`	97.01	test_kubernetes_clusters.py
test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true	`Failure`	323.04	test_routers_network_ops.py
test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false	`Failure`	321.16	test_routers_network_ops.py
test_01_migrate_VM_and_root_volume	`Error`	73.68	test_vm_life_cycle.py
test_02_migrate_VM_with_two_data_disks	`Error`	50.53	test_vm_life_cycle.py
test_01_secure_vm_migration	`Error`	110.20	test_vm_life_cycle.py
test_02_unsecure_vm_migration	`Error`	170.04	test_vm_life_cycle.py
test_08_migrate_vm	`Error`	46.97	test_vm_life_cycle.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	`Failure`	374.43	test_vpc_redundant.py
test_05_rvpc_multi_tiers	`Failure`	480.06	test_vpc_redundant.py

rohityadavcloud added the component:systemvm-template label Jun 3, 2021

rohityadavcloud added this to the 4.15.2.0 milestone Jun 3, 2021

apache deleted a comment from blueorangutan Jun 3, 2021

kernel from backports fails to boot on vmware :( let's try linux-imag…

e1edc85

…e-4.19.0-16-cloud-amd64 Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

apache deleted a comment from blueorangutan Jun 3, 2021

rohityadavcloud added the type:experimental-feature label Jun 3, 2021

rohityadavcloud removed this from the 4.15.2.0 milestone Jun 3, 2021

alright let's at least try the latest 5.10 kernel which also ships wi…

7f2e9f0

…th Debian 11 Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>

rohityadavcloud closed this Jun 3, 2021

systemvmtemplate: reduce template by using cloud kernel #5070

systemvmtemplate: reduce template by using cloud kernel #5070

Uh oh!

Conversation

rohityadavcloud commented Jun 3, 2021

Types of changes

Uh oh!

rohityadavcloud commented Jun 3, 2021

Uh oh!

blueorangutan commented Jun 3, 2021

Uh oh!

blueorangutan commented Jun 3, 2021

Uh oh!

rohityadavcloud commented Jun 3, 2021

Uh oh!

blueorangutan commented Jun 3, 2021

Uh oh!

rohityadavcloud commented Jun 3, 2021

Uh oh!

rohityadavcloud commented Jun 3, 2021

Uh oh!

blueorangutan commented Jun 3, 2021

Uh oh!

blueorangutan commented Jun 4, 2021

Uh oh!

blueorangutan commented Jun 4, 2021

Uh oh!

weizhouapache commented Jun 4, 2021

Uh oh!

weizhouapache commented Jun 4, 2021

Uh oh!

blueorangutan commented Jun 4, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants