Commit Graph

74 Commits

Author SHA1 Message Date
guoguangwu
e4b396e870 chore: unnecessary use of fmt.Sprintf d
Signed-off-by: guoguangwu <guoguangwu@magic-shield.com>
2023-11-12 21:08:23 +08:00
wanyaoqi
ba4437434b fix(host): detect blk dev numqueues and nics(no id) pci addresses 2023-10-31 19:20:17 +08:00
wanyaoqi
57a517c98d fix(host): check qga connect is closed (#18271) 2023-10-12 14:48:53 +08:00
Zexi Li
d710057616 Merge pull request #18065 from wanyaoqi/fix/cancel-migrate
fix(region,host): cancel migrate sync guest status
2023-09-21 22:40:15 +08:00
chentianxiang
4fd11f2900 feat(region,host,host-deployer):use qga set network 2023-09-20 16:25:09 +08:00
wanyaoqi
7ebff96fe0 fix(region,host): cancel migrate sync guest status 2023-09-20 00:13:31 +08:00
wanyaoqi
9d5d96b1f1 fix(host): nvidia vgpu hotplug
Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2023-09-14 21:07:39 +08:00
wanyaoqi
a36d9767af fix(region,host): qga command timeout (#17465)
Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2023-07-12 16:14:55 +08:00
wanyaoqi
3db004d5a8 fix(region,host): virtio dirver local disk live migrate
Guest using the virtio-blk driver for local disks, iothread is used to
handle IO operations, Qemu will segfault when copying disks during live
migration. To address this issue, use nbd server and drive_mirror
approach to copy the disks.
2023-06-13 16:32:24 +08:00
wanyaoqi
0e9d206867 fix(region,host): block jobs progress refactor
Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2023-03-19 21:21:30 +08:00
wanyaoqi
904e7b31a5 Automated cherry pick of #15664: Automated cherry pick of #15618: fix(host): use drive backup sync backup disks (#15681)
* fix(host): use drive backup sync backup disks

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>

* fix(region,host): guest backup backend use fetcherfs

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2023-01-02 11:58:14 +08:00
wanyaoqi
e1d3635b0a fix(region,host): migrate use source desc file. (#15623) 2022-12-27 16:50:47 +08:00
wanyaoqi
659c455818 fix(region,host): backup guest refactor 2022-12-14 23:58:00 +08:00
wanyaoqi
f5415697b9 fix(host): convert migrate set downtime value to float64 (#15475)
* fix(host): convert migrate set downtime value to float64

* fix(host): live migration optimize

Qemu will send `STOP` event on start last time migration, but this
moment migration not completed. So we need wait magration complete.
Configurable Auto converge max cpu throttle.
2022-12-08 14:45:37 +08:00
wanyaoqi
434f487e4f fix(region,host): live migrate quickly converge (#15419) 2022-11-22 12:26:08 +08:00
Zexi Li
0e2c520ecd feat(misc): use cloudmux package (#15254) 2022-10-28 19:53:03 +08:00
wanyaoqi
e83b167e43 feat(host): qemu kvm cpu caps 2022-10-11 18:34:38 +08:00
wanyaoqi
79dfa27ca5 fix(host): live migrate optimize (#14996)
- support set live migrate bandwidth
- support cancel migrate
- live migrate enable multifd
- cancel set live migrate max downtime in init live migrate
- save and sync guest desc and start script on sync config
- init machine pci addresses on load guest desc
- load memory devices for guests not init pci addresses
- attach network set upscript and downscript
- add a guest launcher for redirect qemu stdout/stderr
- start monitor on guest script start
- fix guest hotplug cpu and mem not update desc
2022-09-23 14:09:33 +08:00
wanyaoqi
9459ad7e61 fix(host): generate pci address for guests created
Generate pci addresses for guests create before structure desc.
Read guest pci info from qmp query-pci command and fill guest
description.
Guest desc add field AnonymousPCIDevs to save unidentified pci devices
address.
2022-09-08 20:36:42 +08:00
wanyaoqi
1570b17eb3 fix: gen copyright
Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2022-08-28 13:52:25 +08:00
wanyaoqi
b4a347f237 feat(qga): add server-qga-command
usage:
climc server-qga-command <ID> <QGA_RAW_COMMAND>

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2022-08-28 13:51:21 +08:00
wanyaoqi
63b30cef60 feat(region,host): qga set user password
Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2022-08-28 13:51:21 +08:00
wanyaoqi
48ce4b31cd feat(host): describe pci controller and devices in guest desc (#14826)
- describe pci controller and devices in guest desc.
- extend pcie bus and pcie-to-pci bridge and root ports, disks and
nics default attach to pci-bridge for support hotplug.
- generate pci address on guest starts
- live guest desc for running guest, and save source desc

Signed-off-by: wanyaoqi <wanyaoqi@yunion.cn>

Signed-off-by: wanyaoqi <wanyaoqi@yunion.cn>
2022-08-24 16:33:42 +08:00
wanyaoqi
e26ea2ebb3 feat(region,host): server-monitor support qmp
server-montior add qmp option, default is hmp.

usage:
    climc server-monitor --qmp <ID> <COMMAND>

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2022-07-14 16:17:53 +08:00
wanyaoqi
d51d7599d2 feat(region,host): refector guests cgroups (#14558)
* feat(region,host): refector guests cgroups

hostagent will create a root group cloudpods.hostagent at init.
guests group under cloudpods.hostagent. Qemu start params add '-S'
option freeze guest at first, after guest set cgroup or other initialize
hostagent will resume guest.

host support reserve cpus. if has reserved cpus, hostagent will create a
group cloudpods.hostagent.reserved, one thing to note is set host
reserved cpus must ensure host no guests running.

climc usage:
  climc host-reserve-cpus --cpus '2-3,32-33' --mems '0-1' \
    --disable-sched-load-balance <IDS>

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>

* hostman: disable cpuset balancer

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2022-07-02 18:00:48 +08:00
wanyaoqi
f163690191 feat(host,region): suport live change disk storage (#14342)
Guest start drive mirror job to copy full disk to target, after drive
mirror job ready, guest reopen target disk to replace source disk.
Qemu must support block reopen image feature.

Supported storage: local, ceph

Signed-off-by: wanyaoqi <d3lx.yq@gmail.com>
2022-06-03 01:47:48 +08:00
Jian Qiu
94f509a524 fix: hide server rtc_change event log (#14334)
Co-authored-by: Qiu Jian <qiujian@yunionyun.com>
2022-05-28 09:07:22 +08:00
Jian Qiu
3f9be08fa3 Feature/qj encryption support snapshot backup (#14191)
* feature: encryption support snapshot and backup

* fix: encrypted snapshot create

* fix issues with backup encryption

Co-authored-by: Qiu Jian <qiujian@yunionyun.com>
2022-05-03 11:39:55 +08:00
Qiu Jian
2cd805ead6 fix: migrate set down time 2022-04-12 20:17:08 +08:00
Qiu Jian
df5bb58318 fix: migrate set downtime 2022-04-05 15:16:46 +08:00
Zexi Li
c0a0121d2b feat(host): server instance snapshot with memory 2022-03-03 13:53:11 +08:00
Zexi Li
6a71444b27 feat(region,host): tls live migrating 2022-01-27 10:32:54 +08:00
Qiu Jian
d81d6cc368 fix: guest sync status persistent block_stream status 2022-01-11 10:20:57 +08:00
ioito
2bfdc5fe75 fix(host): migrate progress 2022-01-04 15:58:36 +08:00
ioito
244d643680 fix(host): qemu block device 2021-12-31 17:36:40 +08:00
Qiu Jian
255be9e2c3 fix: add migrate progress metrics 2021-12-26 00:15:16 +08:00
ioito
db981a146b fix(host): add vm clonse progress and mbps 2021-12-24 20:03:31 +08:00
ioito
d62d6abf7a fix(host): add speed info for block-job 2021-12-20 15:52:45 +08:00
Qiu Jian
c67f1bde5b fix: server migration halted by an unexpected STOP event 2021-12-18 22:00:06 +08:00
Zexi Li
70edbdcb3c fix(host): adjust kvm block_stream query frequency and speed limit 2021-12-08 10:17:28 +08:00
wanyaoqi
980396f151 dirve mirror check block replication is support 2020-10-28 10:51:33 +08:00
wanyaoqi
c74d8ca0c7 hotplug network device 2020-01-18 15:01:08 +08:00
wanyaoqi
908b9c3ce9 fix instance-snapshot create 2019-11-11 19:35:44 +08:00
wanyaoqi
0a02db5cfd support hmp 2019-10-28 19:03:39 +08:00
wanyaoqi
2d0dfc95ff misc bugfix 2019-09-10 22:28:21 +08:00
yunion-ci-robot
4ce5b3c2eb Merge pull request #2741 from wanyaoqi/bugfix/wyq/io-throttle-add-log-event
bugfix: io throttle add log event
2019-09-07 19:08:18 +08:00
wanyaoqi
d9b9586539 fix vnc connect, filter qmp event 2019-09-05 20:59:14 +08:00
wanyaoqi
41317e1a5e io throttle add log event 2019-09-05 20:30:40 +08:00
wanyaoqi
8376d14d42 io throttle 2019-08-22 20:50:32 +08:00
wanyaoqi
34bce15cb4 import running libvirt guests 2019-06-24 16:52:20 +08:00