Host:
OS: Ubuntu 16.04
Disable apparmor
| Code Block |
|---|
$ /etc/init.d/apparmor stop
$ /etc/init.d/apparmor teardown
$ update-rc.d -f apparmor remove |
Isolate 2 cores from the OS by modifying: /etc/default/grub
| Code Block |
|---|
GRUB_CMDLINE_LINUX_DEFAULT="text isolcpus=10,11"
|
Update grub:
| Code Block |
|---|
$ sudo update-grub |
Reboot
Install barometer build-essentials:
| Code Block |
|---|
$ git clone https://gerrit.opnfv.org/gerrit/barometer $ ./src/install_build_deps.sh |
Install virtualization pacakges packages and other required packages:
| Code Block |
|---|
$ sudo apt install qemu-kvm libvirt-bin virtinst virt-manager screen |
...
| Code Block |
|---|
sudo adduser $USER libvirtd |
Create a dir to store ISOs
| Code Block |
|---|
$ sudo mkdir /usr/local/src/images/ $ cd /usr/local/src/images/ $ sudo -E wget http://releases.ubuntu.com/16.04/ubuntu-16.04.2-server-i386.iso |
Ceate a Test VM
| Code Block |
|---|
$ sudo virt-install -n test -r 256 --disk path=/var/lib/libvirt/images/test.img,bus=virtio,size=4 -c /usr/local/src/images/ubuntu-16.04.2-server-i386.iso --network network=default,model=virtio --graphics vnc,listen=0.0.0.0 --noautoconsole -v |
connect Connect to the console to complete the installation process.
...
Clone the latest libvirt code, build and install collectd:
| Code Block |
|---|
$ git clone https://github.com/maryamtahhan/collectd.git mt_collectd $ cd mt_collectd $ ./build.sh $ ./configure |
Check that the virt plugin is configured:
| Code Block |
|---|
virt . . . . . . . . yes |
Install collectd:
...
| Code Block |
|---|
|
$ sudo make -j install |
Install collectd as a service:
| Code Block |
|---|
sudo mv systemd.collectd.service collectd.service sudo chmod +x collectd.service vi collectd.service |
Edit the collectd.service script
| Code Block |
|---|
[Service] |
...
#ExecStart=/usr/sbin/collectd |
...
ExecStart=/opt/collectd/sbin/collectd -C /opt/collectd/etc/collectd.conf |
...
#EnvironmentFile=-/etc/sysconfig/collectd |
...
#EnvironmentFile=-/etc/default/collectd |
...
ProtectSystem=fullProtectHome=true...
ProtectSystem=full
ProtectHome=true |
Modify the /opt/collectd/etc/collectd.conf file
| Code Block |
|---|
<LoadPlugin cpu>
Interval 1
</LoadPlugin>
<LoadPlugin virt>
Interval 1
</LoadPlugin>
LoadPlugin csv
LoadPlugin network
<Plugin cpu>
ReportByCpu true
ReportByState false
ValuesPercentage true
</Plugin>
<Plugin csv>
DataDir "/tmp/collectd/csv"
# StoreRates false
</Plugin>
<Plugin network>
# server setup:
Listen "<host ip address>" "28597"
<Listen "<host ip address>" "28597">
</Listen>
</Plugin>
<Plugin virt>
Connection "qemu:///system"
# RefreshInterval 60
# Domain "name"
# BlockDevice "name:device"
# BlockDeviceFormat target
# BlockDeviceFormatBasename false
# InterfaceDevice "name:device"
# IgnoreSelected false
HostnameFormat uuid
# InterfaceFormat name
# PluginInstanceFormat name
Instances 1
ExtraStats "disk pcpu"
</Plugin>
|
Core 10 and 11 were isolated from the OS using the isolcpus argument to grub command line and using virsh to Pin the vCPUs to those cores (Requires KVM acceleration):
| Code Block |
|---|
$ virsh vcpupin test 0 10
$ virsh vcpupin test 1 11 |
To check for KVM acceleration see that the response to the command below is > 0:
| Code Block |
|---|
$ cat /proc/cpuinfo | egrep -c '(vmx|svm)' |
without KVM acceleration you will need to taskset the qemu threads to the isolated cores:
| Code Block |
|---|
$ grep pid /var/run/libvirt/qemu/test.xml
<domstatus state='running' pid='4907'>
$ grep Cpus_allowed_list /proc/4907/task/*/status
/proc/4907/task/4916/status:Cpus_allowed_list: 4
/proc/4907/task/4917/status:Cpus_allowed_list: 5
/proc/4907/task/4918/status:Cpus_allowed_list: 6
/proc/4907/task/4919/status:Cpus_allowed_list: 7
</section> |
To taskset the process + tasks repeat the following for the PID and the subtasks:
| Code Block |
|---|
$ taskset -pc 4 4907... |
Guest
OS: Ubuntu 16.04.2 LTS
Install collectd and stress
| Code Block |
|---|
$ sudo apt install collectd stress stress-ng |
configure /etc/collectd/collectd.conf
| Code Block |
|---|
Hostname "ubuntu_vm"
<LoadPlugin cpu>
Interval 1
</LoadPlugin>
LoadPlugin network
<Plugin cpu>
ReportByCpu true
ReportByState false
ValuesPercentage false
</Plugin>
<Plugin network>
# # client setup:
Server "<HOST IP>" "28597"
<Server "<HOST IP>" "28597">
</Server>
</Plugin> |
Start collectd on the host and the guest
| Code Block |
|---|
$ service collectd start |
Run Stress in the VM on a single core
| Code Block |
|---|
$ taskset 1 stress -c 2 -t 10
stress: info: [1422] dispatching hogs: 2 cpu, 0 io, 0 vm, 0 hdd
stress: info: [1422] successful run completed in 10s
|