Host:
OS: Ubuntu 16.04
Disable apparmor
| Code Block |
|---|
$ /etc/init.d/apparmor stop
$ /etc/init.d/apparmor teardown
$ update-rc.d -f apparmor remove |
Isolate 2 cores from the OS by modifying: /etc/default/grub
| Code Block |
|---|
GRUB_CMDLINE_LINUX_DEFAULT="text isolcpus=10,11"
|
Update grub:
| Code Block |
|---|
$ sudo update-grub |
Reboot
Install barometer build-essentials:
| Code Block |
|---|
$ git clone https://gerrit.opnfv.org/gerrit/barometer $ ./src/install_build_deps.sh |
Install virtualization pacakges packages and other required packages:
| Code Block |
|---|
$ sudo apt install qemu-kvm libvirt-bin virtinst virt-manager screen |
...
| Code Block |
|---|
sudo adduser $USER libvirtd |
...
Create a dir to store ISOs
| Code Block |
|---|
$ sudo mkdir /usr/local/src/images/ $ cd /usr/local/src/images/ $ sudo -E wget http://releases.ubuntu.com/16.04/ubuntu-16.04.2-server-i386.iso |
Ceate a Test VM
| Code Block |
|---|
$ sudo virt-install -n test -r 256 --disk path=/var/lib/libvirt/images/test.img,bus=virtio,size=4 -c /usr/local/src/images/ubuntu-16.04.2-server-i386.iso --network network=default,model=virtio --graphics vnc,listen=0.0.0.0 --noautoconsole -v |
connect Connect to the console to complete the installation process.
...
Clone the latest libvirt code, build and install collectd:
| Code Block |
|---|
git$ git clone https://github.com/maryamtahhan/collectd.git mt_collectd $ cd mt_collectd $ ./build.sh $ ./configure |
Check that the virt plugin is configured:
...
Install collectd:
| Code Block |
|---|
sudo$ sudo make -j install |
...
Install collectd as a service:
| Code Block |
|---|
sudo mv systemd.collectd.service collectd.service sudo chmod +x collectd.service vi collectd.service |
...
Edit the collectd.service script
...
| Code Block |
|---|
<LoadPlugin cpu> Interval 1 </LoadPlugin> <LoadPlugin virt> Interval 1 </LoadPlugin> LoadPlugin csv LoadPlugin network <Plugin cpu> ReportByCpu true ReportByState false ValuesPercentage true </Plugin> <Plugin csv> DataDir "/tmp/collectd/csv" # StoreRates false </Plugin> <Plugin network> # server setup: Listen "<host ip address>" "28597" <Listen "<host ip address>" "28597"> </Listen> </Plugin> <Plugin virt> Connection "qemu:///system" # RefreshInterval 60 # Domain "name" # BlockDevice "name:device" # BlockDeviceFormat target # BlockDeviceFormatBasename false # InterfaceDevice "name:device" # IgnoreSelected false HostnameFormat uuid # InterfaceFormat name # PluginInstanceFormat name Instances 1 ExtraStats "disk pcpu" </Plugin> |
Core 10 and 11 were isolated from the OS using the isolcpus argument to grub command line and using virsh to Pin the vCPUs to those cores (Requires KVM acceleration):
| Code Block |
|---|
$ virsh vcpupin test 0 10
$ virsh vcpupin test 1 11 |
To check for KVM acceleration see that the response to the command below is > 0:
| Code Block |
|---|
$ cat /proc/cpuinfo | egrep -c '(vmx|svm)' |
without KVM acceleration you will need to taskset the qemu threads to the isolated cores:
| Code Block |
|---|
$ grep pid /var/run/libvirt/qemu/test.xml
<domstatus state='running' pid='4907'>
$ grep Cpus_allowed_list /proc/4907/task/*/status
/proc/4907/task/4916/status:Cpus_allowed_list: 4
/proc/4907/task/4917/status:Cpus_allowed_list: 5
/proc/4907/task/4918/status:Cpus_allowed_list: 6
/proc/4907/task/4919/status:Cpus_allowed_list: 7
</section> |
To taskset the process + tasks repeat the following for the PID and the subtasks:
| Code Block |
|---|
$ taskset -pc 4 4907... |
Guest
OS: Ubuntu 16.04.2 LTS
Install collectd and stress
| Code Block |
|---|
$ sudo apt install collectd stress stress-ng |
configure /etc/collectd/collectd.conf
| Code Block |
|---|
Hostname "ubuntu_vm"
<LoadPlugin cpu>
Interval 1
</LoadPlugin>
LoadPlugin network
<Plugin cpu>
ReportByCpu true
ReportByState false
ValuesPercentage false
</Plugin>
<Plugin network>
# # client setup:
Server "<HOST IP>" "28597"
<Server "<HOST IP>" "28597">
</Server>
</Plugin> |
Start collectd on the host and the guest
| Code Block |
|---|
$ service collectd start |
Run Stress in the VM on a single core
| Code Block |
|---|
$ taskset 1 stress -c 2 -t 10
stress: info: [1422] dispatching hogs: 2 cpu, 0 io, 0 vm, 0 hdd
stress: info: [1422] successful run completed in 10s
|