Anuket Project

CPU Utilisation case study Configuration

Host:

OS: Ubuntu 16.04

Disable apparmor 

$ /etc/init.d/apparmor stop
$ /etc/init.d/apparmor teardown
$ update-rc.d -f apparmor remove

 

Isolate 2 cores from the OS by modifying: /etc/default/grub

GRUB_CMDLINE_LINUX_DEFAULT="text isolcpus=10,11"

 

Update grub:

$ sudo update-grub

 

Reboot

Install barometer build-essentials:

$ git clone https://gerrit.opnfv.org/gerrit/barometer
$ ./src/install_build_deps.sh

 

Install virtualization packages and other required packages:

$ sudo apt install qemu-kvm libvirt-bin virtinst virt-manager screen

 

Add the user to the libvirtd group:

sudo adduser $USER libvirtd

 

Create a dir to store ISOs

$ sudo mkdir /usr/local/src/images/
$ cd /usr/local/src/images/
$ sudo -E wget http://releases.ubuntu.com/16.04/ubuntu-16.04.2-server-i386.iso


Ceate a Test VM

$ sudo virt-install -n test -r 256 --disk path=/var/lib/libvirt/images/test.img,bus=virtio,size=4 -c /usr/local/src/images/ubuntu-16.04.2-server-i386.iso --network network=default,model=virtio --graphics vnc,listen=0.0.0.0 --noautoconsole -v

 

Connect to the console to complete the installation process.

 

Clone the latest libvirt code, build and install collectd:

$ git clone https://github.com/maryamtahhan/collectd.git mt_collectd
$ cd mt_collectd
$ ./build.sh
$ ./configure

 

Check that the virt plugin is configured:

 virt  . . . . . . . . yes

 

Install collectd:

$ sudo make -j install


 Install collectd as a service:

sudo mv systemd.collectd.service collectd.service
sudo chmod +x collectd.service
vi collectd.service

 

Edit the collectd.service script

[Service]#ExecStart=/usr/sbin/collectd
ExecStart=/opt/collectd/sbin/collectd -C /opt/collectd/etc/collectd.conf
#EnvironmentFile=-/etc/sysconfig/collectd
#EnvironmentFile=-/etc/default/collectd
ProtectSystem=full
ProtectHome=true

 

Modify the /opt/collectd/etc/collectd.conf file

<LoadPlugin cpu>
  Interval 1
</LoadPlugin>


<LoadPlugin virt>
  Interval 1
</LoadPlugin>


LoadPlugin csv
 
LoadPlugin network


<Plugin cpu>
 ReportByCpu true
 ReportByState false
 ValuesPercentage true
</Plugin>

<Plugin csv>
 DataDir "/tmp/collectd/csv"
# StoreRates false
</Plugin>

<Plugin network>
        # server setup:
        Listen "<host ip address>" "28597"
        <Listen "<host ip address>" "28597">
        </Listen>
</Plugin>


 
<Plugin virt>
 Connection "qemu:///system"
# RefreshInterval 60
# Domain "name"
# BlockDevice "name:device"
# BlockDeviceFormat target
# BlockDeviceFormatBasename false
# InterfaceDevice "name:device"
# IgnoreSelected false
 HostnameFormat uuid
# InterfaceFormat name
# PluginInstanceFormat name
 Instances 1
 ExtraStats "disk pcpu"
</Plugin>

 

Core 10 and 11 were isolated from the OS using the isolcpus argument to grub command line and using virsh to Pin the vCPUs to those cores (Requires KVM acceleration):

$ virsh vcpupin test 0 10
$ virsh vcpupin test 1 11

To check for KVM acceleration see that the response to the command below is > 0:

$ cat /proc/cpuinfo | egrep -c '(vmx|svm)'

 

without KVM acceleration you will need to taskset the qemu threads to the isolated cores:

$ grep pid /var/run/libvirt/qemu/test.xml
<domstatus state='running' pid='4907'>
$ grep Cpus_allowed_list /proc/4907/task/*/status
/proc/4907/task/4916/status:Cpus_allowed_list: 4
/proc/4907/task/4917/status:Cpus_allowed_list: 5
/proc/4907/task/4918/status:Cpus_allowed_list: 6
/proc/4907/task/4919/status:Cpus_allowed_list: 7
</section>

 

To taskset the process + tasks repeat the following for the PID and the subtasks:

$ taskset -pc 4 4907...


Guest

OS: Ubuntu 16.04.2 LTS

Install collectd and stress

$ sudo apt install collectd stress stress-ng

 

configure /etc/collectd/collectd.conf

Hostname "ubuntu_vm"

<LoadPlugin cpu>
  Interval 1
</LoadPlugin>

LoadPlugin network
 
<Plugin cpu>
        ReportByCpu true
        ReportByState false
        ValuesPercentage false
</Plugin>

<Plugin network>
#       # client setup:
        Server "<HOST IP>" "28597"
        <Server "<HOST IP>" "28597">
        </Server>
</Plugin> 

 

Start collectd on the host and the guest

$ service collectd start

 

Run Stress in the VM on a single core

$ taskset 1 stress -c 2 -t 10
stress: info: [1422] dispatching hogs: 2 cpu, 0 io, 0 vm, 0 hdd
stress: info: [1422] successful run completed in 10s