Meeting info can be found in the calendar. Caution, the time in calendar is given in UTC.
...
Builds mostly working.
DPDK still not installed correctly, however, have been able to merge remaining Gerrit items as they are not dependent on DPDK.
Trevor is still working on the getting DPDK ready.
Merged blocked items into stable/gambia
Release Items
Complete Testing 12/5
Update Docs / JIRA Cleanup 12/6
Tag Repos / Release 12/7
Release Report
Writing release notes for gambia
Was able to complete Milestone 7, Stable Branch after build fix
Updating Milestone 9, Final documentation
Gambia 7.0 was 11/2
Gambia 7.1
For those projects that publish docker images, I have noticed that there are some Gambia jobs missing.
X86_64 (from releng/jjb/releng/opnfv-docker.yaml):
· Barometer
· Clover
· NFVBench
Basically, you just need to edit the file and change frasier to gambia for your specific artifacts.
Collectd Updates
Octo has been providing reviews
Rubenik as well
Election
Unless I missed a nomination, Matthias Runge will be the sole candidate.
Barometer committers will be able to vote on a Gerrit Issue.
Since there is only one candidate. Simple voting.
Assumption is that Matthias will preside over the meeting next week
Need to organize a JIRA cleanup with Matthias and go over different aspects.
FOSDEM
Need a room for meetup
Nothing available at Red hat
Intel, still checking
Around 20 people
Best idea is to rent a room (share expense between companies)
Contact Emma (FOSDEM)
Contact Google as well (Octo)
Cloud Native
Clover
gRPC call
Prometheus collection
ISTIO / Service Mesh
gRPC plugin in collectd
Go to Clover wiki…
...
- Status of Release
- What do we want in the release?
virt plugin enhancements Virt plugin should be enhanced to provide the following additional details:
Release G X X BAROMETER-99 - Virt plugin enhancement -- VM names OPEN
ovs-dpdk-stats The ovs-dpdk-stats plugin should include extended dpdk stats per interface Release G X X BAROMETER-96 - Enable OVS-DPDK PMD Statistics OPEN
ovs-dpdk-events link statusThe ovs-dpdk-events plugin should indicate link status change eventsRelease GXXBAROMETER-109 - ovs-events link status OPENDMA Functionality The DMA Local Agent will provide the following features:
- Local processing of metrics – Allows metrics to be sampled at a higher rate than storage rate for detection of short-lived conditions.
- Runtime configuration of collectd – Collectd configuration can be managed remotely with the Local Agent providing the writing of collectd configuration and collectd restart.
- Simple OpenStack metadata discovery – Provide runtime information related to the mapping between virtual and physical elements. The metadata can be attached to metric sent by collectd.
Release G X X BAROMETER-95 - The DMA project will provide additional functional for the Barometer project OPEN
DMA Container Add DMA container build Release G X X BAROMETER-94 - The DMA project will exist as a container separate from the collectd container OPEN
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface The ovs stats plugin collects the right set of data in case the dpdk interfaces are mapped directly under the ovs bridge. But for the use case where a bonding interface is needed underneath the ovs bridge, ovs stats cannot pull the dpdk interface statistics.
Release G X X BAROMETER-92 - Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface OPEN
- Original plan stalled by no release from Collectd.
- virt plugin enhancements – Complete waiting on release
- ovs-dpdk-stats –
- DMA Functionality - In progress
- DMA Container - In progress
- Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface – completed waiting on release
- Participation in https://openmetrics.io/
...
Good discussion last week around what service providers really want to use related to telemetry. Do they need to install additional agents for monitoring?
Not everything is nor will be cloud native -- Providing native poll interfaces may not be possible
Node Exporter is the Prometheus / cloud native agent for collecting data from the hardware.
Collectd is the historical metrics / events collection agent.
Need a solution across all environments
Need a solution for baremetal, switches, SDN, etc...
Node Exporter vs. Collectd vs. No additional agents
Multi-VIM environments
Filed exception for MS5
Missed Sept 11th meeting -- Will be covered in next meeting.
Gambia release behind
Milestones
Test case implementation completed.
Preliminary documentation completed.
Complete documentation compliance table for MS6.
First day that projects may request creation of the stable branch for their project.
Last day that projects may request creation of the stable branch for their project.
Any project not yet branched will be branched by LF.
MS69/07/18 (PAST)
MS79/21/18
Available in Gerrit
https://jira.opnfv.org/browse/BAROMETER-92
This option seems to be the most popular
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
Looking for reviewers and feedback!
Add support for 'collectd-master' container
Need reviewers
Release Plan Items
Virt plugin enhancement -- VM names
Milestone 5.9
Work completed, needs to be merged into collectd
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
September 04, 2018
Good discussion around what service providers really want to use related to telemetry
Not everything is or will be cloud native
Node Exporter vs. Collectd vs. No additional agents
Multi-VIM environments
Filed exception for MS5
In approval process
Milestones
Test case implementation completed.
Preliminary documentation completed.
Complete documentation compliance table for MS6.
First day that projects may request creation of the stable branch for their project.
Last day that projects may request creation of the stable branch for their project.
Any project not yet branched will be branched by LF.
MS69/07/18
MS79/21/18
Thanks for the heads up on Doc change Emma
https://jira.opnfv.org/browse/BAROMETER-92
This option seems to be the most popular
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
Looking for reviewers
Add support for 'collectd-master' container
Need reviewers
Release Plan Items
Virt plugin enhancement -- VM names
Milestone 5.9
Work completed, needs to be merged into collectd
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
DMA functionality
DMA container
Fix functest
Waiting internal review
https://jira.opnfv.org/browse/BAROMETER-92
This option seems to be the most popular
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
Looking for reviewers
Additional virt plugin functionality (VM Naming)
PR ready for reviews
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
08/28/2018
Filed exception for MS5
Milestones
Scenario integration completed
All scenarios have deploy jobs in OPNFV CI
Scenario status page is locked. No new scenarios may be added. However, scenario owners may request the removal of a scenario.
Test case implementation completed.
Preliminary documentation completed.
Complete documentation compliance table for MS6.
First day that projects may request creation of the stable branch for their project.
Last day that projects may request creation of the stable branch for their project.
Any project not yet branched will be branched by LF.
MS58/24/18
MS69/07/18
MS79/21/18
Dev Updates
Virt plugin enhancement -- VM names
Milestone 5.9
Work completed, needs to be merged into collectd
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
DMA functionality
DMA container
Fix functest
Waiting internal review
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
Additional virt plugin functionality (VM Naming)
PR ready for reviews
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Red Fish
Collectd module completed
08/21/2018
Dev Updates
Waiting internal review
Week 33?
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
PR ready for reviews
Week 33?
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
Virt plugin enhancement -- VM names
Milestone 5.9
Red Fish
Collectd module completed
OPNFV Testing Harmonization
Self-healing Sig Update
08/14/2018
Dev Updates
Waiting internal review
Week 33?
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
Tracked with https://github.com/collectd/collectd/issues/2858
PR submitted --https://github.com/collectd/collectd/pull/2865
This option seems to be the most popular
Looking for reviewers
PR ready for reviews
Week 33?
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
Virt plugin enhancement -- VM names
Milestone 5.9
Red Fish
Collectd module completed
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Major feature should at least be proposed and partly reviewed at this time.
Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.
MS7 -- September 14
Stable branch window close
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Won’t make Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.
Upcoming milestones (Update with outcome)
Need to offer help to collectd to get the next release out (5.9)
New RFEs (NEEDINFO)
OPNFV Testing Harmonization
Self-healing Sig Update
08/07/2018
Dev Updates
Waiting internal review?
Collectd ovs_stats plugin does not collect dpdk interface statistics if under bond interface
PR submitted -- https://github.com/collectd/collectd/pull/2880.
Looking for reviewers
PR ready for reviews
Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
Enable OVS-DPDK PMD Statistics
Some related merges upstream in OVS
https://github.com/openvswitch/ovs/commit/971f4b394c6e8480300494787fe919869ff3886c
Virt plugin enhancement -- VM names
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Major feature should at least be proposed and partly reviewed at this time.
Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.
MS7 -- September 14
Stable branch window close
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Won’t make Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.
KubeCon
Monitoring Tug of War: Matching Cloud Native and Infrastructure Monitoring (Sunku/Aaron)
OpenStack
DMA Team
Barometer on the Edge
OpenSource Summit (LinuxCon)
Barometer has two Prom dates
ONS Europe
DMA -- Tomo/Aaron
Upcoming milestones (Update with outcome)
Need to offer help to collectd to get the next release out (5.9)
Barometer-related paper submissions
OPNFV Testing Harmonization
Self-healing Sig Update
07/30/2018
· Dev Updates
o https://jira.opnfv.org/browse/BAROMETER-106
[ELF] Patches created; waiting internal approval to upstream
o https://gerrit.opnfv.org/gerrit/#/c/59635/
§ Write redis plugin enable
§ Need +1
o https://gerrit.opnfv.org/gerrit/#/c/59209/
o Upcoming milestones
§ MS6 -- August 24
...
· Need to have development “mostly” complete by then
[ELF] Major feature should at least be proposed and partly reviewed at this time.
Functest support should be mostly done (tests upstreamed for collectd-plugins), bug fixes are okay after this date but no new tests.
§ MS7 -- September 14
· Stable branch window close
· Need feedback on the following list of collect plugins
o https://bugzilla.redhat.com/buglist.cgi?bug_status=NEW&bug_status=ASSIGNED&bug_status=POST&bug_status=MODIFIED&bug_status=ON_DEV&bug_status=ON_QA&bug_status=VERIFIED&component=collectd&known_name=collectd-all&list_id=9166173&product=Red%20Hat%20OpenStack&query_based_on=collectd-all&query_format=advanced
o Feedback will help prioritize work
...
o Also, join #collectd on Freenode if possible
[ELF] Not likely to be available for Gambia, given that we would need to provide config, docs, validation in Barometer once it is closed; However, we should continue to help.
· Openstack voting has begun
o https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22013
o https://www.openstack.org/summit/berlin-2018/vote-for-speakers/#/22000
[ELF] There was a very short voting period this time around, and it’s already closed
AOB:
- Collectd container split: Need to check whether the separate container build jobs (master and stable) are configured correctly; so we can start adding config and build support for newer features (Emma/Kamil)
07/30/2018
Dev Updates
Write redis plugin enable
Need +1
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Need to have development “mostly” complete by then
MS7 -- September 14
Stable branch window close
Upcoming milestones
Need feedback on the following list of collect plugins
Feedback will help prioritize work
Need to offer help to collectd to get the next release out (5.9)
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Openstack voting has begun
07/24/2018
Dev Update
Thanks for the update Radoslow
Do you think the fix will be a lot of work?
Tentative schedule
Write redis plugin enable
Late comment
Moving forward?
MS6 -- August 24
Test cases implemented, preliminary documentation completed, and stable branch open
Need to have development “mostly” complete by then
MS7 -- September 14
Stable branch window close
Upcoming milestones
Need feedback on the following list of collect plugins
Feedback will help prioritize work
Need to offer help to collectd to get the next release out (5.9)
Contact maintainers and ask “what can I do to help?”
Also, join #collectd on Freenode if possible
Openstack voting has begun
07/03/2018
Barometer CI
Al
TST010 -- Using Barometer test code to invoke faults
Lucakz
Virt plugin enhancements by end of week
106 WIP
John, Prometheus WIP to be removed soon
Test lab /hardware for Nokia / RedFish
Parker Berberian <pberberian@iol.unh.edu>
Lincoln Lavoie <lylavoie@iol.unh.edu>
Pharos Lab
Non OpenStack installed hardware
UNH
Sunku to send contacts for Intel
Requestor to send e-mail
Prometheus / collectd native times stamp
...
Development
Apologies on the confusion on who would do the work.
Thanks for the review
Additional clarification added / needed
INTEL_PMU loading issue
Rename -- Need to check with APEX
Yes!
ETSI NFVI Testing group might be interested in using Barometer
Might use Barometer to collect metrics during API compliance testing
Would also like to use fault triggering code from one of the Barometer demos
Bring an interface down / up, etc…
Did new contributors get added?
Plugfest (Al Morton)
...
DMA team (Tomo) to present a demo of Local Agent collecting OpenStack metadata.
One of the features of the DMA project is to collect virtual infrastructure information from OpenStack and make it available to collectd so that metadata can be added to metrics / events.
Tomo gave a demo of Local Agent using OpenStack API to gather metadata information for use by Collectd.
Development
VM -- Names
Proposal
Variable defined
Installer Integration -- No_sdn - 6/15/18
Nomination of new contributors
Kamil: kamilx.wiatrowski@intel.com
Lukasz: lukaszx.cybura@intel.com
Sunku: sunku.ranganath@intel.com
Kevin: kevin.laatz@intel.com
Self Healing Sig
Use case templates about DMA project and local healing
What about 5 9’s
White paper on Barometer’s role in self-healing / availability
Originally discussed in Sydney
What should be included and what people care about
NEC, Verizon, etc…
Focus is HA.
Go over monitoring paper
Go with Confluence Wiki on Barometer home page
New dedicated resource for collectd.
Ryan McCabe (Red Hat)
...
(MS3) Installer integration with OpenStack
3.0 Integration / nosdn deploy / run HC 6/15
3.1 deploy SDN / pass HC 6/29
PMU Plugin
Evaluating options
JIRA item to track virt plugin metric additions (gaps with ceilometer) -- https://jira.opnfv.org/browse/BAROMETER-98
JIRA item to track virt plugin VM name enhancements -- https://jira.opnfv.org/browse/BAROMETER-99
Ceilometer / Collectd parity
Can Ceilometer be replaced with collectd?
NFVI (OpenStack Services) monitoring
NFVI Monitoring Whitepaper -- https://jira.opnfv.org/browse/BAROMETER-97
How to collaborate? Google docs?
...
Gambia Release
Not clear on XCI requirements.
When do the tests need to be in place for XCI?
Traditional, XCI, both?
What are tentative development goals for the Gambia release?
RPMs / Container build
New pull request - https://gerrit.opnfv.org/gerrit/#/c/53805/9
Standards
Analytics processing tasks need info all the way down to the agent layer
Need to make sure there’s a measurement timestamp to provide context
Yes, scope parameter makes that possible
Scope must be conveyed with the measurements
All the info we’re collecting will end up in analytic engines
Does test008 spec have the flexibility to talk about measurement of network interface using a particular VLAN tag?
VES
Multi-VM reqs
6.0 specs on the way (next week)
Compass support -- not for Gambia or Fraser?
Barometer will be supported in Gambia
HA scenario issues with build
A problem with OOO?
Fails every third build or so.
Will be looked at soon (next week)
Edge Cloud
Categories
Use cases
Use cases where latency is critical
Example feedback loop?
Requirements
Latency
What does lightweight mean in the context of edge telemetry?
...
Made MS6...
Next upcoming milestone, MS7, April 6th -- last day to request a stable branch. Can request one anytime until then.
After than MS8, April 16, completion of testing
Current Fraser status
test_add_remove_volume
test_attach_volume_nowait
test_detach_volume_nowait
….
Perhaps it was a system / connectivity failure?
Results not appearing quickly enough due to Gnocchi archive policy
Change default policy to High
Need to modify the tests to perform specific failure action
Emma good catch on Hugepages failing fix
Gnocchi failures
AODH failures
REDFISH Plugin
Purpose -- node or rack?
Design review
Standards Update
VES Updates
ONAP flow
Vendor VNF
Closed loop control
Services goes into VNF
Any missing heatheats
At the FM layer
Progress on ETSI?
VES Mobile edge platforms?
Is there a cadvisor plugin for collectd?
C, Java VES libraries
Microservice heatbeat
...
Milestone 5 complete
Scenario deployment passed
Functest failing
MS6 03/16/18
Complete documentation compliance table for MS6.
Test case implementation completed.
Preliminary documentation completed.
First day that projects may request creation of the stable branch for their project.
APEX
Functests failing
Virtual deploy -- RDT, Hugepages… Should we skip during virtual deploy?
APEX deployment help -- Aaron has a test setup running and can answer questions.
Collectd
pmu plugin / pmu core -- Reviewer comments -- 03/06/2018
ovs link status -- Is this still relevant?
AMQP1 -- Needs review
Connectivity Event -- Reviews in progress
Process Event -- Reviews in progress
System Event -- Reviews in progress
PRs
DMA project would like to have another meeting (possibly at ONS)
Did you get your feedback to Alok? I know I didn’t yet :(.
Want to get comments by the 15th
Produce a spec update by end of March
Have a weekly update
VES Update
VES Project into ETSI
Parts of the project, metric / event definitions, transport
Pair things down to what’s important
10’s of collectors at present
VES mobile edge platforms
CAdvisor plugin for collectd?
Maybe try in the Barometer container?
...
Should Barometer Graduate? (https://www.opnfv.org/software/technical-project-governance/project-lifecycle)
Are we a part of enough scenarios (another installer)?
Would be a good recognition of the work done by Barometer
Have had good recognition at shows (OpenStack Summit, OPNFV, etc)
Bryan would be supportive of applying for graduation
No definitive answer, but positive reception
Standards Update (Al)
Meeting with IFA working group completed work on all measurement content. Al provided an edit / rewrite of the document and resubmitted.
Discussion of GAPs in Baromter
VES Update
Bryan working on Barometer Kubernetes scenario. Should be ready soon. Barometer as DaemonSet
Conversion of VES to gRPC in the testing phase.
Development Update
Ansible scripts submitted to Gerrit
Clarification that plugins not in collectd yet should still make it into Barometer / Fraser
(MS5) Scenario integration and feature freeze -- 03/02/18
Good discussion on “What’s next for Barometer”
Scope expansion -- Should Barometer move beyond metrics / events to policy
Scope continuation into container space --
OPNFV Barometer people going to ONS in March
Aaron
Al
Bryan
??
...