2022-12-14 Agenda and Minutes

Special Topic: Containerizing PROX

Update on 09 Dec 2022 

Issue remains - haven't been able to collect the logs yet. 

Notes from 30 Nov 2022 

Trouble finding the old logs: maybe in mail from Daniele

SR - maybe give a presentation on AF_XDP  https://github.com/intel/afxdp-plugins-for-kubernetes  Cillium not working with DPDK - talking with Cillium group to sort this out - maybe needs telco requests.

Also - Korea group is comfortable with Trex, that may be all

Futurewei - has a solution for networking, but does it work with DPDK? https://github.com/CentaurusInfra/mizar SR is exploring the solution and will connect if it makes sense.

Intern Update  

14 Dec 2022 

Status: two tasks to complete:

1. Basic eBPF bridge program and test-runs.  After backups, install Ubuntu,    Issue with BMC certificates?  problem on Nodes 1 and 2 (BMC) - contact Tim.
2. K8S cluster deployment – with afxdp cni and l2fwd pods.  = complete on UNH pod

This is the agreement to complete the Internship. will fill-out evaluation when done.

ACTION: Al needs to upload SSH key.  and reserve resource for "Pod 1"

Complete

Notes on 09 Dec 2022 

Third topo might be possible, maybe just use single CPU core, will plan to complete topo 1 and 2 for sure.

Need status - Shivank was working on backups and installing Ubuntu,

Notes from30 Nov 2022 

ACTION: Propose to Tim that we complete the Pod 12 work at end of January.   Need time to transition to UNH AFTER the intern project is over.

Status: Status Check from Shivank - needs to be completed Shivank has an exam today...  Needs to take-over the work.

First look at status - then we will review the Intern feedback form.

Notes from23 Nov 2022 

Tim Gresham wants to know time horizon for the completion of the Intern project.

Sridhar will try UNH - Sawyer or Lincoln Lavoie can get us started. Al sent mail with requirements

IXIA was loaned to LF, intel just hosting it. Maybe it can be moved to UNH! need to investigate.

Shivank: Status:  Exams in progress.  3 tasks need to be completed.  Where are we now?

1. Infrastructure setup: Install
   1. OS
   2. Software
   3. cloud, K8s
2. Test Setup (DUT, Testing tools)
   1. vswitch- kernel module - switching solution
   2. CNIs
   3. TGen Pods
   4. Forwarding Pods
3. Test Runs
   1. Run Tests
   2. Modify 2 and repeat.

Shivank's Internship page with progress: Internship 2022 - Benchmarking eBPF based solutions

Internship 2022 - Benchmarking eBPF based solutions  (pdf)

If we can complete by end of the year - stay on Intel pod 12

Otherwise, Start to move to UNH LaaS

Notes/questions on 09 Dec 2022   https://labs.lfnetworking.org/  walk-through  -

and answers at the 12 Dec 2022 meeting

Lincoln Lavoie Sawyer Bergeron (Deactivated) Justin Choquette Sridhar Rao Al Morton 

2PTLs  - created pods cannot be modified - admins do not maintain access to the bookings/hosts, can add collaborators to the bookings, owner and all collaborators will get access.  SR needs to login to dashboard to appear in the list.

Need to add Sridhar's SSH key  - see above.  Add Sawyer and others.  Collaborators have root access.

Sawyer and team can extend the booking dates - can do 6 months or 12 month bookings - like we had on the community labs.

• Networking questions: direct connect is possible? (can't draw it)  not easily possible, proximity is not guaranteed along with specific hosts...
• After booking, at 6 months duration, try working with fabric first for networking.  Then try static allocation and then direct connect. Note: a few back-end changes will allow changes after booking. may be able to pull hosts out of pool. 
• Not very worried about the BW constraints of the fabric today, host to ToR is four 25G and two 10G link.

• Sridhar's access and key - can do.
• What networks have internet access? does red net have it?  - currently each booking has one public network - connection to node that is NAT'ed to Internet, DHCP assignment, /24 for Pod. Other nets not Internet/public, Layer 2 only.  Admins can change this.
• IXIA - LF owns it, could move to UNH.
• SW Traffic Gen - do we need to change BIOS? No.
• These are baremetal server bookings, right?  YES you get the whole thing! 
• Jump will be over-provisioned.
• how does snapshot work now?  shouldn't/doesn't work. Side effect of past and needs doc fix. maybe again - but not available in 2.0:  Can use cloudinit files in YAML - can send docs.   Can get a server to be ready with many packages installed. add commands like a script during stand-up.
• Need to fill-out purpose and other fileds in the Resource Request   - can add collabs, also Congi field is where you paste in the YAML
• Ubuntu 20.04 - can be upgraded after provisioning.  You own it.  BMC credentiials get added to the bookings and are shared with the info after.
• Don't change BIOS password with BMC access!
• Ping Sawyer and Team with problems!!!

• note 'sudo do-release-upgrade'

Notes from 30 Nov 2022 

SR's requirements:

1 Node for Jump Host  (50% of the HW req below should be ok)

3 Nodes Kubernetes Cluster (1 Master and 2 Worker Nodes)

Requirements on Each Single Node Configuration of the cluster

1. 1x Gigabit ethernet for control-plane/internet/external-access (management)

2. 2 to 4 x SR-IOV compatible NICs for dataplane (testing)  At least 10GigE

3. 2 socket x (Intel Xeon E/Gold, (or ARM) at least 22 cores, at least 2.4 Ghz, approx 50mb Cache) 

4. 64GB to 128Gb Memory

5. 180GB SSD and 3TB SATA HDD storage

Networking between the nodes:

1. need separate management network and dataplane/testing network
2. What does the dataplane network include?  ToR switch? How many hosts share the ToR switch?
3. VLAN tags needed?  How many?
4. Direct cabling between NICs of Master and one worker nodes would be ideal.

WHAT about COSTS?  does TSC need to approve?  No cost - NO Approval needed.

ACTION Al Morton  - fill-out request ASAP, then ping Lincoln and Sawyer on this.

09 Dec 2022 

Notes from 30 Nov 2022 

Slides: Considerations for Benchmarking Network Performance in Containerized Infrastructure  

https://datatracker.ietf.org/doc/draft-dcn-bmwg-containerized-infra/

yangun@dcn.ssu.ac.kr  Sirdhar will contact.

mipearlska1307@dcn.ssu.ac.kr  presented at IETF-115

Nile Progress

Schedule

Notes on 09 Dec 2022 

Notes from 30 Nov 2022 

Re-prioritize this for December, complete dev and updates... with possible shift to next release. Prioritize results for December!

Review Sridhar Rao input 02 Nov 2022 

Started Release Plan for ViNePerf Nile

Sridhar has submitted 2 new patches, which will complete the dev schedule - Al must review.  New SW versions and New OS versions. Adding Al as a reviewer.

Using DPDK build with  Meson and Ninja tools now.  new tools.  The build process is different for diff each OS now, diff folders for Fedora, etc.

Need a discussion with Fulvio on the approach to use with building the CNIs.  Sridhar will consider the questions to ask and try to exchange e-mail with Fulvio.

Pod 12 is fine now!  but we are the last user of the Intel community pods...   The IXIA license has expired.

Consider collaboration with Open Programmable Interface Project (Linux OPI) - need a member to join with us and start to identify common areas of interest. Sridhar will talk to Joe White, Dell TSC Chair.

Node 3 in POD 13 has build issues - need to update that system. system dependencies.  Build was successful in other locations, so we are interested to know where other projects are doing their builds. Maybe UNH Lab.

 12 Oct 2022  Sridhar presented at the Tech Discuss!

eBPF  - final slides

Sridhar Rao 

Sridhar presented slides, which he used to familiarize Anuket with XDP and eBPF

L3AF project in LFN - life cycle management on eBPF programs

Cillium project has done some of their own benchmarking - but uses some unknown TCP: https://docs.cilium.io/en/stable/operations/performance/benchmark/ 

Not much uptake in telco - still many operations issues. The Cillium community agrees that they have not made a good case for telco usage (in conversations with Sridhar).

19 Oct 2022 

Here are Shivank's updates for this week.
https://wiki.anuket.io/display/HOME/Internship+2022+-+Benchmarking+eBPF+based+solutions
repo:
https://github.com/Alt-Shivam/Benchmarking-eBPF-XDP
Sridhar Rao commented: target to complete the Topology-1 (refer to slides that I had sent) first as baseline results to compare with previous results.

21 Sep 2022 

Shivank's CPU not supported by DPDK .  Need this for most of our benchmarking tools

New T-rex traffic Gen have been added and a new DPDK folder.

Sirdhar shared https://github.com/intel/afxdp-plugins-for-kubernetes  it is a possible option to use  Shivank will investigate.

Mail to Casey Cain about Intern compensation and feedback.

Shivank's report for last week:  14 Sep 2022 

https://github.com/Alt-Shivam/eBPF-CNI

Pod 18 connectivity not working for several days, impacting Shivank's work. Tim G says working... Need Pod 12 working as well. There is an active JIRA ticket and comment stream.

Shivank testing with a VM and K8s cluster - can try out locally

Need to review mid-term Mentoring report - Al and Sridhar completed in last half of the meeting.

ACTION  Al Morton invite Maryam meeting to discuss performance (when we agree it's the right time).

Post review of Daniele's work 13 Jul 2022 

closure to Daniele's work and see if there is anything worth publishing, may consider less-selective conferences if novelty is less

New project, governing board formed and TSC meeting set.

Opportunity for Benchmarking: work with us.

Need to know planned NIC speeds, Need NIC HW to benchmark.

20 Jul 2022 There will be a test bed discussion, UNH and Keysight collaboration - using Keysight tools.  We want to join the collaboration. Maybe UNH would welcome our help to some degree. Need some time to understand how the DUT HW will be obtained and installed. Also Remote access (for us, like Intel labs).

2nd ACTION: Do we have support from Ancuta or other IXIA person?  Al Morton sent e-mail

ACTION: License for IXIA HW - Check with Trevor

Trevor Cooper says connected and powered on, but we still might have a license issue. Need Pierre's help.

11 May 2022 this activity seems to have stalled ...

13 Jul 2022  Federica

Past meeting: python scripts.  Possible combine 1 and 3

@Sridhar will expand on the proposal descriptions and Federica will begin to ask students about their interests.

python scripting with K8s is possible for some students in 3rd year. Projects must have resume value, add skill set or new experience.

Sridhar Rao created some projects.

ACTION: See proposals & review

https://wiki.anuket.io/display/HOME/Potential+Projects+for+Student+Volunteers

"Maryam Tahhan joins the crew to talk XDP, AF_XDP, and fast networking"

Operations support seems to be a big issue, and performance is currently about 0.7 of VPP and DPDK

Tasks 1, 3, and 4have been completed/merged. Not doing 2.  DONE