E3DDS SG Meeting 20190625

From neicext
Jump to navigation Jump to search


E3DDS steering group meeting

Time: 2019-06-25 09h00-11h00 CEST

Place: https://cscfi.zoom.us/j/9917669499

Invitations:

  • Craig Heinselman, EISCAT
  • Yasunobu Ogawa, EISCAT
  • Tomasz Malkiewicz, NeIC, Project owner
  • John White, NeIC, Project manager

Agenda

Presence, approval of agenda (5')

Project status

The project plan is being followed:

- PDF form at: https://wiki.neic.no/wiki/EISCAT_3D_Data_Solutions#Documents - The google docs version is at: https://docs.google.com/document/d/1rgO0qtHJR6zjigdQ2KytFD3ySLH11XvasvSpJNCBVGg/

  • Project works well... good attendance to meetings

https://wiki.neic.no/int/Category:E3DDS_Project_minutes

  • Deliverable documents are "owned" by the partners. So far has worked well.
  • Deliverable 2 (Ari-CSC) being finished...

https://wiki.neic.no/int/E3DDS_Deliverable_2

- SBF now split between FSRU and RB nodes. Still to be tested.

- The size of the prompt computing cluster still variable.

- All other sections completed.

FtF Meeting in Umea

  • AMD CPUs look promising. PCIe4 and # of lanes. Price.
  • A recommendation for a test cluster made.
  • Testing of the phase multiplication in RB nodes to be made (Dan/Assar)
  • Set up the data transfer tests between NDGF and SNIC.
  • Prompt computing first calculations. Needs benchmarking.

Deliverable 3

  • Dan - Uninett
  • "The simulations (Deliverable 1) running in the NP e-infrastructures are now run as scale simulation of the EISCAT_3D operations."
  • Work starts before holidays. Due October 2019.

Cluster Management

  • We have not proceeded so far
  • Roles of the various computing on-site are not clearly known...
  • e.g. Ring buffer nodes
    • house "disk" buffer SSDs
    • perform phase multiplication (FSRU takes care of time)
  • prompt computing
    • GPU speed-up negligible.

Data Transfer Tests

  • We have acquired resources NDGF and SNIC (until end of June)
  • Tests underway.
  • We actually start to have numbers!

AOB

Next meeting

From the previous meeting (https://wiki.neic.no/wiki/E3DDS_SG_Meeting_20190327#Next_meeting_2):

It is planned for:

  • "Meeting after the next is scheduled for 2019/10/17 at 09h00. 10h30 Stakeholder meeting afterwards."
  • "The next E3DDS Stakeholder meeting will be on 2019/10/17 in Tromso. 10h30 local time."

Minutes

Presence

  • Craig Heinselman, EISCAT
  • Yasunobu Ogawa, EISCAT
  • Tomasz Malkiewicz, NeIC, Project owner
  • John White, NeIC, Project manager

Approval of agenda

Approved.

Project status

The Deliverable 2 has been read but not digested. The statement in the prompt computing will be clarified as to what the factor of 5 actually means. Determination of the dimensions of the prompt computing important now as the RB computing quite "well-known". The prompt computing is defined as the computing that produces the data products for lag profile, plasma lines etc. It does not include the second beam forming (split between FSRUs and RB nodes).

FtF Meeting in Umea

For a test cluster deployed at a national provider computing/data centre, will have to check with the financial officer about the thresholds for tendering etc. Must be careful that we don't issue a tender and get the wrong equipment based on performance specifications only. Want to test the most likely hardware configuration. Three offers for a tender are needed. Norway would be better from VAT point of view. But the Rimdhuset in Kiruna is the closest fibre peering point and could also be an interesting location. Advantages of installing to an existing data centre is that all services are already in place.

A FtF meeting is "proposed" for later this year... November in Kiruna? Subject to travel costs being understood.

Deliverable 3

There were no comments from SG. Noted, though, that due to the FSRU schedules (August 2019 in NO) that maybe this needs to be pushed back a bit. October 2019 might be ambitious for a test cluster that may arrive late in September 2019?

Cluster Management

No comments from the SG here. Proceed with Harri/Simon.

Data Transfer Tests

Note from CSC networking people that going from 100 to 400 Gb/s for the network can be more cost-effective. More cost-effective to have better network capacity and do computing in one place rather than distributing to each site (this has been the E3DS/E3DDS position all along).PG should contact CSC guys to talk about this. Also, EISCAT interface is NorduNet (Lars F) who has presented at the Stakeholder meetings in the past.

AOB

There is a plan that a radar expert in NIPR (JP) works at EISCAT HQ (Kiruna)/Sodankyla for one year starting September 2019. It would be interesting for him to join the E3DDS via the EISCAT group. (Yes). He could join to the E3DDS meetings Mondays 13h00 CEST on July 1st, 8th and August 12th?

Next meeting

Next meeting: In Tromso: 2019/10/17 at 09h00; 10h30 Stakeholder meeting afterwards.

Tomasz and John will be in Oslo 14/15th for NeIC PMPO, therefore either a flight in evening of 15th (my vote) or early 16th October would be best.

Pickup time on October 16th better after 10 a.m., and drive to the site (Skibotn) to see everything. The drive should take approximately 2 hours by car.

Agenda for next meeting

  • E3DDS benefit realization
Retrieved from "https://wiki.neic.no/w/ext/index.php?title=E3DDS_SG_Meeting_20190625&oldid=10977"