E3DDS SG Meeting 20191017

From neicext
Jump to navigation Jump to search


E3DDS steering group meeting

Time: 2019-10-17 09h00-10h00 CEST

Place: Teorifagbygget hus 2 Rom 2.310


Invitations:

  • Craig Heinselman, EISCAT
  • Yasunobu Ogawa, EISCAT
  • Tomasz Malkiewicz, NeIC, Project owner
  • John White, NeIC, Project manager

Agenda

Presence, approval of agenda (5')

Project status (15')

The project plan is being followed:

- PDF form at: https://wiki.neic.no/wiki/EISCAT_3D_Data_Solutions#Documents - The google docs version is at: https://docs.google.com/document/d/1rgO0qtHJR6zjigdQ2KytFD3ySLH11XvasvSpJNCBVGg/

  • Project works well... good attendance to meetings.
  • New members from Japan participating. Information about WAN timing.
  • Working on the DO3 "The simulations (Deliverable 1) running in the NP e-infrastructures are now run as scale simulation of the EISCAT_3D operations." See below.
  • FtF meeting with NorduNET. Sept 30th.

DO2 (5')

  • For approval to be made public.

DO3 (5')

  • "The simulations (Deliverable 1) running in the NP e-infrastructures are now run as scale simulation of the EISCAT_3D operations."
  • Some software has been tested on NP (and other) infrastructure.
    • Second beam former.
    • Data transfer tests
  • Test cluster critical to this Deliverable.
  • Still open question on the second beam forming... can this be performed using all (10) wide-angle beams and summed within one server?
    • No Infiniband required. Save money.
    • FSRU packets need to be switched in front of RB/SBF nodes. Back to "original" diagrams for LAN.
    • How many RB nodes are needed?
    • Benchmarking the new SBF? (Spread over FSRU and RB/SBF node).
    • A test cluster necessary. See below.
  • Prompt computing still unclear
    • Estimates of "Skylake equivalent sockets".
    • Input to prompt computing?
    • Data stream or files?

Test Cluster (5')

  • Specifications for the test cluster servers:

https://wiki.neic.no/wiki/E3DDS_Specifications_for_the_Test_Cluster

  • Need for Infiniband networking not clear.
    • 25/100 Gb/s ethernet may be sufficient.
  • Location of test cluster TBD. EISCAT will own these machines so will determine their location.
  • Hosting in established data centre preferable in order to conduct end-to-end online data production.
  • Ideally could site 12 FSRUs in racks and generate data through a 100/25 Gb/s switch to 3 RB/SBF nodes and two Prompt Computing nodes.
  • Question: Is Infiniband needed?
  • Uninett (Tromso) has shown interest to host the test cluster. Sent series of questions on operation of same.
  • Operations questions answered and forwarded to other centres as an example of how EISCAT would want to operate a test cluster.
  • Offer from Umea to host test cluster free of charge in return for opportunity to benchmark on new hardware.
  • CSC still tentative.
  • We have clarified the terms of operation of a test cluster.

WAN Topology (5')

  • FtF meeting at Arlanda Sept 30th 2019
  • Discussed WAN (and also LAN issues).
  • More detailed results from this meeting to follow at the Stakeholders meeting following.

Data Transfer Tests (5')

  • Please see:

https://wiki.neic.no/int/E3DDS_Data_Transfer_Tests

  • Data can be transferred/replicated at rates needed by EISCAT_3D.
  • Performing this in "real life" conditions still TBD.

Benefit realization management (10’)

  • NeIC Benefit realisation management policy

https://wiki.neic.no/int/File:NeIC_Policy_for_Benefits_Realization_Management_-_approved_Aug_2019.pdf

  • E3DDS benefit realisation management's monitoring:

https://docs.google.com/spreadsheets/d/1LFN7bPoWfqT2reRf4P0g2W9FzAw8bOlA0UXLJu-qqcM/edit?usp=sharing

NeIC Affiliate programme (5’)

Next meeting (5')

Proposal:

AOB (5')

  • SAC meeting?

Minutes

Presence, approval of agenda (5')

  • Craig Heinselman, EISCAT
  • Yasunobu Ogawa, EISCAT
  • Tomasz Malkiewicz, NeIC, Project owner
  • John White, NeIC, Project manager
  • The agenda is approved.

Project status (15')

  • The final report: EISCAT is happy that an update to DO1 (1.1) can function as the final report.

DO2 (5')

  • The E3DDS project should update DO2 according to the testing and network.

DO3 (5')

  • The DO3 is approved to move to December 2019.

Test Cluster (5')

Comment: We (EISCAT) are acquiring a test server. A schedule for an actual test cluster would have to follow testing on this test server. How many servers required for a cluster to be determined.

WAN Topology (5')

Comment: Before settling on a WAN topology, we would have to understand the benefit of running all prompt computing at one site? (user analysis etc).

Data Transfer Tests (5')

  • No comments received.

Benefit realization management (10’)

  • No comments received. Tomasz and John to continue working on this.

NeIC Affiliate programme (5’)

  • The NeIC affiliate programme noted.

Next meeting (5')

  • Wednesday 5th 10h00 CET online
  • May 2020, attached to the EISCAT User Meeting... May 12th 10h00-11h30 CET.

AOB (5')

  • Yasunobu: Invite John to present project results to the EISCAT SAC in March, Svalbard.
Retrieved from "https://wiki.neic.no/w/ext/index.php?title=E3DDS_SG_Meeting_20191017&oldid=11706"