E3DDS SG Meeting 20190327

From neicext
Jump to navigation Jump to search


E3DDS steering group meeting

Time: 2019-03-27 09h00-10h00 EET (Helsinki)

Place: CSC, Espoo, Finland

Invitations:

  • Craig Heinselman, EISCAT
  • Yasunobu Ogawa, EISCAT
  • Tomasz Malkiewicz, NeIC, Project owner
  • John White, NeIC, Project manager

Agenda

Presence, approval of agenda (5')

Project status

Project plan

The project plan is being followed:

- PDF form at: https://wiki.neic.no/wiki/EISCAT_3D_Data_Solutions#Documents - The google docs version is at: https://docs.google.com/document/d/1rgO0qtHJR6zjigdQ2KytFD3ySLH11XvasvSpJNCBVGg/

  • Project works well... good attendance to meetings

https://wiki.neic.no/int/Category:E3DDS_Project_minutes

  • Deliverable documents are "owned" by the partners. So far has worked well.

Deliverable 1

  • We wait for a suitable time to update this document.
  • Still take note of the various input network and SBF computing options considered so far... See:

Deliverable 2

  • Working on the Deliverable 2: The on-site data processing simulation with a baseline of a prototype second beamformer simulation is written and supported to run in the national provider e-infrastructures.
  • The CPU-based SBF needs the summation steps to be verified independently.
  • GPU-based SPF is close to performance. Still needs some percent.
  • Multi-GPU based code to be tested.
  • MPI and GPU SBF code to be profiled independently.
  • Second beam former (SBF) tested on Intel (Kebnekaise) in Umea, AMD servers in Slovenia and GPU-equipped IBM Power9 cluster in NY.
  • Gold-plated case for testing the system: tracking rocket launch.
  • Also the Space Debris case.

Milestone 2

  • Dialog with software architect
  • Overall software architect still TDB?
  • We meet with Harri, Assar, Simon weekly

Stakeholder meeting

  • March 27th, Espoo, FI

Documents from E3DS

  • MC-3
  • Have talked with Ole Ole Ingvard Langfeldt from Torndheim about the BenchEIT results. Most detailed results are not made public.
  • BenchEIT has produced summary results on the costs of academic IT.
  • Still ongoing...

Future Collaborations NeIC/EISCAT_3D/NPs

  • Preparation of proposal to for the NeIC Open Call?
  • Deadline May.
  • Or for later in the year?
  • Cluster management.
    • Who can run the clusters? EISCAT-employed or EISCAT-controlled personnel (out sourced).
    • What level of data to leave sites?
    • The issue of white/black listed orbits still not clear. Removed in FBF?
    • Requirements for secure computing e.g. plenty of experience within NPs handling patient data.
    • Virtual environments. e.g. containers for analysis jobs
    • On-site management of VMs/containers.
  • Data management
    • Copying of data from sites to Data Centre?
    • Data copying policies.
    • Data access policies.
    • End user access to analysis and data. See above.
    • Setting up/testing/hosting master metadata repository.
    • Analysis elsewhere in Europe?

slides

Next meeting

  • Proposal: 24.-28.06.2019
    • Tue, 25.06., 9 - 11 CEST

AOB

Meeting afterwards 2019/10/17 with 09h00 Steering Group FtF and 10h30 Stakeholder meeting. This will take place in Tromso NO.

Note: We should check with Yasunobu if he will be travelling to the area at this time.

Minutes

Presence, approval of agenda (5')

Presence:

  • Craig Heinselman, EISCAT
  • Tomasz Malkiewicz, NeIC, Project owner
  • John White, NeIC, Project manager
  • Yasunobu Ogawa, EISCAT, could not join the meeting remotely.

The agenda is approved.

Project status

PM gives the project status so far.

Project plan

Noted that the project focuses on the correct subjects for EISCAT_3D.

Deliverable 1

Decision whether to follow FPGA solution for second beam former needs to be made in May 2019. Therefore an update to this document beforehand.

Deliverable 2

Progress on the deliverable noted. Again noted the decision for FPGA for the second beam former needed for May 2019.

Milestone 2

Noted that dialog with software architect(s) Harri, Assar, Simon weekly.

Stakeholder meeting

Noted that the Stakeholder meeting will immediately follow the Steering Group meeting.

Documents from E3DS

EISCAT still interested to see if any comparisons can be made with the BenchEIT results. Continue with investigations.

Future Collaborations NeIC/EISCAT_3D/NPs

EISCAT notes that they cannot sustain the current funding model after May 2020. In the absence of new funding the project should end in May 2020. If there is funding available, then could be a different answer. Therefore we do not foresee writing a proposal to the upcoming NeIC Open Call.

Next meeting

SG meeting scheduled for Tuesday 2019/06/25, 9 - 11 CEST

AOB

Meeting after the next is scheduled for 2019/10/17 at 09h00. 10h30 Stakeholder meeting afterwards.

Note: This is dependent on checking if Yasunobu will travel to the area at this time.