E3DDS Stakeholder 20200428
Time/Location
- Meeting to be held online: https://cscfi.zoom.us/j/9917669499
Live Minutes
https://docs.google.com/document/d/1NwD0MKHg2IIVPQCRkchI0FRWZa44ZS6JKeMa1-5pmtM/edit
Objectives for the meeting
The E3DDS stakeholder forum gathers representatives from the NeIC EISCAT_3D Data Solutions project, NeIC, EISCAT, EISCAT_3D users, national e-Infrastructure providers and network providers in order to achieve the goals:
- To update each other about progress of projects and e-Infrastructure roadmaps;
- To intensify the collaboration between the EISCAT_3D Data Solutions project and the providers for network and e-Infrastructures.
The general objective of this meeting is to bring together the EISCAT_3D technical community with national providers of HTC/HPC and networking from the relevant countries. The goals of the meeting include the need to update each other of statuses and time-lines of national providers and the EISCAT_3D activities.
Agenda
- Meeting chair: Tomasz Malkiewicz, NeIC
- 13h00 - 13h05 Welcome slides(Tomasz Malkiewicz, NeIC)
- 13h05 - 13h30 Status of the EISCAT_3D project slides (Harri Hellgren, EISCAT)
- 13h30 - 14h00 Status of the E3DDS project slides (John White, NeIC)
- 14h00 - 14h20 Status Skibotn Site (Helge Stranden, Uninett)
- 14h20 - 14h40 Nordic Network Plans slides (Lars Fischer, NORDUnet)
- 14h40 - 15h00 Preparation for EISCAT_3D Karesuvanto site (Thomas Ulich, SGO)
- 15h00 - 15h15 Progress on Finnish National e-infrastructure slides(Ari Lukkarinen, CSC)
- 15h15 - 15h30 Progress on Norway National e-infrastructure: slides (Olaf Schjelderup, Uninett) and slides (Steinar Trædal-Henden, UiT)
- 15h30 - 15h45 Progress on Swedish National e-infrastructure (Per-Olov Hammargren, SNIC)
- 15h45 - 15h55 Benefit realization (Tomasz Malkiewicz, NeIC)
- 15h55 - 16h00 Closing slides (John White, NeIC)
Minutes
- Online (raw) minutes page at: https://docs.google.com/document/d/1NwD0MKHg2IIVPQCRkchI0FRWZa44ZS6JKeMa1-5pmtM/edit
Presence
- Ari Lukkarinen (CSC)
- Björn Torkelsson (HPC2N)
- Carl-Fredrik Enell (EISCAT)
- Craig Heinselman (EISCAT)
- Dan Johan Jonsson (UiT)
- Hans Eide (Uninett)
- Harri Hellgren (EISCAT)
- Helge Stranden (Uninett)
- Ilkka Virtanen (Univ Oulu)
- Ingrid Mann (EISCAT NO)
- Ingemar Häggström (EISCAT)
- Inger Solheim (EISCAT NO)
- Jani Myrry (FUNET)
- Johan Kero (IRF)
- John White (NeIC)
- Koji Nishimura (NIPR)
- Lars Fischer (NORDUnet)
- Mattias Wadenstein (HPC2N)
- Olaf Schjelderup (Uninett)
- Per-Olov Hammargren (SNIC)
- Simon Brown (EISCAT)
- Steinar Trædal-Henden (Univ Tromso)
- Thomas Ulich (SGO)
- Tomasz Malkiewicz (NeIC)
- 13h00 - 13h05 Welcome (Tomasz Malkiewicz, NeIC)
- 13h05 - 13h30 Status of the EISCAT_3D project (Harri Hellgren, EISCAT)
- 13h30 - 14h00 Status of the E3DDS project slides (John White, NeIC)
The user login to access EISCAT_3D data is through a portal we are implementing EGI Checkin as broker of federated identities. https://www.egi.eu/services/check-in/
The Affiliate programme is a web page of all the collected materials from the project plus some limited budget per year in order to co-fund a small workshop, school, etc. A "shepherd" is nominated as the contact person.
- 14h00 - 14h20 Status Skibotn Site (Helge Stranden, Uninett)
A contract has been made with a local electrical company. Will make the electrical installations this summer.
- 14h20 - 14h40 Nordic Network Plans slides (Lars Fischer, NORDUnet)
IP connectivity noted to FUNET and Uninett, the SUNET status was discussed. The fibre from Skibotn connected phyically to locations in either to NO or FI. Connection to SUNET through those places. physical places. Can move services over 400 Gb/s classic connection in the upper North. Easy.
Regarding moving computing/storage out of Skibotn i.e. moving downstream computing first, e.g., prompt and user clusters etc., along with storage - we can move services over 400 Gb/s classic connection in the upper North. This is easy. Further south the fibre gets more congested.
- 14h45 - 15h00 Preparation for EISCAT_3D Karesuvanto site (Thomas Ulich, SGO)
The fibre from main road to the site is not yet installed. If the above-ground power line needs to be upgraded (current for a ski station) then installing fibre at the same time would be best. Needs to be discussed. We have got the power but only mobile phone connectivity to the site. We have offers for fibre are along main road. The meeting point will be along main road.
Separate build for power/fibre is a good idea. Dropping the power into the ground as well is a good idea at the same time.
Permafrost risk was risen, i.e., how deep to avoid permafrost. The permafrost situation might be OK there. The site is right on a border. This will be looked into more with the power/fibre people.
- 15h00 - 15h15 Progress on Finnish National e-infrastructure (Ari Lukkarinen, CSC)
The new cluster at CSC has Infiniband connections. Tape will be used for long term preservation. For normal computing object storage is the main way to store.
- 15h15 - 15h30 Progress on Norway National e-infrastructure (Olaf Schjelderup, Uninett; Steinar Trædal-Henden, UiT)
In order for users to use local storage to work on/with data products there should be a plan to ask to the local planning for storage.
The EISCAT_3D interface is the Jupyter notebook. The data sets may be too large to download locally. This depends on the science case how much data can be downloaded.
When the data storage needs to be moved will there will be a tender process for external storage or processing capacity.
The normal way for a user to access data will be through the DIRAC portal. From the EOSC-Hub project. The data will be physically at EISCAT. May need clearance to export data whereas users will want to use their local resources. Need to teach users how to use DIRAC and notebooks systems.
- 15h30 - 15h45 Progress on Swedish National e-infrastructure (Per-Olov Hammargren, SNIC)
There is work on hhe funding for update of Swestore. There will be a joint procurement for the dCache (NT1) part of Swestore.
- 15h45 - 15h55 Benefit realization (Tomasz Malkiewicz, NeIC)
Benefit realisation management current status was presented and discussed.
- 15h55 - 16h00 Closing (John White, NeIC)
Thank you to all who have been working in these projects over the last years (E3DS and E3DDS)
IF it is possible. We would like to tentatively plan for a face-to-face meeting in Umea in August 2020. The caveat is that, since the project will be finished, NeIC cannot absorb all the travel costs for this meeting. More details before June 2020.