Glenna2/Glenna2-Newsletter-May-2020

From neicext
Jump to navigation Jump to search
Glenna Logo.gif

Glenna2 Newsletter, May 2020


Welcome to read the last newsletter of the Nordic Glenna2 cloud computing project. 


Contents:
Glenna2 comes to an end 
News:
Installation of a Machine Learning platform for enabling NGT AI/ML workflows
Gnocchi & Ceilometer - Time series storage

________________________________________________________

Glenna2 comes to an end

After 5 years with the Glenna program beginning with Glenna1, it is now time to wrap up the project and bid a heartfelt farewell. During my time as Glenna project manager I’ve had the pleasure of working with a string of highly talented individuals on making community clouds an integrated part of the national provider computing portfolios in the Nordics.

The project wiki will continue to exist at https://wiki.neic.no/wiki/Glenna2. You will continue to find presentations, events materials and links to code on these pages as well as the official deliverables. The project overview, including the steering groups assessment and the deliverables, is given in the final report which you can find at:

Glenna2 Final Report V1.1 (approved as of 2020-05-15)

Big thanks to the members of the Glenna2 team whose combined effort has shaped cloud computing for research at the national providers, to NeIC who made this project possible and to the national providers who have provided the talent to make the project a success. The Glenna2 steering group deserves special recognition for their foresight and encouragement and a special thanks to Michaela Barth, the project owner who has steadily guided the steering group during all these years.

Dan Still
Glenna1 and Glenna2 project manager


News


Installation of a Machine Learning platform for enabling NGT AI/ML workflows

A rapid expansion of research projects in the Nordics in the general area of artificial intelligence, in particular in machine learning and deep learning is anticipated. Frameworks such as TensorFlow and high-level libraries such as Keras have become popular, with applications across many areas.

In Glenna2 we introduced a new aim for machine learning in late 2018 resulting in the evaluation on Kubeflow and the LeanAI toolkit described in the December 2019 newsletter. Here we highlight the work enabled on the UNINETT NIRD Toolkit, to support a use-case aiming at developing a novel computational platform for designing next-generation therapeutics (NGT), diagnostics and vaccines by combining high-throughput single-cell antibody and T-cell receptor sequencing with artificial intelligence.


This workflow has been implemented according to the research by Greiff et al. which the users wished to have replicated onto the NIRD Service Platform as identical as possible. This required effort to build and run a container with the following capabilities:

  • login for users of a specific NIRD project,
  • being able to run commands from the command line,
  • having standard deep learning software packages pre-installed,
  • access to a GPU, and
  • access to data stored under a NIRD storage project.

Report at: https://wiki.neic.no/wiki/File:Glenna2_Aim_3_Target_4_AI_D2.pdf
Workflow based on research reported in: https://www.biorxiv.org/content/10.1101/759498v5


Gnocchi & Ceilometer: Time series storage

Gnocchi is an open source time series database created in 2014 when OpenStack was looking for a highly scalable, fault-tolerant time series database that did not depend on a specialized database (e.g., Hadoop, Cassandra, etc.). The primary reason for Gnocchi development within OpenStack was to be a substitute for the Ceilometer API.

The Norwegian Research and Education Cloud (NREC) team at the University of Bergen (UiB) has been running Ceilometer and Gnocchi in production since OpenStack version Ocata (2018), but have so far not used the collected metrics for any production use cases. They are currently looking into the CloudKitty (https://wiki.openstack.org/wiki/CloudKitty) service for cost visualizing, and will be looking into using the collected metrics in a Grafana dashboard.

A recent concern for the future is that the Gnocchi project is unmaintained as of October 2019. However, users have been informed that there will still be bug fixes and there is still activity in the project GitHub repository. You can find out more about the work to enable the UiB Gnocchi platform:

https://wiki.neic.no/wiki/File:Glenna2_Aim1_Target2_Monitoring-as-a-Service.pdf


About Glenna2:

Glenna2 was a three-year project running from March 2017 to March 2020 to continue Nordic collaboration on cloud computing in Denmark, Finland, Iceland, Norway and Sweden. The project aimed for building on already existing services and infrastructure at the participating centers. The work has been supported and directed by the Nordic e-infrastructure providers.


More about the outcomes of the Glenna2 project: https://wiki.neic.no/wiki/Glenna2


The name Glenna is an Icelandic name and means "Opening in the clouds"

---

The Glenna2 Newsletter is distributed to team members and affiliated parties. Feel free to contact me for more information!

On behalf of the Glenna2 team,

Dan.Still@csc.fi

Retrieved from "https://wiki.neic.no/w/ext/index.php?title=Glenna2/Glenna2-Newsletter-May-2020&oldid=12652"