You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 6 Next »

Aruna Object Storage (AOS) is a modern distributed storage platform designed to meet the increasing demand for effective data management and storage of scientific data. It is the central storage of RDCs cloud layer and the data foundation for the upper layers. It is a cloud-native, scalable system with an API and a S3-compatible interface. It allows resource organization into Objects, Datasets, Collections, and Projects. Additionally, its provides an event-driven architecture which enables automation, data validation, and improves accessibility and reproducibility of scientific results. AOS is open-source and available at https://aruna-storage.org.

Status: PRODUCTIVE

Current Version: v1.0.x; Version v2.0.x (planned before September, 15th 2023)

Weblink: https://aruna-storage.org

Target group:

Keywords:  data management, storage, FAIR, multi-cloud, cloud-native, data mesh

RDC Integration

The Aruna Object Storage (AOS) is part of the cloud layer of the RDC. It is an object storage designed as open source storage platform that allows scientists to store, annotate and share their data according to the FAIR principles.

Overview

AOS is a fast, secure ,and geo-redundant data storage. It offers a sophisticated metadata management according to the FAIR principles. It builds the foundation for RDCs mediation and semantic layer and and handles all stored data objects data-agnostically.

AOS key features are:

  • Data storage - Easily store large volumes of arbitrary data.
  • Metadata enrichment - Enrich and group a user's data and metadata together for easier access and better organization.
  • Secure Storage - Secure data storage from the moment of upload.
  • FAIR - All data is managed according to the FAIR principles.
  • Easy Sharing - Flexible data sharing made easy with flexible presigned URLs.
  • Effortless Migration - Effortless migration from AWS thanks to S3 compatible interface.

Until now, storing data in localized, domain-specific data silos has limited collaboration, reuse, and data analysis. Here, AOS offers significant benefits for research data in NFDI4Biodiversity. These benefits include improved collaboration, compliance with FAIR principles, scalability, robust data security, and seamless integration with existing systems and workflow tools. Ultimately, this facilitates scientific progress and enhances the quality of our research.

Getting started

The AOS start site is located at https://aruna-storage.org. Users can log in there. Currently, the AAI of the GWDG is used for this purpose, which requires a user account at the GWDG, the DFN or at LifeScience AAI. After the account has been activated, the user can create a project. Further users can then be activated for this project to enable data exchange and joint processing. The project can then be filled with data either via the API or via the S3 interface.

User Guide

Basically, AOS is intended as a data backend for the RDC. For this reason, very few end users will use AOS directly. Verification, transformation and processing of data is basically possible via the services in the mediation layer. This also ensures the consistency of the data. Users and services can be informed about changes to individual data objects or even entire projects via the AOS notification service and can thus react to these changes.

Developer Guide


References

Links:

  • No labels