The original system set up to distribute GHRSST data products has grown and become more complex with the addition of more Data Assembly Centres (DACs) and data producers. The GHRSST Data and Services Technical Advisory Group (DAS-TAG) recognised that a well-defined system with greater decentralisation of data ingestion and distribution would better prepare GHRSST for future growth and facilitate the participation of new data producers.
The R/G TS TT was tasked with the definition, design and oversight of implementation of the new Regional and Global Task Sharing System.
The new R/G TS will provide a central end-point access (dataset catalogue and federated OpenSearch granule-level search service) to otherwise distributed data archiving, distribution and search services (implemented by DACs).
The R/G TS TT has produced a report “GHRSST R/G TS System Architecture (GSA)” which describes the agreed new framework for the GHRSST R/G TS. The report describes the data management and distribution services and specifies the services that are required to implement it. The new R/G TS was reviewed and approved at GHRSST XXI meeting in 2020.
Information on DAC service provision was gathered in a survey conducted for GHRSST XXI (2020).
Task 1: Implementation and population of a central catalogue of GHRSST datasets
This task will rely on existing metadata conventions and software solutions and is supported through EUMETSAT/Copernicus funding.
It is expected to be completed by GHRSST XXIII with most of the development work done through 2021; feeding of the catalogue itself being completed between GHRSST XXII and GHRSST XXIII.
Task 2: Implementation and operation of HTTP(S) (mandatory) & FTP (strongly recommended) service at each DAC
The survey of DACs showed each DAC was providing HTTP(S) or FTP. Only two of seven DACs were not providing HTTP(S), only one could not commit to HTTP(S) within the next two years. We consider this task already implemented with increasing homogenization (HTTP(S) becoming the main standard) over the next two years.
Task 3: Implementation and operation of OpenSearch-compliant granule search service at each DAC
Five of the surveyed DACs do not currently provide an OpenSearch service, of the five only two could not commit to doing so in the next two years. However, this type of service is becoming increasingly available from various data providers and cloud-based processing platforms; the R/G TS team is investigating mitigation solutions. It is expected that most DACs will have implemented this service by GHRSST XXIII (in 2022) . Mitigation solutions shall make possible having all GHRSST products searchable by GHRSST XXIV (in 2023).
Task 4: Implementation of central GHRSST OpenSearch end-point for federated queries
The implementation of this end-point service will be supported through EUMETSAT/Copernicus funding and is expected to be completed by GHRSST XXIII (in 2022).
The service will connect the DAC OpenSearch services available at that time.
LAST REPORT TO THE SCIENCE TEAM
Slides on progress, June 2021: Slides-RGTS2021
TASK TEAM MEMBERS
Chair and co-chair: Jean-François Piollé (Ifremer), Ed Armstrong (JPL/PO.DAAC)
Members: Sheekela Baker, Helen Beggs, Kenneth Casey, Mitsuhiko Fuda, Pallavi Govekar, Jacob Hoyer, Sasha Ignatov, Bruce McKenzie, Kachi Misako, Hideyuki Muramatsu, Korak Saha, Igor Tomazic, Cristina Tronconi, Yongsheng Zhang.
INTERESTED IN CONTRIBUTING?
Please contact the chair/co-chair or the task leaders directly:
- Jean-François Piollé, Jean.Francois.Piolle@ifremer.fr
- Ed Armstrong, firstname.lastname@example.org