Big Data Processing in Astronomy and Earth Observation: Synergies & Shared Challenges

Start date
End date
Location
SURF Utrecht

*Registration opens mid-October 2023.

On January 23rd, NSO and SURF are organizing the seminar: “Big Data Processing in Astronomy and Earth Observation: Synergies & Shared Challenges”. The seminar will take place at SURF Utrecht, from 10:00-16:00.

Do you deal with Big Data in your research in Astronomy or Earth Observation? Or do you want to learn about innovative projects in these domains with a strong data processing component? Then save the date for this seminar, organized by SURF &NSO, bringing together the Astronomy and Earth Observation communities to discuss shared challenges and best practices.

Register here*

Big (data) challenges

The challenges related to Big Data are similar for Astronomy & Earth Observation research. Both domains deal with ever-growing amounts of data and increasing complexity of data. Hence, mission and instrument teams are expected to deliver science/analysis-ready data products as it is not feasible anymore for the end-users to handle the pre-processing themselves.

Another effect of the increased data volumes and complexity is the migration of scientific workflows from desktops to Virtual Research Environments or HPC clusters. New AI algorithms and other optimizations are needed to plough through the huge datasets. And how is Big Data managed and shared in the context of the Open Science revolution?

In this seminar, we bring together two research communities with similar challenges, and learn how innovative Big Data projects in Astronomy and Earth Observation deal with:

  • data processing and analysis: how to get from raw data to science/analysis-ready data products and scientific workflows?
  • data storage and management: how to manage distributed and heterogenous datasets and storage systems following Open Science and FAIR principles?
  • emerging technologies: how to use AI, Quantum Computing, HPC, exascale computing to tackle Big Data challenges?