Connecting Hundreds of Oceanographic Data Sources from 35 Countries in and around Europe into a Big Data Network
Abstract:Until some years ago, oceanographic data in Europe were scattered across dozens of data centres and hundreds of government agencies, research institutes and university groups. As a consequence, it was impossible to get an overview of available data and very difficult to get access to the data. And even if one managed to get access, data were difficult to use because the data came in different formats and were of varying quality.
All these issues were successfully addressed in a series of projects culminating in the current SeaDataNet-project. The resulting and operational SeaDataNet infrastructure now connects hundreds of data sources from 35 countries in and around Europe. It was designed to provide a central overview of available data as well as direct access to a distributed system of online data sources. When data are being transferred to the user, the data are converted into a standard format, chosen by the user. Through a joint activity with the MyOcean project, all data within the SeaDataNet infrastructure have been quality controlled.