Data access & code

Model simulations

The main model simulations conducted by PRIMAVERA groups follow the CMIP6 HighResMIP protocol. The model outputs will be made available on the CMIP ESGF (Earth System Grid Federation) as soon as we can, likely starting early-mid 2019, once CEDA is ready to ingest the data.

The project itself has all these simulations available on the CEDA-JASMIN platform, mainly on tape. We use the PRIMAVERA DMT (Data Management Tool) to select and extract the data from tape to disk. This tool can also be used to query which CMOR-formatted variables are available from our simulations. The DMT is available for users to query the available data. ​View the DMT user guide

To avoid having to read all of the user guide, please go to ​https://prima-dm.ceda.ac.uk/received_data/ to see what data has been received. Hopefully the search is fairly intuitive. If not, then please let us know and we will work to improve it, or to improve its documentation.

If you would like to collaborate with PRIMAVERA and use CEDA-JASMIN with us to conduct complementary analysis, then please contact us for details. A summary of the required technical steps is available here.

Further information on coordinated analysis of the HighResMIP simulations is available.

Data access for CLIVAR and other groups

Users of PRIMAVERA data (e.g. CLIVAR collaborators and others) should follow the instructions at http://help.jasmin.ac.uk/article/189-get-started-with-jasmin to get access to the JASMIN facilities:

  • At step 4, applying for the jasmin-login role, you should include the email addresses of two UK-based PRIMAVERA project member who can provide you with a reference to support your application. Hence you will need to speak with us before you apply.
  • At step 5 you should apply for access to the "primavera" Group Workspace. Malcolm, Jon and Rein can be contacted for help with filling in the JASMIN access form.
  • To access data that has already been published to the ESGF you will also need to register for a CEDA account at ​http://www.ceda.ac.uk/ and link this to your JASMIN account at ​https://accounts.jasmin.ac.uk/account/profile/.

There are some short videos to get you used to working with JASMIN at https://light.ceda.ac.uk/primavera/jasmin_docs/

The data that is available can be queried using the DMT (Data Management Tool) available at https://prima-dm.ceda.ac.uk/. Most people will find the Variables Received Query (https://prima-dm.ceda.ac.uk/received_data/) is the best way to search through the available data. Data will have an “Online Status” of online if all of that data is currently available on disk, and offline or partial if some data is only available on tape. If data is only available on tape then users can use the request retrieval buttons to the right of the table and the “Create Retrieval Request” button at the bottom of the page to request that data is restored from tape to disk. Restoring data from tape to disk may take several days depending upon how busy the tape system is.  

Anyone can use the DMT’s queries to search for available data. However, to request that data is restored from tape to disk then an account on the DMT is required. An account can be created at: https://prima-dm.ceda.ac.uk/register/  
 
The complete user guide for the DMT is available from https://docs.google.com/document/d/1rz4KB3xFUiqsWsCd85Kv4HIBOPM5e7n8QHa6urxWdXY/

Code resources

We are building up a library of useful utilities within the project which may have a wider application. Please see the github site: https://github.com/PRIMAVERA-H2020

We have a variety of packages of code, including:

  • HighResMIP-storm_reader: Python code to read the CMOR-like storm files that will become available on the CEDA archives
  • HighResMIP-extreme_indices: Python code using the ICCLIM package to calculate climate extreme indices
  • HighResMIP-futureSSTSeaice: code base used to generate the future SST and sea-ice forcing for the HighResMIP experiment highresSST-future out to 2050

Coming soon: standard code used to calculate other model indices (such as AMO, AMM, El Nino), as well as code to calculate power spectra and the like, to be used in forthcoming manuscripts from the project.

Data resources

Full data outputs from the models (as per the CMIP6 HighResMIP data request specification) will become available on ESGF in early 2019.

Tropical and extra-tropical cyclones

Tracking the model simulations (using TRACK and TempestExtremes algorithms to far) for both tropical and extra-tropical storms in ongoing. This data is available within CEDA-JASMIN only currently, but will be coming to CEDA archives in early 2019.

The list of models that have been tracked can be seen at this Google doc.

Climate extremes indices

These are being calculated using the ICCLIM software (see above). Michael Wehner has made these available via a server at Berkeley: http://portal.nersc.gov/archive/home/projects/cascade/www/ETCCDI/