Using the download Process¶

Go through this tutorial step by step.

Step 0: Install malleefowl with defaults
Step 1: Install birdy
Step 2: Check if birdy works
Step 3: Run the download process
Step 4: Install Phoenix
Step 5: Login to Phoenix
Step 6: Copy the twitcher access token in Phoenix
Step 7: Access malleefowl behind the OWS proxy with access token
Step 8: Get a ESGF certificate using Phoenix
Step 9: Download a file from ESGF

Step 0: Install malleefowl with defaults ¶

# get the source code
$ git clone https://github.com/bird-house/malleefowl.git
$ cd malleefowl

# run the installation
$ make clean install

# start the service
$ make start

# open the capabilities document
$ firefox http://localhost:8091/wps?service=WPS&request=GetCapabilities

Step 1: Install birdy ¶

We are using birdy in the examples, a WPS command line client.

# install it via conda
$ conda install -c birdhouse birdhouse-birdy

Step 2: Check if birdy works ¶

# point birdy to the malleefowl service url
$ export WPS_SERVICE=http://localhost:8091/wps
# show a list of available command (wps processes)
$ birdy -h

Step 3: Run the download process ¶

Make sure birdy works and is pointing to malleefowl … see above.

# show the description of the download process
$ birdy download -h

# download a netcdf file from a public thredds service
$ birdy download --resource \
    https://www.esrl.noaa.gov/psd/thredds/fileServer/Datasets/ncep.reanalysis2/surface/mslp.1979.nc

Step 4: Install Phoenix ¶

Phoenix is a web client for WPS and comes by default with an WPS security proxy (twitcher).

$ git clone https://github.com/bird-house/pyramid-phoenix.git
$ cd pyramid-phoenix
$ make clean install
$ make restart

Step 6: Copy the twitcher access token in Phoenix ¶

Go to your profile.
Choose the Twitcher access token tab.
Copy the access token.

Step 7: Access malleefowl behind the OWS proxy with access token ¶

# configure wps service
$ export WPS_SERVICE=https://localhost:8443/ows/proxy/malleefowl

# check if it works
$ birdy -h

# run the download again ... you need the access token
$ birdy \
    --token 3d8c24eeebb143b3a199ba8a0e045f93 \
    download --resource \
    https://www.esrl.noaa.gov/psd/thredds/fileServer/Datasets/ncep.reanalysis2/surface/mslp.1979.nc

Step 8: Get a ESGF certificate using Phoenix ¶

Go to your profile.
Choose the ESGF credentials tab.
Use the green button Update credentials.
Choose your ESGF provider, enter your account details and press Submit.

Step 9: Download a file from ESGF ¶

Make sure birdy works and points to the proxy url of malleefowl … see above.

Choose a file from the ESGF archive you would like to download and make sure you have dowload permissions.

You can choose the ESGF search browser in Phoenix or an ESGF portal.

# try the download ... in this example with a CORDEX file.
# make sure your twitcher token and your ESGF cert are still valid.
$ birdy \
    --token 3d8c24eeebb143b3a199ba8a0e045f93 \
    download --resource \
    http://esgf1.dkrz.de/thredds/fileServer/cordex/cordex/output/EUR-44/MPI-CSC/MPI-M-MPI-ESM-LR/historical/r1i1p1/MPI-CSC-REMO2009/v1/mon/tas/v20150609/tas_EUR-44_MPI-M-MPI-ESM-LR_historical_r1i1p1_MPI-CSC-REMO2009_v1_mon_200101-200512.nc