malleefowl.processes

Package Contents

class malleefowl.processes.ESGSearchProcess

Bases:pywps.Process

The ESGF search process runs a ESGF search request with constraints (project, experiment, …) to get a list of matching files on ESGF data nodes. It is using esgf-pyclient Python client for the ESGF search API.

In addition to the esgf-pyclient the process checks if local replicas are available and would return the replica files instead of the original one.

The result is a JSON document with a list of http:// URLs to files on ESGF data nodes.

TODO: bbox constraint for datasets

_handler(self, request, response)
class malleefowl.processes.Download

Bases:pywps.Process

The download process gets as input a list of URLs pointing to NetCDF files which should be downloaded.

The downloader first checks if the file is available in the local ESGF archive or cache. If not then the file will be downloaded and stored in a local cache. As a result it provides a list of local file:// paths to the requested files.

The downloader does not download files if they are already in the ESGF archive or in the local cache.

_handler(self, request, response)
class malleefowl.processes.ThreddsDownload

Bases:pywps.Process

_handler(self, request, response)
class malleefowl.processes.DispelWorkflow

Bases:pywps.Process

The workflow process is usually called by the Phoenix WPS web client to run WPS process for climate data (like cfchecker, climate indices with ocgis, …) with a given selection of input data (currently NetCDF files from ESGF data nodes).

Currently the Dispel4Py workflow engine is used.

The Workflow for ESGF input data is as follows:

Search ESGF files -> Download ESGF files -> Run choosen process on local (downloaded) ESGF files.

_handler(self, request, response)
malleefowl.processes.processes