The data preparation step foresees to copy test data to the sandbox and register it in the sandbox local catalogue.
The application uses Envisat MERIS Level 1 Reduced Resolution data.
For the purpose, and although ESA provides access to the full mission data through MyEarthNet and via the G-POD framework, Terradue has created a catalogue with a subset of the Envisat MERIS Level 1 Reduced Resolution mission data.
This section shows how to copy and register the test data to the sandbox local storage and sandbox local catalogue. The same techniques can be applied to the ESA G-POD catalogues or other OpenSearch catalogues.
The sandbox includes a catalogue exposing the OpenSearch search engine.
A Web interface is available at: http://<sandbox_host>/catalogue/sandbox
When initiated the sandbox contains no data so clicking on the Search button will not return results:
Sandbox catalogue user interface showing no results
You will use the ciop-catcp [1] utility to copy both the data and metadata from the source catalogue. The source catalogue is the Terradue catalogue containing a subset of the Envisat MERIS mission. The ciop-catcp utility takes an Open Search URL and a few options to optionally copy the data and register the metadata.
On the sandbox shell run the command:
ciop-catcp -m byval "http://catalogue.terradue.int/catalogue/search/MER_RR__1P/rdf?start=2012-04-05T10:00:00&stop=2012-04-08"
That will copy the Envisat MERIS Level 1 acquisitions available on Terradue catalogue to the local sandbox filesystem and catalogue.
Tip
In the URL above, change rdf to html to see what products are returned by the search:
To check the registered data and its accessibility go back to the sandbox catalogue web interface and click the Search button. The graphical interface will show the data now available on the sandbox:
Sandbox catalogue user interface showing the MERIS products registered
Click on one product of the list on the left and then on the Access tab below the map. Finally click on the HTTP URL. The download of the select MERIS Level 1 product starts.
Copy the link to the selected MERIS file, go back to the Sandbox shell and type:
cd
ciop-copy -o ./ http://localhost/data/MER_RR__1PRLRA20120407_112751_000026243113_00253_52853_0364.N1
This will copy the MER_RR__1PRLRA20120407_112751_000026243113_00253_52853_0364.N1 product from the sandbox to the home folder.
The ciop-copy [2] utility does more than simply copying HTTP URLs, it can also consume the catalogue entry RDF URL as input.
Go back to the web interface, and click on Metadata tab, and on the RDF logo 
. This will open the MERIS product catalogue entry in the RDF format. Copy that URL and use it as argument to ciop-copy:
cd
ciop-copy -o ./ http://localhost/catalogue/sandbox/MER_RR__1P/MER_RR__1PRLRA20120407_112751_000026243113_00253_52853_0364.N1/rdf
Congrats!
There is now Envisat MERIS test data on the Sandbox and registered on the local catalogue ready to be processed!
Footnotes
| [1] | ciop-catcp man page |
| [2] | ciop-copy man page |