BETTER Data Pipelines

The main objective of BETTER is to implement an EO Big Data intermediate service layer devoted to harnessing the potential of the Copernicus and Sentinel European EO data directly from the needs of the users.

BETTER aims to go beyond the implementation of generic EO data tools and incorporate those tools with user experience, expertise and resources to deliver an integrated EO intermediate service layer. This layer will deliver customized solutions denominated Data Pipelines for large volume EO and non-EO datasets access, retrieval, processing, analysis and visualisation.

The BETTER solutions will focus in addressing the full data lifecycle needs associated with EO Big Data to bring more downstream users to the EO market and maximise exploitation of the current and future Copernicus data and information services.

• Foreword
• World Food Programme
  • WFP-01-01-01 Sentinel-1 backscatter timeseries
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application
    • Exploitation
      • better-wfp-00001 data pipeline results (Sentinel-1 backscatter time-series selected polarization): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-wfp-00001 data pipeline results (Sentinel-1 backscatter time-sries selected polarization): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest (two approaches to determine VOI:)
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Exporting geotif
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the Queue Trigger & PIPE Trigger
          • Build Trigger Queue
          • Build Trigger PIPE:
        • Deploy the trigger on the Production Centre
          • Deploy Trigger-Queue on Production Centre
          • Deploy Trigger-Pipe on Production Centre
        • Test the trigger in pipe mode
      • Coordinators
        • Coordinator - better-wfp-00001 queue
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00001 pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • Configuration
  • WFP-01-01-02 Sentinel-1 coherence timeseries
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application for WFP-01-01-02
        • Master search
    • Exploitation
      • better-wfp-00002 data pipeline results (Sentinel-1 Coherence timeseries): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-wfp-00002 data pipeline results (Sentinel-1 Coherence timeseries): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest (two approaches to determine AOI)
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the Queue Trigger & PIPE Trigger for WFP-01-01-02
          • Build Trigger Queue
        • Deploy the trigger on the Production Centre
          • Deploy Trigger-Queue on Production Centre
          • Check and Deploy Trigger-Pipe on Production Centre
        • Test the trigger WFP-01-01-02
          • Test single queued date item submission
          • Pipe the queue
      • Coordinators
        • Coordinator - better-WFP-00002 queue
          • Area of Interest definition
            • The geometry defining the 4 sub areas of interest for WFP-01-01-02:
              • Visual check on the AOI
                • Check data transformation application
                • Check trigger coordinator
                • Feed the queue
              • Get the needed input parameters list
          • Set the input parameters
          • Submit the coordinator request
        • Coordinator - better-WFP-00002 pipe
          • Queue parameters
            • Coordinator parameters
            • Common Parameters
            • Check data transformation application
            • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • configuration.ipynb
  • WFP-01-02-01 Sentinel-2 reflectances and vegetation indices
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • WFP-01-02-01-US-02 Service deployment
        • Deploy the application on the Production Centre
      • Test the data transformation application
    • Exploitation
      • better-wfp-00003 data pipeline results (Sentinel-2 reflectances and vegetation indices) : metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
        • Create the dataframe
        • Save the metadataframe
      • better-wfp-00003 data pipeline results (Sentinel-2 reflectances and vegetation indices): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Plotting data and exporting geotif
          • Plot data
          • Export a Geotiff
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • WFP-01-02-01-US-03 Data pipeline definition
        • Build the trigger
        • Deploy the trigger on the Production Centre
        • Test feeding the queue
        • Test the trigger in pipe mode
        • Test a data stream entry
      • Coordinators
        • Coordinator 4 - better-wfp-00003-queue for WFP-01-02-01 over Afghanistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator 3 - better-wfp-00003-queue for WFP-01-02-01 over Mali
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator 1 - better-wfp-00003-queue for WFP-01-02-01 over Niger
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator 2 - better-wfp-00003-queue for WFP-01-02-01 over Tajikistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00003 pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • configuration.ipynb
  • WFP-01-02-02 Landsat-8 reflectances and vegetation indices
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • WFP-01-02-02-US-02 Service deployment
        • Deploy the application on the Production Centre
      • Test the data transformation application
    • Exploitation
      • better-wfp-00004 data pipeline results (Landsat 8 reflectances and vegetation indices): metadata loading and saving (pickle file)
        • Time of interest
        • Query the data pipeline catalogue access point
        • Area of Interest
        • Create the dataframe
        • Save the metadataframe
      • better-wfp-00004 data pipeline results (Landsat 8 reflectances and vegetation indices) : metadata loading from pickle file and results exploiting
        • Import needed modules
        • Read picke data file
        • Time of interest
        • Area of interest
          • Provide here your ellip username and api key for platform access
          • Define 2 auxiliary methods to add data to the dataframe
        • Create a new dataframe with data values
        • Plot functionality
        • Create a geotif with the area of interest
        • Download functionality
          • Single product download
          • Bulk Download
    • Operations
      • Triggers
        • WFP-01-02-02-US-03 Data pipeline definition
        • Build the trigger
        • Deploy the triggers on the Production Centre
        • Test feeding the queue
        • Test the trigger in pipe mode
        • Test a data stream entry
        • Get results from source-out references
      • Coordinators
        • Coordinator - better-wfp-00004-queue-ss for WFP-01-02-02 over Afghanistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue for WFP-01-02-02 over Afghanistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue-ss for WFP-01-02-02 over Mali
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue for WFP-01-02-02 over Mali
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue-ss for WFP-01-02-02 over Niger
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue for WFP-01-02-02 over Niger
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue-ss for WFP-01-02-02 over Tajikistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004-queue for WFP-01-02-02 over Tajikistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00004 pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • Configuration
  • WFP-01-02-03 Sentinel-1 Sigma-0 backscatter all polarization
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application
    • Exploitation
      • better-wfp-00005 data pipeline results (Sentinel-1 Sigma-0 backscatter all polarization): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-wfp-00005 data pipeline results (Sentinel-1 Sigma-0 backscatter all polarization): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Plotting data and exporting geotif
          • Plot data
          • Export the Geotiff
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the trigger
        • Deploy the trigger on the Production Centre
        • Test feeding the queue
        • Test a data stream entry
        • Test the trigger in pipe mode
      • Coordinators
        • Coordinator - better-wfp-00005 queue - Niger area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00005 queue - Tajikistan area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00005 queue - Mali area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00005 queue - Afghanistan area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-wfp-00005 pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • Configuration
  • WFP-01-03-01 COPERNICUS Vegetation Indicators - Aggregations
    • Design
      • Data pipeline design
        • Description
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
    • Application
      • WFP-01-03-01 Build the data transformation application for the Production Centre - COPERNICUS Vegetation Indicators - Aggregations and Anomalies
      • WFP-01-03-01 Deploy the application on the Production Centre - COPERNICUS Vegetation Indicators - Aggregations and Anomalies
      • WFP-01-03-01 Data transformation application - COPERNICUS Vegetation Indicators - Aggregations and Anomalies
    • Exploitation
      • better-wfp-00006 data pipeline results (COPERNICUS Vegetation Indicators Aggregations): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-wfp-00006 data pipeline results (COPERNICUS Vegetation Indicators Aggregations): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest (two approaches to determine VOI:)
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Exporting geotif
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the Queue Trigger
          • Build Trigger Queue
        • Deploy the trigger on the Production Centre
          • Deploy Trigger-Queue on Production Centre
          • Deploy Trigger-Pipe on Production Centre
        • Test feeding the queue
      • Coordinators
        • Coordinator queue
          • Application parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
  • WFP-01-03-02 CHIRPS Rainfall Estimates (RFE) - Aggregations
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Description
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
    • Application
      • WFP-01-03-02 Build the data transformation application for the Production Centre - CHIRPS Rainfall Estimates (RFE) - Aggregations and Anomalies
      • WFP-01-03-02 Deploy the application on the Production Centre - CHIRPS Rainfall Estimates (RFE) - Aggregations and Anomalies
      • WFP-01-03-02 Data transformation application - CHIRPS Rainfall Estimates (RFE) - Aggregations and Anomalies
    • Exploitation
      • better-wfp-00007 data pipeline results (CHIRPS Rainfall Estimates Aggregations): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-wfp-00007 data pipeline results (CHIRPS Rainfall Estimates Aggregations): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest (two approaches to determine VOI:)
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Exporting geotif
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the Queue Trigger & PIPE Trigger
          • Build Trigger Queue
        • Deploy the trigger on the Production Centre
          • Deploy Trigger-Queue on Production Centre
          • Deploy Trigger-Pipe on Production Centre
        • Test feeding the queue
      • Coordinators
        • Coordinator queue
          • Application parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • Configuration
  • WFP-01-03-03 MODIS Terra Land Surface Temperature (LST) - Aggregations
    • Data transformation
    • Trigger
    • Coordinators
    • Exploitation
• EU SatCen
  • SATCEN-01-01-01 Sentinel-2 Vegetation and Water Thematic Index
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application on Production Centre
        • Check if selected product still have intersection with the aoi_wkt
    • Exploitation
      • better-satcen-00001 data pipeline results (Sentinel-2 Vegetation and Water themtic index) : metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
        • Create the dataframe
        • Save the metadataframe
      • better-satcen-00001 data pipeline results (Sentinel-2 Vegetation and Water themtic index) : loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Plotting data and exporting geotif
          • Plot data
          • Export a Geotiff
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the Trigger
          • Build Trigger Queue
        • Deploy the trigger (and its Coordinator) on the Production Centre
          • Deploy Trigger-queue
            • Deploy Trigger-Pipe on Production Centre
        • Test feeding the queue (on Production Centre)
        • Test a data stream entry
        • Test the trigger in pipe mode
      • Coordinators
        • Coordinator - better-SATCEN-00001 queue
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-SATCEN-00001 pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • configuration.ipynb
  • SATCEN-01-02-01 Sentinel-1 Multi-temporal SLC Stack
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the application
        • Search for a master
    • Exploitation
      • better-satcen-00002 data pipeline results (Sentinel-1 Multi-temporal SLC stack and Multi-temporal Coherence stack data pipeline): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-satcen-00002 data pipeline results (Sentinel-1 Multi-temporal SLC stack and Multi-temporal Coherence stack data pipeline): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Plotting data and exporting geotif
          • Plot data
          • Export the Geotiff
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the trigger
        • Deploy the trigger on the Production Centre
        • Test the trigger
          • Test single queued date item submission
          • Pipe the queue
      • Coordinators
        • Validation coordinator - better-satcen-00002 queue - North East Niger Area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Validation coordinator - better-satcen-00002 queue - North West Niger Area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Validation coordinator - better-satcen-00002 queue - South Niger Area
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Visual check on the AOI
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator - better-satcen-00002 pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • SATCEN-01-02-01 Configuration
  • SATCEN-01-02-02 Sentinel-1 Multi-temporal Coherence Stack
    • Data transformation
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application
        • Search for an earthquake
        • Search parameters
        • Build and submit the catalog search
        • Search for the pre-event masters
    • Trigger
      • Build the trigger
      • Deploy the trigger on the Production Centre
      • Test feeding the queue
      • Test the trigger in pipe mode
    • Coordinators
    • Exploitation
  • SATCEN-01-03-01 Sentinel-2 DVI, composites and BOA reflectances
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application
    • Exploitation
      • better-satcen-00004 data pipeline results (Sentinel-2 DVI, composites and BOA reflectances) : metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
        • Create the dataframe
        • Save the metadataframe
      • better-satcen-00004 data pipeline results (Sentinel-2 DVI, composites and BOA reflectances): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Plotting data and exporting geotif
          • Plot data
          • Export a Geotiff
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the trigger
        • Deploy the trigger on the Production Centre
        • Test feeding the queue (on Production Centre)
        • Test the trigger in pipe mode
      • Coordinators
        • Coordinator - better-satcen-00004 queue - Columbia AOI
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Queue trigger setup
        • Coordinator - better-satcen-00004 queue - Albania-Greece border AOI
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Queue trigger setup
        • Coordinator - better-satcen-00004 queue - Afghanistan
          • Data selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Queue trigger setup
        • Coordinator - better-satcen-00004 pipe
          • Preparatory work
          • Pipe selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Pipe trigger setup
        • ** DANGER ZONE **
      • SATCEN-01-03-01 Configuration
• ETH-Zurich
  • ETHZ-01-01-01 Coseismic DInSAR
    • ETHZ-01-01-01 Coseismic DInSAR
      • Data transformation
        • Build the data transformation application for the Production Centre
        • Deploy the application on the Production Centre
        • Test the data transformation application
          • Search for the L’Aquila earthquake
            • Search for a slave product post event
            • Search for the pre-seismic and coseismic masters
    • ETHZ-01-03-01 Co-seismic deformation maps
      • Data transformation
        • Build the data transformation application for the Production Centre
        • Deploy the application on the Production Centre
        • Test the data transformation application
    • Trigger
    • Coordinators
    • Exploitation
  • ETHZ-01-02-01 Filtered DInSAR interferograms
    • Design
      • Data pipeline design
        • Parallelization Strategy
        • Data Sources
        • Tools and Libraries
          • Trigger
        • Queue
        • Pipe
          • Coordinators
    • Application
      • Build the application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application
    • Exploitation
      • better-ethz-00002 data pipeline results (Filtered DInSAR interferograms): metadata loading and exporting (pickle file)
        • Set the data pipeline catalogue access point
        • Area of Interest
        • Time of interest
          • Create the dataframe
        • Save the metadataframe
      • better-ethz-00002 data pipeline results (Filtered DInSAR interferograms): loading from pickle file and exploiting
        • Import needed modules
        • Read picke data file
        • Credentials for ellip platform access
        • Define filter parameters
          • Time of interest
          • Area of interest
        • Create a new dataframe with data values
          • Define auxiliary methods to create new dataframe
        • Create a new dataframe with data values
        • Plotting data
        • Download functionalities
          • Download a product
          • Bulk Download
    • Operations
      • Triggers
        • Build the trigger
        • Deploy the application on the Production Centre
        • Test the trigger
          • Set the data discovery parameters
            • Test single queued date item submission
            • Pipe the queue
      • Coordinators
        • Validation coordinator queue
          • Application parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Feed the queue
            • Define the input parameters
            • Submit the coordinator request
        • Coordinator pipe
          • Queue selection parameters
          • Coordinator parameters
          • Common Parameters
          • Check data transformation application
          • Check trigger coordinator
          • Process the queue
            • Submit the coordinator request
      • Configuration
  • ETHZ-01-03-01 Co-seismic deformation maps
    • Data transformation
      • Build the data transformation application for the Production Centre
      • Deploy the application on the Production Centre
      • Test the data transformation application
        • Search for an earthquake
        • Search parameters
        • Build and submit the catalog search
        • Search for the pre-event masters
    • Trigger
      • Build the trigger
      • Deploy the trigger on the Production Centre
      • Test feeding the queue
      • Test the trigger in pipe mode
    • Coordinators
    • Exploitation
  • ETHZ-01-03-02 SAR Coherence changes
    • Data transformation
    • Trigger
    • Coordinators
    • Exploitation
• Common Data Pipelines
  • Sen2Cor Atmospheric Correction
    • Sen2cor data pipeline design
      • Coordinators
        • Areas of interest