Node flh-procΒΆ

The flh-proc job template defines the streaming executable and the wall time.

The job template includes the path to the streaming executable.

      <defaultParameters>

The job template defines three parameters:

Parameter name Default value Description
startdate N/A Start date of time of Interest
enddate N/A End date of time of Interest
format GeoTIFF Format of the output FLH product (GeoTIFF or BEAM-DIMAP)

which translates to:

        <parameter scope="runtime" title="Start date" abstract="Start date of the TOI (e.g. 2012-04-04T00:00:00)" type="opensearch" target="time:start" id="startdate" maxOccurs="1"/>
        <parameter scope="runtime" title="Stop date" abstract="Stop date of the TOI (e.g. 2012-04-04T23:59:59)" type="opensearch" target="time:end" id="enddate" maxOccurs="1"/>
        <parameter id="format" scope="runtime" title="Format" abstract="Format for the ouput products (BEAM-DIMAP or GeoTIFF)">
          <options>
            <option>GeoTIFF</option>
            <option>BEAM-DIMAP</option>
          </options>

The job template set the property mapred.task.timeout, the wall time between messages in the log:

        </parameter>
      </defaultParameters>
      <defaultJobconf>

Here’s the job template including the elements described above:

    <jobTemplate id="flh-proc">
      <streamingExecutable>/application/flh-proc/run</streamingExecutable>
      <defaultParameters>
        <parameter scope="runtime" title="Start date" abstract="Start date of the TOI (e.g. 2012-04-04T00:00:00)" type="opensearch" target="time:start" id="startdate" maxOccurs="1"/>
        <parameter scope="runtime" title="Stop date" abstract="Stop date of the TOI (e.g. 2012-04-04T23:59:59)" type="opensearch" target="time:end" id="enddate" maxOccurs="1"/>
        <parameter id="format" scope="runtime" title="Format" abstract="Format for the ouput products (BEAM-DIMAP or GeoTIFF)">
          <options>
            <option>GeoTIFF</option>
            <option>BEAM-DIMAP</option>
          </options>
        </parameter>
      </defaultParameters>
      <defaultJobconf>
        <property id="mapred.task.timeout">9900000000000</property>
      </defaultJobconf>

The streaming executable implements the activities:

!define DIAG_NAME Workflow example !include includes/skins.iuml skinparam backgroundColor #FFFFFF skinparam componentStyle uml2 start :Source libraries; :Get format parameter value; :Check format parameter value; while (check stdin?) is (line) :Stage-in MERIS Level 1b product; :Apply FLH operator to MERIS Level 1b product with format defined; :Stage-out FLH product; endwhile (empty) stop

The streaming executable source is available here: /application/flh-proc/run.sh