better-satcen-00004 data pipeline results (Sentinel-2 DVI, composites and BOA reflectances) : metadata loading and exporting (pickle file)¶
This Notebook shows how to load in memory (no data is actually stored into the local disk) the better-satcen-00004 metadata pipeline results
Result selection is done filtering by an AOI and a time range
Retrieved metadata frame is saved into a *pickle file* in order to allow the user working with it outside the platform
In [1]:
import pandas as pd
from geopandas import GeoDataFrame
import cioppy
import gdal
from shapely.wkt import loads
import numpy as np
import matplotlib
import matplotlib.pyplot as plt
from PIL import Image
%matplotlib inline
from urlparse import urlparse
import requests
#import getpass
Set the data pipeline catalogue access point¶
In [2]:
series = 'https://catalog.terradue.com/better-satcen-00004/series/results/description'
Area of Interest¶
In [3]:
geom = 'MULTIPOLYGON (((-77.24516666666666 0.9424444444444445, -77.24516666666666 2.753833333333333, -79.0253888888889 2.753833333333333, -79.0253888888889 0.9424444444444445, -77.24516666666666 0.9424444444444445)), ((21.29611111111111 39.58638888888889, 21.29611111111111 41.032, 19.89788888888889 41.032, 19.89788888888889 39.58638888888889, 21.29611111111111 39.58638888888889)), ((65.02055555555556 30.43894444444445, 65.02055555555556 33.39566666666666, 63.94222222222222 33.39566666666666, 63.94222222222222 30.43894444444445, 65.02055555555556 30.43894444444445)))'
# Afghanistan area
wkt = loads(geom)[2].wkt
print wkt
POLYGON ((65.02055555555556 30.43894444444445, 65.02055555555556 33.39566666666666, 63.94222222222222 33.39566666666666, 63.94222222222222 30.43894444444445, 65.02055555555556 30.43894444444445))
Time of interest¶
Data selection can be done filtering on start, stop and/or update dates of the datasets
Each of them can be empty allowing the not-empty param time filtering
In [4]:
start_time = '2018-06-01T00:00:00Z'
stop_time = '2018-07-31T23:59:59Z'
update = '2019-01-25T10:00:00.00Z/2019-01-25T23:59:59.99Z'
In [5]:
search_params = dict([('start', start_time),
('stop', stop_time),
('update', update),
('geom', wkt),
('count', 5000)])
Create the dataframe¶
We create the data frame with the following metadata: * enclosure -
the URL reference to access the actual data for the download *
identifier - the unique item identifier in the catalogue * self -
Link to resource that identifies the resource in the catalogue *
startdate - Start time of the dataset (UTC ISO 8601)
* enddate - End time of the dataset (UTC ISO 8601) * title -
Title of the item, containing the string of the data filename
In [6]:
ciop = cioppy.Cioppy()
from datetime import datetime
print datetime.utcnow().isoformat()
search = GeoDataFrame(ciop.search(end_point=series,
params=search_params,
output_fields='enclosure,identifier,self,startdate,enddate,title,wkt',
pagination=100,
timeout=300000,
model='GeoTime'))
2019-01-28T09:28:46.492144
In [7]:
print datetime.utcnow().isoformat()
2019-01-28T09:30:12.969601
- Showing the very 5 first results of our search
In [8]:
search.head(50)
Out[8]:
| enclosure | enddate | identifier | self | startdate | title | wkt | |
|---|---|---|---|---|---|---|---|
| 0 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 01be9eec66cb994310e469e012a3a2bc670f92e8 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 1 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 037133bb420b2f5407a223e2f2709e7c6eefbdf0 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 2 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 03aa38a9b430af9f2b2b2cb47cae31788c0fd59c | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
| 3 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 0949c278e99a1b2244ddd0edb3be4e38c7b10e81 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNR_2... | POLYGON((63.9422209286482 31.5415371135011,64.... |
| 4 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 0cccedf5d105c98b1bce071eebd3639084ebc43d | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
| 5 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 13f7b9c57f80b8239602fa8643e850e2810dbe86 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
| 6 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 167985828c36cf97dc38e758b03e04d2121c5082 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPQ_2... | POLYGON((64.0544752567945 30.6291153366071,65.... |
| 7 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 18264a8a9c895138334632255a890c0207401534 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNS_2... | POLYGON((63.942190134373 32.4437136477504,64.1... |
| 8 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 18f96b3c16107b494e99dd10fb6a8c89b22cfaca | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 9 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 233965e5bca9bf121a3092c514a98467fb5a5aca | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNT_2... | POLYGON((63.942190134373 33.3457570767331,64.1... |
| 10 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 354aa778fcc35e3998c7451008bf6dafbcd321b2 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPS_2... | POLYGON((64.0754281831925 32.4329181100723,65.... |
| 11 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 38f6b4cd118b725ccc93f31520cf9e8ce2ef9c41 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPQ_2... | POLYGON((64.0544752567945 30.6291153366071,65.... |
| 12 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 3e0cc5ae3ee89390f0f35e9ac3b4c0779ae9a92d | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 13 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 42c37d86f8c3ce37a281713f63e381959e6e3189 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 14 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 498e74bbdeb0aa7def6dc6284eb2f051d74c84e3 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNR_2... | POLYGON((63.9422209286482 31.5415371135011,64.... |
| 15 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 49cf4bdbc631ccabf43b72482242b121f8930026 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 16 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 4c7c8408c793f723a482d26aa3a65a6a91c255d9 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 17 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 4e5bbc202c65d2649fd479c907091c80f657ea14 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPS_2... | POLYGON((64.0754281831925 32.4329181100723,65.... |
| 18 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 51173b87fb29165633894c2355f5de71886c2d1f | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 19 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 54689c1c16f24c80b2ee4f3e4d29c2afba0b2936 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
| 20 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 547b0323004742006fe45dece35dcee0a6de6083 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 21 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 550e6ace65683c219d0c5cdc41b27cfcd54e1e8d | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPQ_2... | POLYGON((64.0544752567945 30.6291153366071,65.... |
| 22 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 55e295d49efbcaea0dea69e0adf20155280add31 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 23 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 56488c02141057af7af43d74a927547a59cbf1a1 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNT_2... | POLYGON((63.942190134373 33.3457570767331,64.1... |
| 24 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 57f6f8df0ec2292c0f61394e737d4ba8ba6518bc | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNR_2... | POLYGON((63.9422209286482 31.5415371135011,64.... |
| 25 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 594a4c19c030fba4efd93b005e99b526b9f9b62d | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNS_2... | POLYGON((63.942190134373 32.4437136477504,64.1... |
| 26 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 5b8194ba9806bed2c1dbe01b96d6213f63792b3b | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNS_2... | POLYGON((63.942190134373 32.4437136477504,64.1... |
| 27 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 5fe752a7d2dbcd24700f3aa546d33ad2c741f21a | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPS_2... | POLYGON((64.0754281831925 32.4329181100723,65.... |
| 28 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 6182f0b65578c45e7f0fd71fbc7f7ed33b617cf0 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPP_2... | POLYGON((64.0445211297571 30.4274058286158,65.... |
| 29 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 61b06847aa5913bc20eaf7450098d4d0a40104d6 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNR_2... | POLYGON((63.9422209286482 31.5415371135011,64.... |
| 30 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 635d9767247bdc9467f9c008e8a14f4a2fe0ca67 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 31 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 637f4093b0a7aa2b22bdd09cde74f6926c80b1af | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPP_2... | POLYGON((64.0445211297571 30.4274058286158,65.... |
| 32 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 677bc7b366428414215ca507168562c51249f971 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPS_2... | POLYGON((64.0754281831925 32.4329181100723,65.... |
| 33 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 6df3abdab5b71b14b08fde8e8113885ddc59cc86 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 34 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 6fb812cd87addc8c2432ea1b486d6304672c72a4 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPS_2... | POLYGON((64.0754281831925 32.4329181100723,65.... |
| 35 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 70180f573adf433340d142b9e8dc753281af17d1 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 36 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 70cb3f78df82cbf5a51a13e50869f0d5418607e6 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 37 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 7114f7fbb90dd4a80fc2caf8dc78b1c3cf60c27c | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNS_2... | POLYGON((63.942190134373 32.4437136477504,64.1... |
| 38 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 80f2f9b4123a9a814936348673f437f59e66ab42 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNR_2... | POLYGON((63.9422209286482 31.5415371135011,64.... |
| 39 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 8b3bb55ab02a06e2c547de5c63d73b54724f5c02 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 40 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 9189f923cd286882caf502a526680f246a759e27 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNT_2... | POLYGON((63.942190134373 33.3457570767331,64.1... |
| 41 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 91ae30907d96b90e3d9aef4ccc9f810a583115e0 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNS_2... | POLYGON((63.942190134373 32.4437136477504,64.1... |
| 42 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 91e3a7573e06de20708bb27cad33c3411f5b6169 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPQ_2... | POLYGON((64.0544752567945 30.6291153366071,65.... |
| 43 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 9346a8a9d3e28cce0c1b232398251d2477ed80f3 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPP_2... | POLYGON((64.0445211297571 30.4274058286158,65.... |
| 44 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 991fe3da0d0b114521c5f3895bf000e2e70652a7 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 45 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 9bbfec52619495530e59c8d93ad5825ae1ae870f | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPT_2... | POLYGON((64.0754281831925 33.3349200126815,65.... |
| 46 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | 9d229867b43e7477ba178c7b9d3354e1d7779e73 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 47 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | a1d479a98420d844c2f26922339a922b87f0e6fd | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
| 48 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | ad216af589ded529e7b5a1e3e1338711b7eb5e09 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 49 | https://store.terradue.com/better-satcen-00004... | 2018-07-29T06:16:31.0240000Z | b116aeeb8a9bd4db215681e252d52da8be985a9c | https://catalog.terradue.com//better-satcen-00... | 2018-07-29T06:16:31.0240000Z | S2A_MSIL2A_20180729T061631_N0206_R034_T41RPQ_2... | POLYGON((64.0544752567945 30.6291153366071,65.... |
In [9]:
print '%s results have been retrieved' %len(search)
1516 results have been retrieved
- Formatting date time
In [10]:
search['startdate'] = pd.to_datetime(search['startdate'])
search['enddate'] = pd.to_datetime(search['enddate'])
In [11]:
search.head()
Out[11]:
| enclosure | enddate | identifier | self | startdate | title | wkt | |
|---|---|---|---|---|---|---|---|
| 0 | https://store.terradue.com/better-satcen-00004... | 2018-07-29 06:16:31.024 | 01be9eec66cb994310e469e012a3a2bc670f92e8 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29 06:16:31.024 | S2A_MSIL2A_20180729T061631_N0206_R034_T41SPR_2... | POLYGON((64.0648798642054 31.5308017399005,65.... |
| 1 | https://store.terradue.com/better-satcen-00004... | 2018-07-29 06:16:31.024 | 037133bb420b2f5407a223e2f2709e7c6eefbdf0 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29 06:16:31.024 | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNP_2... | POLYGON((63.9421703624035 30.4373158799178,64.... |
| 2 | https://store.terradue.com/better-satcen-00004... | 2018-07-29 06:16:31.024 | 03aa38a9b430af9f2b2b2cb47cae31788c0fd59c | https://catalog.terradue.com//better-satcen-00... | 2018-07-29 06:16:31.024 | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
| 3 | https://store.terradue.com/better-satcen-00004... | 2018-07-29 06:16:31.024 | 0949c278e99a1b2244ddd0edb3be4e38c7b10e81 | https://catalog.terradue.com//better-satcen-00... | 2018-07-29 06:16:31.024 | S2A_MSIL2A_20180729T061631_N0206_R034_T41SNR_2... | POLYGON((63.9422209286482 31.5415371135011,64.... |
| 4 | https://store.terradue.com/better-satcen-00004... | 2018-07-29 06:16:31.024 | 0cccedf5d105c98b1bce071eebd3639084ebc43d | https://catalog.terradue.com//better-satcen-00... | 2018-07-29 06:16:31.024 | S2A_MSIL2A_20180729T061631_N0206_R034_T41RNQ_2... | POLYGON((63.9421873560077 30.6397709351317,64.... |
Save the metadataframe¶
Saving the dataframe containing metadata as a pickle allows working with it outside the platform
In [12]:
search.to_pickle('better-satcen-00004_Jun-Jul_Afghanistan.pkl')