Directory Structure
The data processing pipeline transmits data from origination sites to a controlled directory structure on the Nebula computer at NCSA where it is available for transfer via Globus. This directory structure is visible when accessing data via the Globus interface.
The data is generally structured as follows:
1
/sites
2
/ua-mac
3
/raw_data
4
/sensor1
5
/timestamp
6
/dataset
7
/sensor2
8
...
9
/Level_1
10
/extractor1_outputs
11
/extractor2_outputs
12
...
13
/danforth
14
/raw_data
15
/sensor3
16
...
17
/Level_1
18
/extractor3_outputs
Copied!
...where raw outputs from sensors per site are stored in a raw_data subdirectory and corresponding outputs from different extractor algorithms are stored in Level_1 (and Level_2, etc) subdirectories (see data product levels). When possible, sensor directories are divided into days and then into individual datasets.
Export as PDF
Copy link