|
Data Availability Script for Data Providers |
|
|
|
Written by Tom Narock
|
|
Friday, 19 October 2007 |
This tool autonomously generates a listing of new and modified data files. The listing is output to a standard location and periodically retrieved by the VHO in order to keep its internal metadata records current.
The data avialability tool runs in the bash environment which is a standard component of most unix/linux systems. However, this tool does require that a certain version of unix/linux tools be installed. In particular a data provider will need: bash version 3.2, find version 4.2.31 and the gnu coreutils version 6.9. One can find the current version by using the following commands from the command prompt:
bash --version
find --version
ls --version
For those that do not have the latest versions of these tools we have included them in data availability tool download.
Usage Instructions
1.) Edit the mkdata-lslR configuration file for each data set you are serving to the VHO. Example data set entry would be:
## WIND MFI Version 3 data
# SPASE ID assigned by VHO
SPASEID[0]="spase://VHO/NumericalData/WIND/MFI/v3_PT03S"
# Top level directory where the search starts
LDIR[0]="/data/wind/mfi/ver3"
# LSPATH[0] is an optional place to output the result file to
# If we don't specify a location LDIR[0] is used
# In this case that is what we want
# Pattern to use to search for data files
PATTERN[0]="wi_h0_mfi_*_v03.cdf"
# The results will include directory and filename
# We want to strip off the directory name so we
# specify that here
STRIP[0]=${LDIR[0]}
2.) Place the configuration file in /etc
3.) Set up cron to run mkdata-lslR once per day
|
|
Last Updated ( Friday, 19 October 2007 )
|
Documents 
