Actions

NC2TABLE.DAT: Difference between revisions

From BAWiki

imported>Lang Guenther
(first version (text not upt to date yet))
 
m (update version)
 
(12 intermediate revisions by one other user not shown)
Line 2: Line 2:
|name_de=NC2TABLE.DAT
|name_de=NC2TABLE.DAT
|filetype=nc2table.dat
|filetype=nc2table.dat
|version=July 2017
|version=October 2024
|version_descr=July 2016
|version_descr=October 2017
|significance=contains general steering data for the program [[NC2TABLE]].
|significance=contains general steering data for the program [[NC2TABLE]].
|filecontents=
|filecontents=
'''steering data'''
'''steering data'''


* Block '''Program_Parameters''': general input data
* Block '''Program_Parameters''': general steering data
*# '''Input_Data_File''': [[NetCDF|CF NetCDF]] file with input data
*# '''ASCII_Output_Format''': format for output file(s)
*# '''Output_Data_File''': [[NetCDF|CF NetCDF]] file with aggregated result data
*## ''csv'' : [[NC2TABLE.CSV|nc2table.csv]], store results in [https://en.wikipedia.org/wiki/Comma-separated_values CSV format]
*# '''Aggregation_File''': definition of control volumes in file of type [[IPDS.DAT|ipds.dat]]
*# '''Max_Read_Storage''': maximum number of data values stored in one READ cycle.
*# '''Aggregation_EPSG''': EPSG code (see [http://www.epsg-registry.org/ http://www.epsg-registry.org/]) for coordinates stored in ''Aggregation_File''
*# (optional) '''Create_Missing_Variables''': enable automatic creation of missing variables, e. g. for D-Flow FM result files.
*# (optional) '''NC_Deflate_Level''': deflate level (0,1,2,...,9) for online compression of data during write. 0 corresponds to no compression and 9 to maximum compression
*## ''0'' : disabled (Default);
*# (optional) '''Max_Time_Steps_Per_Record''': maximum number of time steps allowed to be transferred in one WRITE to disc file.
*## ''1'' : enabled.
*# (optional) '''Create_Missing_Variables''': create additional (virtual) variables
*# (optional) '''Fortran_Format''': Fortran-Format, e.g. '''F10.3'''.
*#: 0 = do not create (default);
*## In case this key is specified, this value will be used as default for all output variables.
*#: 1 = create (for DFlow FM UGRID CF NetCDF).
*## In case this key is not specified, program default '''G15.8''' will be used.
*# (optional) '''With_Median''': compute (.true.) median (>= 32 values) or do not compute (.false.);
*## Only valid formats defined in nc2table_dico.dat are allowed to be used.
*# (optional) '''With_Percentiles_05_95''': compute (.true.) percentiles Q05, Q95 (>= 32 values) or do not compute (.false.);
*# (optional) '''Min_Water_Depth''': minimum water coverage in [m], up to which data values are considered being valid.
*# (optional) '''With_Percentiles_01_99''': compute (.true.) percentiles Q01, Q99 (>= 51 values) or do not compute (.false.).
*## In case this key is specified, this value will be used as default for all output variables.
* (optional) Block '''Exclude_Variable_From_nc2table''': list of variables to be excluded from aggregation.
*## In case this key is not specified, program default 0.0 will be applied.
*# '''Variable''': variable from ''Input_Data_File''. Key can be prescribed several times. With exception of the variables listed here results will be computed for all variables suited for aggregation.
*## Works only for variables which have an auxiliary variable of type ''total water depth''.
* (optional) Block '''Include_Only_Variable_for_NCAGGREAGTE''': list of variables for which results are exclusively aggregated.
*# (optional) '''NOBS_Filter''': description of ''filter type'' and ''filter value''.
*# '''Variable''': variable from ''Input_Data_File''. Key can be prescribed several times. Aggregation will be solely performed for the variables listed here.
*## ''filter type'':
* (optional) Block '''Probability_Distribution_Group''': classification and list of variables for which probability distributions are computed. Block can be prescribed several times.
*### ''EQ'' : results will be only shown as long as the number of observations are identical to a prescribed value.
*# '''Bounds_Name''': classification from file [[BOUNDS.CFG.DAT|bounds.cfg.dat]] which will be used to compute probability distributions for all subsequent variables.
*### ''LE'' : results will be only shown when the number of observations is less or equal to a prescribed value.
*# '''Variable''': variable from ''Input_Data_File''. Key can be prescribed several times. Probability distributions will be solely performed for the variables listed here. Variables listed here shall not be excluded via blocks '''Exclude_Variable_From_nc2table''' or '''Include_Only_Variable_for_NCAGGREAGTE'''.
*### ''GE'' :  results will be only shown when the number of observations is greater or equal to a prescribed value.
*## ''filter value'':                                      
*### ''N'' : 0 := maximum number of observations;  N := number of observations N; -M := maximum number of observations minus M.
*## In case this key is specified, this filter will be used as default for all output variables..
*## In case this key is not specified, program default ''no filter'' will be used.
*## Works only for variables which have an auxiliary variable of type ''number of observations''.
*# (optional) '''Undefined_String'''
*## In case this key is specified, this value will be used as default for all output variables.
*## In case this key is not specified, program default ''--undefined-'' will be used.
*# (optional) '''Date_Time_Format''': string definition for date and time output format.
*## In case this key is not specified, program default ISO8601 (see [https://en.wikipedia.org/wiki/ISO_8601 ISO 8601]) will be used.
*## In case this key is specified, the following components may be used
*##: ''YYYY'' : year
*##: ''MM'' : month
*##: ''DD'' : day
*##: ''hh'' : hour
*##: ''mm'' : minute
*##: ''ss'' : second
*##: ''n'' : parts of a second, from ''n'' (1/10 sec) to ''nnnnnnn'' (1/100000000 sec)
*##: ZZZZ : time zone (as text)
*##: zzzz : time zone as integer number
*##: Further characters <nowiki>''.'', '':'', ''-'' or '' ''</nowiki>.
*##: examples: YYYY-MM-DD hh:mm:ss ; YYYY-MM-DD hh:mm:ss.nnn ZZZZ.
*# (optional) '''Time_Diff_Format''': string definition for time differences output format.
*## In case this key is not specified, program default ISO8601 (see [https://en.wikipedia.org/wiki/ISO_8601 ISO 8601]) will be used.
*## In case this key is specified, the following components may be used
*##: ''V'' : sign
*##: ''D'' : day, from ''D'' to ''DDDDDD''
*##: ''hh'' : hour
*##: ''mm'' : minute
*##: ''ss'' : second
*##: ''n'' : parts of a second, from ''n'' (1/10 sec) to ''nnnnnnn'' (1/100000000 sec)
*##: Further characters <nowiki>''.'', '':'', ''-'' or '' ''</nowiki>.
*##: examples: Vhh:mm:ss .
*# (optional) '''Hor_Coord_Format''': Output format for (geographical) coordinates.
*## Format '''XY''': local coordinates as real numbers.
*## Format '''GEO_LON_LAT''': geographical coordinates as real number (in degree).
*## Format '''GEO_DEGREE''': geographical coordinates in degree, minute, second (and fractions of a second) plus specification of direction '''N''', '''S''', '''E''' or '''W''' (default).
*# (optional) '''Table_Datetime_Zone''': time zone used for date and time table data.
*## '''UTC''' or '''GMT''': [https://en.wikipedia.org/wiki/Coordinated_Universal_Time ''Universal Time Coordinated''] (Default);
*## '''CET''' or '''MEZ''': [https://www.timeanddate.com/time/zones/cet ''Central European Time''];
*## '''CEST''' or '''MESZ''': [https://www.timeanddate.com/time/zones/cest ''Central European Summer Time''].
* Block '''Input_Variable_Info''' (IVI): informations about variables (can be specified more than once)
*# '''Name''': short name.
*## In case several IVI blocks are specified, ''Name'' must be unique.
*## In case several IVIs are extracted to one table ''Name'' is used as column/row header.
*# '''File''': file name and file type
*## name of file from which data shall be extracted, type [[CF-NETCDF.NC|cf-netcdf.nc]].
*## file type ''NETCDF''.
*# '''Variable''': name of variable to be extracted. Must be contained in '''File'''.
*# (optional) '''Fortran_Format''': Fortran format.
*## Overrides program default or value specified in  Block '''Program_Parameters''' . See block '''Program_Parameters'''.
*## For variables with time, special format ''TI'' may be specified. In this case '''Date_Time_Format''' will be used for output.
*## For variables with time differences (periods), special format ''DT'' may be specified. In this case '''Time_Diff_Format''' will be used for output.
*# (optional) '''Display_Unit''': physical unit to be used during data extraction.
*## Must be known in $PROGHOME/cfg/phydef.cfg.si.dat.
*## Actually transformation is only supported in case the SI base doesn't change, e.g. from ''m'' to ''cm''.
*## In case this key is missing, original variable units are used.
*# '''Min_Water_Depth''': minimum water coverage in [m], up to which data values are considered being valid.  
*## Overrides program default or value specified in block '''Program_Parameters'''. See block '''Program_Parameters'''.
*# (optional) '''NOBS_Filter''': description of ''filter type'' and ''filter value''.
*## Overrides program default or value specified in block '''Program_Parameters'''. See block '''Program_Parameters'''.
* Block '''Coordinate_Space_Info''' (CSI): informations about coordinate dimensions (can be specified more than once)
*# '''Name''': short name.
*## In case several CSI blocks are specified, ''Name'' must be unique.
*# '''Dim_Name''': name of coordinate dimension.
*## Must be a valid dimension of variables referenced in IVI blocks.
*## For all the variables listed in IVI blocks all of their used dimensions should be specified in CSI blocks.
*## Dimensions not specified but in use are considered being used with full dimension. This can result in a rather large number of tables to be extracted.
*# '''Dim_Space''': range of (coordinate) values (four different options)
*## '':'' : all values.
*## ''<startindex>:<endindex>:<schrittweite>'' : equidistant selection.
*## ''indices=<index1>,<index2>,<index3>,...,<indexN>'' : list of individual coordinate values.
*## ''names=<name1>,<name2>,<name3>,...,<nameN>'' : list of names. Must be defined in a respective label coordinate variable.
*## ''xy=(<x1>,<y1>),(<x2>,<y2>),(<x3>,<y3>),...,(<xN>,<yN>)'': list of coordinate value pairs (local coordinates). The respective dimension must be part of a coordinate variable. Remark: In case the coordinate variable has more than one horizontal space dimension, for all of these dimensions the very same coordinate value pairs have to be specified.
*## ''geo=(<lon1>,<lat1>),(<lon2>,<lat2>),(<lon3>,<lat3>),...,(<lonN>,<latN>)'': list of coordinate value pairs (geographic coordinates). The respective dimension must be part of a coordinate variable. Remark: In case the coordinate variable has more than one horizontal space dimension, for all of these dimensions the very same coordinate value pairs have to be specified.
*## ''file=<[[CF-NETCDF.NC|cf-netcdf.nc]]>,NETCDF,<x_or_lon>,<y_or_lat>'': file name, file type (currently NETCDF only) as well as variable for x coordinate or geographic longitude and y coordinate or geographic latitude. Potential input files can be generated using program [[GRIDCONVERT]]. Remark: In case the coordinate variable has more than one horizontal space dimension, for all of these dimensions the very same input data have to be specified.
*# '''Dim_EPSG''': (optional) EPSG code (see [https://www.epsg-registry.org/ EPSG Geodetic Parameter Registry]) for local coordinates prescribed in Dim_Space.  If not present it is assumed that coordinates in Dim_Space are given in the same coordinate system as those specified in the data file.
* Block '''Table_Design_Info''' (TDI): basic design of a table (can be specified more than once).
*# '''Name''': short name.
*## In case several TDI blocks are specified, ''Name'' must be unique.
*# '''First_Column_IVI''': valid ''Name'' from block '''Input_Variable_Info'''.  
*## Will be used to construct the first ''column'' of a table.
*# '''First_Row_IVI''':  Valid ''Name'' from block '''Input_Variable_Info'''.  
*## Will be used to construct the first ''row'' of a table.
*# (optional) '''Row_CSI''': Valid ''Name'' from block '''Coordinate_Space_Info'''
*## Defines the coordinate (dimension) for the ''rows'' of the table.
*# (optional) '''Column_CSI''': Valid ''Name'' from block '''Coordinate_Space_Info'''
*## Defines the coordinate (dimension) for the ''columns'' of the table.
*## ''Column_CSI'' may not contain more than 34 values (= columns).
*# (optional) '''Other_CSI''': Valid ''Name'' from block '''Coordinate_Space_Info'''
*## Several CSIs can be specified in one line.
*## Defines the reach of all other dimensions.
*## The number of tables generated is typically equal to the product of the number of entries in the ''other'' coordinates.
*# '''Remarks''' with respect to ''Row_CSI'' and ''Column_CSI''
*## If in a block of type '''Table_Contents_Info''' a table consists out of only ''one'' IVI, both dimensions, ''Column_CSI'' '''and''' ''Row_CSI'' must be specified in the TDI used.
*## If in a block of type '''Table_Contents_Info''' a table consists out of ''multiple'' IVIs, '''either''' ''Column_CSI'' '''or''' ''Row_CSI'' must be specified.
*## Large dimensions, e.g. number of time steps, can only be processed as ''Row_CSI'', because the maximum number of columns is limited.
* Block '''Table_Contents_Info''' (TCI): design and contents for a (series of) table(s) (can be specified more than once).
*# '''Name''': short name.
*## The folowing file(s) is (are) created for this type of table:
*##: ''<tci:name>_<nnnnnn>.csv'' (data)
*##: ''<tci_name>_<nnnnnn>.txt'' (metadata)
*##  In case several TCI blocks are specified, ''Name'' must be unique.
*# '''TDI''': Valid ''Name'' from block '''Table_Design_Info'''
*## Will be used to ''design'' the table.
*# '''IVI''': Valid ''Name'' from block '''Input_Variable_Info'''.
*## Is used to define the ''contents'' of the table.
*## Can be specified more than once. In this case the respective ''TDI'' may contain '''either''' a ''Row_CSI'' '''or''' a ''Column_CSI''.
===General Remarks===
===General Remarks===
# Dictionary file used from directory '''''$PROGHOME/dic/''''':
# Dictionary file used from directory '''''$PROGHOME/dic/''''':

Latest revision as of 15:19, 21 May 2024

Basic Information

File-Type

nc2table.dat

File-Form

FORMATTED

Version

October 2024

Description-Date

October 2017

Significance of the File

contains general steering data for the program NC2TABLE.

File-Contents (in Catchwords)

steering data

  • Block Program_Parameters: general steering data
    1. ASCII_Output_Format: format for output file(s)
      1. csv : nc2table.csv, store results in CSV format
    2. Max_Read_Storage: maximum number of data values stored in one READ cycle.
    3. (optional) Create_Missing_Variables: enable automatic creation of missing variables, e. g. for D-Flow FM result files.
      1. 0 : disabled (Default);
      2. 1 : enabled.
    4. (optional) Fortran_Format: Fortran-Format, e.g. F10.3.
      1. In case this key is specified, this value will be used as default for all output variables.
      2. In case this key is not specified, program default G15.8 will be used.
      3. Only valid formats defined in nc2table_dico.dat are allowed to be used.
    5. (optional) Min_Water_Depth: minimum water coverage in [m], up to which data values are considered being valid.
      1. In case this key is specified, this value will be used as default for all output variables.
      2. In case this key is not specified, program default 0.0 will be applied.
      3. Works only for variables which have an auxiliary variable of type total water depth.
    6. (optional) NOBS_Filter: description of filter type and filter value.
      1. filter type:
        1. EQ : results will be only shown as long as the number of observations are identical to a prescribed value.
        2. LE : results will be only shown when the number of observations is less or equal to a prescribed value.
        3. GE : results will be only shown when the number of observations is greater or equal to a prescribed value.
      2. filter value:
        1. N : 0 := maximum number of observations; N := number of observations N; -M := maximum number of observations minus M.
      3. In case this key is specified, this filter will be used as default for all output variables..
      4. In case this key is not specified, program default no filter will be used.
      5. Works only for variables which have an auxiliary variable of type number of observations.
    7. (optional) Undefined_String
      1. In case this key is specified, this value will be used as default for all output variables.
      2. In case this key is not specified, program default --undefined- will be used.
    8. (optional) Date_Time_Format: string definition for date and time output format.
      1. In case this key is not specified, program default ISO8601 (see ISO 8601) will be used.
      2. In case this key is specified, the following components may be used
        YYYY : year
        MM : month
        DD : day
        hh : hour
        mm : minute
        ss : second
        n : parts of a second, from n (1/10 sec) to nnnnnnn (1/100000000 sec)
        ZZZZ : time zone (as text)
        zzzz : time zone as integer number
        Further characters ''.'', '':'', ''-'' or '' ''.
        examples: YYYY-MM-DD hh:mm:ss ; YYYY-MM-DD hh:mm:ss.nnn ZZZZ.
    9. (optional) Time_Diff_Format: string definition for time differences output format.
      1. In case this key is not specified, program default ISO8601 (see ISO 8601) will be used.
      2. In case this key is specified, the following components may be used
        V : sign
        D : day, from D to DDDDDD
        hh : hour
        mm : minute
        ss : second
        n : parts of a second, from n (1/10 sec) to nnnnnnn (1/100000000 sec)
        Further characters ''.'', '':'', ''-'' or '' ''.
        examples: Vhh:mm:ss .
    10. (optional) Hor_Coord_Format: Output format for (geographical) coordinates.
      1. Format XY: local coordinates as real numbers.
      2. Format GEO_LON_LAT: geographical coordinates as real number (in degree).
      3. Format GEO_DEGREE: geographical coordinates in degree, minute, second (and fractions of a second) plus specification of direction N, S, E or W (default).
    11. (optional) Table_Datetime_Zone: time zone used for date and time table data.
      1. UTC or GMT: Universal Time Coordinated (Default);
      2. CET or MEZ: Central European Time;
      3. CEST or MESZ: Central European Summer Time.
  • Block Input_Variable_Info (IVI): informations about variables (can be specified more than once)
    1. Name: short name.
      1. In case several IVI blocks are specified, Name must be unique.
      2. In case several IVIs are extracted to one table Name is used as column/row header.
    2. File: file name and file type
      1. name of file from which data shall be extracted, type cf-netcdf.nc.
      2. file type NETCDF.
    3. Variable: name of variable to be extracted. Must be contained in File.
    4. (optional) Fortran_Format: Fortran format.
      1. Overrides program default or value specified in Block Program_Parameters . See block Program_Parameters.
      2. For variables with time, special format TI may be specified. In this case Date_Time_Format will be used for output.
      3. For variables with time differences (periods), special format DT may be specified. In this case Time_Diff_Format will be used for output.
    5. (optional) Display_Unit: physical unit to be used during data extraction.
      1. Must be known in $PROGHOME/cfg/phydef.cfg.si.dat.
      2. Actually transformation is only supported in case the SI base doesn't change, e.g. from m to cm.
      3. In case this key is missing, original variable units are used.
    6. Min_Water_Depth: minimum water coverage in [m], up to which data values are considered being valid.
      1. Overrides program default or value specified in block Program_Parameters. See block Program_Parameters.
    7. (optional) NOBS_Filter: description of filter type and filter value.
      1. Overrides program default or value specified in block Program_Parameters. See block Program_Parameters.
  • Block Coordinate_Space_Info (CSI): informations about coordinate dimensions (can be specified more than once)
    1. Name: short name.
      1. In case several CSI blocks are specified, Name must be unique.
    2. Dim_Name: name of coordinate dimension.
      1. Must be a valid dimension of variables referenced in IVI blocks.
      2. For all the variables listed in IVI blocks all of their used dimensions should be specified in CSI blocks.
      3. Dimensions not specified but in use are considered being used with full dimension. This can result in a rather large number of tables to be extracted.
    3. Dim_Space: range of (coordinate) values (four different options)
      1. : : all values.
      2. <startindex>:<endindex>:<schrittweite> : equidistant selection.
      3. indices=<index1>,<index2>,<index3>,...,<indexN> : list of individual coordinate values.
      4. names=<name1>,<name2>,<name3>,...,<nameN> : list of names. Must be defined in a respective label coordinate variable.
      5. xy=(<x1>,<y1>),(<x2>,<y2>),(<x3>,<y3>),...,(<xN>,<yN>): list of coordinate value pairs (local coordinates). The respective dimension must be part of a coordinate variable. Remark: In case the coordinate variable has more than one horizontal space dimension, for all of these dimensions the very same coordinate value pairs have to be specified.
      6. geo=(<lon1>,<lat1>),(<lon2>,<lat2>),(<lon3>,<lat3>),...,(<lonN>,<latN>): list of coordinate value pairs (geographic coordinates). The respective dimension must be part of a coordinate variable. Remark: In case the coordinate variable has more than one horizontal space dimension, for all of these dimensions the very same coordinate value pairs have to be specified.
      7. file=<cf-netcdf.nc>,NETCDF,<x_or_lon>,<y_or_lat>: file name, file type (currently NETCDF only) as well as variable for x coordinate or geographic longitude and y coordinate or geographic latitude. Potential input files can be generated using program GRIDCONVERT. Remark: In case the coordinate variable has more than one horizontal space dimension, for all of these dimensions the very same input data have to be specified.
    4. Dim_EPSG: (optional) EPSG code (see EPSG Geodetic Parameter Registry) for local coordinates prescribed in Dim_Space. If not present it is assumed that coordinates in Dim_Space are given in the same coordinate system as those specified in the data file.
  • Block Table_Design_Info (TDI): basic design of a table (can be specified more than once).
    1. Name: short name.
      1. In case several TDI blocks are specified, Name must be unique.
    2. First_Column_IVI: valid Name from block Input_Variable_Info.
      1. Will be used to construct the first column of a table.
    3. First_Row_IVI: Valid Name from block Input_Variable_Info.
      1. Will be used to construct the first row of a table.
    4. (optional) Row_CSI: Valid Name from block Coordinate_Space_Info
      1. Defines the coordinate (dimension) for the rows of the table.
    5. (optional) Column_CSI: Valid Name from block Coordinate_Space_Info
      1. Defines the coordinate (dimension) for the columns of the table.
      2. Column_CSI may not contain more than 34 values (= columns).
    6. (optional) Other_CSI: Valid Name from block Coordinate_Space_Info
      1. Several CSIs can be specified in one line.
      2. Defines the reach of all other dimensions.
      3. The number of tables generated is typically equal to the product of the number of entries in the other coordinates.
    7. Remarks with respect to Row_CSI and Column_CSI
      1. If in a block of type Table_Contents_Info a table consists out of only one IVI, both dimensions, Column_CSI and Row_CSI must be specified in the TDI used.
      2. If in a block of type Table_Contents_Info a table consists out of multiple IVIs, either Column_CSI or Row_CSI must be specified.
      3. Large dimensions, e.g. number of time steps, can only be processed as Row_CSI, because the maximum number of columns is limited.
  • Block Table_Contents_Info (TCI): design and contents for a (series of) table(s) (can be specified more than once).
    1. Name: short name.
      1. The folowing file(s) is (are) created for this type of table:
        <tci:name>_<nnnnnn>.csv (data)
        <tci_name>_<nnnnnn>.txt (metadata)
      2. In case several TCI blocks are specified, Name must be unique.
    2. TDI: Valid Name from block Table_Design_Info
      1. Will be used to design the table.
    3. IVI: Valid Name from block Input_Variable_Info.
      1. Is used to define the contents of the table.
      2. Can be specified more than once. In this case the respective TDI may contain either a Row_CSI or a Column_CSI.

General Remarks

  1. Dictionary file used from directory $PROGHOME/dic/:
    • nc2table_dico.dat.

Programs using this Type of File

NC2TABLE

Example-File

$PROGHOME/examples/nc2table/nc2table.dat


back to: File Descriptions


Overview