NCDELTA.DAT: Difference between revisions
From BAWiki
imported>Lang Guenther (version date changed) |
m (update version) |
||
(16 intermediate revisions by 3 users not shown) | |||
Line 2: | Line 2: | ||
|name_de=NCDELTA.DAT | |name_de=NCDELTA.DAT | ||
|filetype=ncdelta.dat | |filetype=ncdelta.dat | ||
|version= | |version=April 2023 | ||
|version_descr= | |version_descr=October 2022 | ||
|significance=contains general steering data for the program [[NCDELTA]]. | |significance=contains general steering data for the program [[NCDELTA]]. | ||
|filecontents= | |filecontents= | ||
Line 9: | Line 9: | ||
* Block '''Program_Parameters''': general steering data | * Block '''Program_Parameters''': general steering data | ||
*# '''Max_Read_Storage''': | *# '''Max_Read_Storage''': number of data items in byte read from input file during each analysis cycle. This value gives a good approximation of [[NCDELTA|NCDELTA's]] mamximum memory requirements for each variable. | ||
*# '''Max_Distance''': maximum distance in [m] up to which points with different location are compared. | *# '''Max_Distance''': maximum distance in [m] up to which points with different location are compared. | ||
*# (optional) '''Print_Modus_Classify''': parameter to steer informative printout messages in program section ''classification'': | *# (optional) '''Print_Modus_Classify''': parameter to steer informative printout messages in program section ''classification'': | ||
Line 23: | Line 23: | ||
*# (optional) '''Print_Modus_Compute''': parameter to steer informative printout messages in program section ''computation of results'': | *# (optional) '''Print_Modus_Compute''': parameter to steer informative printout messages in program section ''computation of results'': | ||
*##'''0''' = no extensive messages printed; | *##'''0''' = no extensive messages printed; | ||
*## '''1''' = more extensive messages about computational result variables will be printed. | *## '''1''' = more extensive messages about computational result variables will be printed. | ||
*# (optional) '''NC_Deflate_Level''': deflate level (0,1,2,...,9) for online compression of data during write. 0 corresponds to no compression and 9 to maximum compression | |||
*# (optional) '''NC_Cmode_Id''': ''creation mode flag'' used for [[NetCDF|CF NetCDF]] method [https://www.unidata.ucar.edu/software/netcdf/netcdf-4/newdocs/netcdf-f90/NF90_005fCREATE.html NF90_CREATE]. Typical values used in this application are: | |||
*#* 4 = '''NF90_64BIT_OFFSET''' (NetCDF 64Bit file, no HDF - no online compression); | |||
*#* 5 = '''NF90_CLASSIC_MODEL''' (HDF file without use of extended HDF features - with online compression). | |||
* Block '''Data_Files''': data files | * Block '''Data_Files''': data files | ||
*# '''Reference_File''': file (NETCDF) with '''reference''' data (filetype [[CF-NETCDF.NC|cf-netcdf.nc]]); | *# '''Reference_File''': file (NETCDF) with '''reference''' data (filetype [[CF-NETCDF.NC|cf-netcdf.nc]]); | ||
*# '''Variant_File''': file (NETCDF) with '''variant''' data (filetype [[CF-NETCDF.NC|cf-netcdf.nc]]); | *# '''Variant_File''': file (NETCDF) with '''variant''' data (filetype [[CF-NETCDF.NC|cf-netcdf.nc]]); | ||
*# '''Result_File''': file (NETCDF) for '''result''' data (filetype [[CF-NETCDF.NC|cf-netcdf.nc]]). | *# '''Result_File''': file (NETCDF) for '''result''' data (filetype [[CF-NETCDF.NC|cf-netcdf.nc]]); | ||
*# (optional) '''Reference_Period''': start and end time of period of comparison for reference data (for synoptic data only); | |||
*# (optional) '''Variant_Period''': start and end time of period of comparison for variant data (for synoptic data only). | |||
* (optional) Block '''Data_Operations''': data operations | * (optional) Block '''Data_Operations''': data operations | ||
*# (optional) '''With_Ordinary_Differences''': compute (.true.) common differences (if possible) or do not compute (.false.); | *# (optional) '''With_Ordinary_Differences''': compute (.true.) common differences (if possible) or do not compute (.false.); | ||
*# (optional) '''With_Taylor_Diagram_Data''': compute (.true.) data for Taylor diagram (if possible) or do not compute (.false.); | *# (optional) '''With_Taylor_Diagram_Data''': compute (.true.) data for Taylor diagram (if possible) or do not compute (.false.); including skill scores according to Taylor (2001) equations 4 and 5; | ||
*# (optional) '''With_Median''': compute (.true.) median (>= 32 events) or do not compute (.false.); | *# (optional) '''With_Median''': compute (.true.) median (>= 32 events) or do not compute (.false.); | ||
*# (optional) '''With_Percentiles_05_95''': compute (.true.) percentiles Q05, Q95 (>= 32 events) or do not compute (.false.); | *# (optional) '''With_Percentiles_05_95''': compute (.true.) percentiles Q05, Q95 (>= 32 events) or do not compute (.false.); | ||
*# (optional) '''With_Percentiles_01_99''': compute (.true.) percentiles Q01, Q99 (>= 51 events) or do not compute (.false.). | *# (optional) '''With_Percentiles_01_99''': compute (.true.) percentiles Q01, Q99 (>= 51 events) or do not compute (.false.); | ||
*# (optional) '''With_Murphy_Skill_1988''': compute (.true.) skill according to Murphy (1988) equation 4 or do not compute (.false.); | |||
*# (optional) '''With_Skill_Willmott_1981''': compute (.true.) skill according to Willmott (1981) Index of agreement (d); | |||
*# (optional) '''With_Original_Data''': copy (.true.) or not (.false.) input data from which ordinary differences are computed. | |||
* (optional) Block '''Exclude_Variable_From_NCDELTA''': list of variables to be excluded from computation. | * (optional) Block '''Exclude_Variable_From_NCDELTA''': list of variables to be excluded from computation. | ||
*# '''Variant_Variable''': variable from ''Variant-File''. Key can be prescribed several times. With exception of the variables listed here results will be computed for all primary variable pairs. | *# '''Variant_Variable''': variable from ''Variant-File''. Key can be prescribed several times. With exception of the variables listed here results will be computed for all primary variable pairs. | ||
* (optional) Block '''Include_Only_Variable_for_NCDELTA''': list of variables for which results ar exclusively computed. | * (optional) Block '''Include_Only_Variable_for_NCDELTA''': list of variables for which results ar exclusively computed. | ||
*# '''Variant_Variable''': variable from ''Variant-File''. Key can be prescribed several times. Results will be solely computed for the variables listed here. | *# '''Variant_Variable''': variable from ''Variant-File''. Key can be prescribed several times. Results will be solely computed for the variables listed here. | ||
* (optional) Block '''No_Normal_Vector_Variable''': The list of variables which are normal vectors is (mostly) automatically determined with [[NCDELTA]]. So far, unfortunately, not all of them can be safely identified based on CF metadata. With this list variables can be explicitely '''''excluded''''' from the class of normal vector variables. | |||
*# '''Variable''': variable from ''Variant-File'' or ''Reference_File''. Key can be prescribed several times. | |||
* (optional) Block '''Normal_Vector_Variable''': The list of variables which are normal vectors is (mostly) automatically determined with [[NCDELTA]]. So far, unfortunately, not all of them can be safely identified based on CF metadata. With this list variables can be explicitely '''''included''''' in the class of normal vector variables. | |||
*# '''Variable''': variable from ''Variant-File'' or ''Reference_File''. Key can be prescribed several times. | |||
* (optional) Block '''Label_Relation''': For intercomparison of ''fractioned'' variables, for which the relationship between individual ''fractions'' (sediment, tidal constituent, etc.) cannot be automatically determined. In such situations the corresponding names must be prescribed by the user. Block can be specified several times. | |||
*# '''Variant_Label_KV''': name of a valid label coordinate variable from ''Variant_File'' or ''NONE''. | |||
*# '''Reference_Label_KV''': name of a valid label coordinate variable from ''Reference_File'' or ''NONE''. | |||
*# '''Relation''': ''name of a ''fraction'' in Variant_File'' ''':''' ''name of a ''fraction'' in Reference_File''. Key can be specified several times. ''NONE'' must be specified in case there exists no corresponding label coordinate variable. Colon is used as separator. | |||
===General Remarks=== | ===General Remarks=== | ||
Line 65: | Line 82: | ||
#* ref. case 2: | #* ref. case 2: | ||
#** identical (tracer-) fractions (if present), and | #** identical (tracer-) fractions (if present), and | ||
#** measured data may contain for the same (geographical) location (x,y) several measured data in different depths (z). | #** measured data may contain for the same (geographical) location (x,y) several measured data in different depths (z). Furthermore | ||
#** for comparisons with measured current velocity attribute "name_id" of variable "current_velocity" must be set to 836. This requirement should be checked before execution (e.g. using ncdump). In case this condition is not fulfilled NCO tool NCATTED <br /> '''ncatted -a name_id,current_velocity,m,i,836 -O ''reference_file''.nc''' <br /> can be used to redefine "name_id" accordingly. | |||
#* ref. case 3: | #* ref. case 3: | ||
#** each (geographical) location is allowed to be present only once; locations with several stacked data positions are not allowed currently with this use case. | #** each (geographical) location is allowed to be present only once; locations with several stacked data positions are not allowed currently with this use case. |
Latest revision as of 11:00, 12 April 2023
Basic Information
File-Type
ncdelta.dat
File-Form
FORMATTED
Version
April 2023
Description-Date
October 2022
Significance of the File
contains general steering data for the program NCDELTA.
File-Contents (in Catchwords)
steering data
- Block Program_Parameters: general steering data
- Max_Read_Storage: number of data items in byte read from input file during each analysis cycle. This value gives a good approximation of NCDELTA's mamximum memory requirements for each variable.
- Max_Distance: maximum distance in [m] up to which points with different location are compared.
- (optional) Print_Modus_Classify: parameter to steer informative printout messages in program section classification:
- 0 = no extensive messages printed;
- 1 = more extensive messages about classified variables will be printed.
- (optional) Print_Modus_Pairs: parameter to steer informative printout messages in program section primary partner variables:
- 0 = no extensive messages printed;
- 1 = more extensive messages about detected variable pairs will be printed;
- 2 = also informations about rejected variable pairs will be printed.
- (optional) Print_Modus_Define: parameter to steer informative printout messages in program section definition of computational results:
- 0 = no extensive messages printed;
- 1 = more extensive informations with respect to metadata of computational results will be printed.
- (optional) Print_Modus_Compute: parameter to steer informative printout messages in program section computation of results:
- 0 = no extensive messages printed;
- 1 = more extensive messages about computational result variables will be printed.
- (optional) NC_Deflate_Level: deflate level (0,1,2,...,9) for online compression of data during write. 0 corresponds to no compression and 9 to maximum compression
- (optional) NC_Cmode_Id: creation mode flag used for CF NetCDF method NF90_CREATE. Typical values used in this application are:
- 4 = NF90_64BIT_OFFSET (NetCDF 64Bit file, no HDF - no online compression);
- 5 = NF90_CLASSIC_MODEL (HDF file without use of extended HDF features - with online compression).
- Block Data_Files: data files
- Reference_File: file (NETCDF) with reference data (filetype cf-netcdf.nc);
- Variant_File: file (NETCDF) with variant data (filetype cf-netcdf.nc);
- Result_File: file (NETCDF) for result data (filetype cf-netcdf.nc);
- (optional) Reference_Period: start and end time of period of comparison for reference data (for synoptic data only);
- (optional) Variant_Period: start and end time of period of comparison for variant data (for synoptic data only).
- (optional) Block Data_Operations: data operations
- (optional) With_Ordinary_Differences: compute (.true.) common differences (if possible) or do not compute (.false.);
- (optional) With_Taylor_Diagram_Data: compute (.true.) data for Taylor diagram (if possible) or do not compute (.false.); including skill scores according to Taylor (2001) equations 4 and 5;
- (optional) With_Median: compute (.true.) median (>= 32 events) or do not compute (.false.);
- (optional) With_Percentiles_05_95: compute (.true.) percentiles Q05, Q95 (>= 32 events) or do not compute (.false.);
- (optional) With_Percentiles_01_99: compute (.true.) percentiles Q01, Q99 (>= 51 events) or do not compute (.false.);
- (optional) With_Murphy_Skill_1988: compute (.true.) skill according to Murphy (1988) equation 4 or do not compute (.false.);
- (optional) With_Skill_Willmott_1981: compute (.true.) skill according to Willmott (1981) Index of agreement (d);
- (optional) With_Original_Data: copy (.true.) or not (.false.) input data from which ordinary differences are computed.
- (optional) Block Exclude_Variable_From_NCDELTA: list of variables to be excluded from computation.
- Variant_Variable: variable from Variant-File. Key can be prescribed several times. With exception of the variables listed here results will be computed for all primary variable pairs.
- (optional) Block Include_Only_Variable_for_NCDELTA: list of variables for which results ar exclusively computed.
- Variant_Variable: variable from Variant-File. Key can be prescribed several times. Results will be solely computed for the variables listed here.
- (optional) Block No_Normal_Vector_Variable: The list of variables which are normal vectors is (mostly) automatically determined with NCDELTA. So far, unfortunately, not all of them can be safely identified based on CF metadata. With this list variables can be explicitely excluded from the class of normal vector variables.
- Variable: variable from Variant-File or Reference_File. Key can be prescribed several times.
- (optional) Block Normal_Vector_Variable: The list of variables which are normal vectors is (mostly) automatically determined with NCDELTA. So far, unfortunately, not all of them can be safely identified based on CF metadata. With this list variables can be explicitely included in the class of normal vector variables.
- Variable: variable from Variant-File or Reference_File. Key can be prescribed several times.
- (optional) Block Label_Relation: For intercomparison of fractioned variables, for which the relationship between individual fractions (sediment, tidal constituent, etc.) cannot be automatically determined. In such situations the corresponding names must be prescribed by the user. Block can be specified several times.
- Variant_Label_KV: name of a valid label coordinate variable from Variant_File or NONE.
- Reference_Label_KV: name of a valid label coordinate variable from Reference_File or NONE.
- Relation: name of a fraction in Variant_File : name of a fraction in Reference_File. Key can be specified several times. NONE must be specified in case there exists no corresponding label coordinate variable. Colon is used as separator.
General Remarks
- Dictionary files used from directory $PROGHOME/dic/:
- ncdelta_dico.dat.
- Use Cases:
- Case 1: Reference_File = simulation 1, Variant_File = simulation 2;
- Case 2: Reference_File = measurement, Variant_File = simulation;
- Case 3: Reference_File = measurement 1, Variant_File = measurement 2;
- Synoptic data or data analysis results from program NCANALYSE can be used.
- General requirements:
- Synoptic data:
- length of time period must be identical (periods may differ), and
- time step must be identical.
- Analysis results (NCANALYSE):
- length of period of data analysis must be comparable, and
- number of events, e.g. tidal high water, must also be identical.
- Z coordinate variables:
- z coordinate variables, if present, must be consistent with respect to
- CF attribute positive all with value "down", or
- CF attribute positive all with value "up"
- (see CF metadata conventions).
- Synoptic data:
- Special requirements:
- ref. case 1:
- same vertical structure (number of layers), and
- identical (tracer-) fractions (if present).
- ref. case 2:
- identical (tracer-) fractions (if present), and
- measured data may contain for the same (geographical) location (x,y) several measured data in different depths (z). Furthermore
- for comparisons with measured current velocity attribute "name_id" of variable "current_velocity" must be set to 836. This requirement should be checked before execution (e.g. using ncdump). In case this condition is not fulfilled NCO tool NCATTED
ncatted -a name_id,current_velocity,m,i,836 -O reference_file.nc
can be used to redefine "name_id" accordingly.
- ref. case 3:
- each (geographical) location is allowed to be present only once; locations with several stacked data positions are not allowed currently with this use case.
- ref. case 1:
Programs using this Type of File
Example-File
$PROGHOME/examples/ncdelta/ncdelta.dat
back to: File Descriptions