Actions

DATACONVERT: Difference between revisions

From BAWiki

imported>Lang Guenther
(mode 8 added for CF SGRID NetCDF into CF UGRID NetCDF conversion)
(working group POS)
 
(11 intermediate revisions by 6 users not shown)
Line 2: Line 2:
|name_de=DATACONVERT
|name_de=DATACONVERT
|name=DATACONVERT
|name=DATACONVERT
|version=September 2017
|version=August 2020
|version_descr=August 2017
|version_descr=September 2022
|catchwords=conversion of Delft3D computational grid<br />
|catchwords=conversion of Delft3D computational grid<br />
conversion of Delft3D computational results<br />
conversion of Delft3D computational results<br />
Line 10: Line 10:
conversion of BDF data into CF NetCDF data <br />
conversion of BDF data into CF NetCDF data <br />
conversion of meteorological data into the Delft3D format METEO_DLFT <br />
conversion of meteorological data into the Delft3D format METEO_DLFT <br />
conversion of timeseries in BOEWRT format into CF NetCDF data<br />
conversion of timeseries in BOEWRT format into CF NetCDF data (with optional [[BOEWRT.DAT#Status-Flag_Variable|status flag variable]])<br />
conversion of CF SGRID NetCDF into CF UGRID NetCDF<br />
conversion of CF SGRID NetCDF into CF UGRID NetCDF<br />


Line 46: Line 46:
** [[NetCDF synoptic data for multiple profiles|synoptic data for multiple profiles]].
** [[NetCDF synoptic data for multiple profiles|synoptic data for multiple profiles]].
* '''mode 6''': conversion of meteorological data into Delft3D format METEO_DLFT.
* '''mode 6''': conversion of meteorological data into Delft3D format METEO_DLFT.
* '''mode 7''': conversion of timeseries and meta information in [[BOEWRT.DAT|BOEWRT format]] into [[CF-NETCDF.NC|cf-netcdf.nc]] data according to NODC's [http://www.nodc.noaa.gov/data/formats/netcdf/#templatesexamples feature type template for timeSeries].
* '''mode 7''': conversion of timeseries and meta information in [[BOEWRT.DAT|BOEWRT format]] into [[CF-NETCDF.NC|cf-netcdf.nc]] data according to NODC's [http://www.nodc.noaa.gov/data/formats/netcdf/#templatesexamples feature type template for timeSeries]. Creation of optional [[BOEWRT.DAT#Status-Flag_Variable|status flag variable]] for description of data quality is supported.
* '''mode 8''': conversion of CF SGRID NetCDF into CF UGRID NetCDF (see [[CF-NETCDF.NC|cf-netcdf.nc]]).
* '''mode 8''': conversion of CF SGRID NetCDF into CF UGRID NetCDF (see [[CF-NETCDF.NC|cf-netcdf.nc]]).
|inputfiles=
|inputfiles=
Line 67: Line 67:
#** [[GITTER05.DAT and GITTER05.BIN|gitter05.dat and gitter05.bin]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[GITTER05.DAT and GITTER05.BIN|gitter05.dat and gitter05.bin]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[UNTRIM_GRID.DAT|untrim_grid.dat]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[UNTRIM_GRID.DAT|untrim_grid.dat]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[UTRSUB_GRID.DAT|utrsub_grid.dat]] (only with ''false'' subgrid - one subpolygon/polygon, one subedge/edge).
#** [[PROFIL05.BIN|profil05.bin]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[PROFIL05.BIN|profil05.bin]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#* ''' mode 6'''
#* ''' mode 6'''
Line 73: Line 74:
#* '''mode 8''' - no grid file required
#* '''mode 8''' - no grid file required
# '''(optional) global metadata'''
# '''(optional) global metadata'''
#* [[Metadata_of_Model_results_in_Coastal_Engineering|Setting metadata via shell scripts]], envrionment variables can of a simulation can be set in a run script. Variables describing the project can be stored in a project script (German: Auftragsskript) under $PROGHOME/bin/dmqs. So, DMQS compliant metadata is generated.
#* [[NC_META.DAT|nc_meta.dat]], in case file ''nc_meta.dat'' is present in the current working directory, this file will be read by the application. Otherwise the respective file from $PROGHOME/cfg will be read.
#* [[NC_META.DAT|nc_meta.dat]], in case file ''nc_meta.dat'' is present in the current working directory, this file will be read by the application. Otherwise the respective file from $PROGHOME/cfg will be read.
# '''computational results or data'''
# '''computational results or data'''
Line 135: Line 137:
#* dataconvert.trc.
#* dataconvert.trc.
|methodology=The original computational grid is in case converted using methods from software package H_GRID or L_GRID. Interpolation of computational results is performed using methods from the H_IP package. Read and Write of computational data is carried through essentially using methods from software package IO_DATASET and in mode 6 also using IO_DELFT.
|methodology=The original computational grid is in case converted using methods from software package H_GRID or L_GRID. Interpolation of computational results is performed using methods from the H_IP package. Read and Write of computational data is carried through essentially using methods from software package IO_DATASET and in mode 6 also using IO_DELFT.
|preprocessor=[http://www.baw.de/methoden/index.php5/Mathematisches_Verfahren_DELFT3D DELFT3D], [[GETDATA]], [[GRIDCONVERT]], [[UNTRIM2007]], [[XTRLQ2]].  
|preprocessor=[http://www.baw.de/methoden/index.php5/Mathematisches_Verfahren_DELFT3D DELFT3D], [[GETDATA]], [[GRIDCONVERT]], [[UNTRIM2007]], [[UNTRIM2]], [[XTRLQ2]].  
|postprocessor=[[ABDF]], [[ADCP2PROFILE]], [[ArcGIS-Applications]], [[DAVIT]], [[Mathematical_Model_DELFT3D|DELFT3D]], [[DIDAMERGE]], [[DIDARENAME]], [[DIDASPLIT]], [[ENERF]], [[GVIEW2D]], [[HVIEW2D]], [[IO_VOLUME]], [[METDIDA]], [[NCANALYSE]], [[NCAUTO]], [[NCDELTA]], [[NCPLOT]], [[NCRCATMAT]], [[NC2TABLE]], [[NetCDF Operators]], [[PARTRACE]], [[PGCALC]], [[PLOTTS]], [[QUICKPLOT]], [[UNK]], [[UNS]], [[VTDK]], [[XTRDATA]], [[XTRLQ2]], [[ZEITR]].  
|postprocessor=[[ABDF]], [[ADCP2PROFILE]], [[ArcGIS-Applications]], [[DAVIT]], [[Mathematical_Model_DELFT3D|DELFT3D]], [[DIDAMERGE]], [[DIDARENAME]], [[DIDASPLIT]], [[ENERF]], [[GVIEW2D]], [[HVIEW2D]], [[IO_VOLUME]], [[METDIDA]], [[NCANALYSE]], [[NCAUTO]], [[NCCHUNKIE]], [[NCDELTA]], [[NCDVAR]], [[NCMERGE]], [[NCPLOT]], [[NCRCATMAT]], [[NC2TABLE]], [[NCVIEW2D]], [[NetCDF Operators]], [[PARTRACE]], [[PGCALC]], [[PLOTPROFILZEIT]], [[PLOTTS]], [[QUICKPLOT]], [[UNK]], [[UNS]], [[VTDK]], [[XTRDATA]], [[XTRLQ2]], [[ZEITR]].  
|language=Fortran90  
|language=Fortran90  
|add_software=-  
|add_software=-  
|contact_original=[mailto:guenther.lang@baw.de G. Lang]
|contact_original=G. Lang, P. Schade
|contact_maintenance=[mailto:guenther.lang@baw.de G. Lang,], [mailto:susanne.spohr@baw.de S. Spohr,], [mailto:peter.schade@baw.de P. Schade,]
|contact_maintenance=[mailto:pos.proghome@baw.de Arbeitsgruppe POS]
|documentation=for example input files please refer to $PROGHOME/examples/dataconvert/
|documentation=for example input files please refer to $PROGHOME/examples/dataconvert/
}}
}}

Latest revision as of 08:50, 6 September 2022

Basic Information

Name of Program

DATACONVERT

Version-Date

August 2020

Description-Date

September 2022

Catchwords

conversion of Delft3D computational grid
conversion of Delft3D computational results
conversion of (DWD) NetCDF data files
merge of (DWD) NetCDF data files in one NetCDF file
conversion of BDF data into CF NetCDF data
conversion of meteorological data into the Delft3D format METEO_DLFT
conversion of timeseries in BOEWRT format into CF NetCDF data (with optional status flag variable)
conversion of CF SGRID NetCDF into CF UGRID NetCDF

Acknowledgment: This project took advantage of netCDF software developed by UCAR/Unidata (www.unidata.ucar.edu/software/netcdf/).

Short Description of Functionality

Program DATACONVERT is used to convert computational results and data:

  • mode 1: conversion of computational results from the integrated modelling system Delft3D into BAW-specific data formats, with
    • conversion of a Delft3D computational grid into UnTRIM grid format,
    • conversion of two-dimensional (depth averaged) Delft3D computational results into BDF data format (2D),
    • conversion and depth averaging of three-dimensional Delft3D computational results into BDF data format (2D), and
    • conversion of three-dimensional Delft3D computational results (sigma-coordinates) into BDF data format (3D, z-layers).

Dynamic model bathymetry (morphodynamics) is supported for 2D as well as 3D computational results. If Delft3D model results have been produced for a domain decomposition run, the converted results are written to different domain-specific data files and are not yet combined into one single file.

A conversion into the subsequent physical output quantities is currently possible:

  1. water level,
  2. current velocity,
  3. salinity,
  4. temperature,
  5. bathymetry (static),
  6. transient bathymetric depth,
  7. vertical erosion,
  8. suspended load (icode=7),
  9. new: (mass) bed load transport rate (icode=621), converted from a volume transport rate,
  10. new: (mass) suspended load transport rate (icode=622), converted from a volume transport rate and
  11. new: bottom shear stress

Input-Files

  1. steering data
    file of type dataconvert.dat. The extended description for this file contains comprehensive informations with respect to steering data, input as well as output data files.
  2. computational grid
  3. (optional) global metadata
    • Setting metadata via shell scripts, envrionment variables can of a simulation can be set in a run script. Variables describing the project can be stored in a project script (German: Auftragsskript) under $PROGHOME/bin/dmqs. So, DMQS compliant metadata is generated.
    • nc_meta.dat, in case file nc_meta.dat is present in the current working directory, this file will be read by the application. Otherwise the respective file from $PROGHOME/cfg will be read.
  4. computational results or data
  5. (optional) vertical structure
    • mode 1
    • mode 2 - no vertical structure required
    • mode 3 - no vertical structure required
    • mode 4 - no vertical structure required
    • mode 6 - no vertical structure required
    • mode 7 - no vertical structure required
    • mode 8 - no vertical structure required

Output-Files

  1. converted computational grid
  2. converted computational results
  3. printer file
    • dataconvert.sdr.
  4. (optional) trace file
    • dataconvert.trc.

Methodology

The original computational grid is in case converted using methods from software package H_GRID or L_GRID. Interpolation of computational results is performed using methods from the H_IP package. Read and Write of computational data is carried through essentially using methods from software package IO_DATASET and in mode 6 also using IO_DELFT.

Program(s) to run before this Program

DELFT3D, GETDATA, GRIDCONVERT, UNTRIM2007, UNTRIM2, XTRLQ2.

Program(s) to run after this Program

ABDF, ADCP2PROFILE, ArcGIS-Applications, DAVIT, DELFT3D, DIDAMERGE, DIDARENAME, DIDASPLIT, ENERF, GVIEW2D, HVIEW2D, IO_VOLUME, METDIDA, NCANALYSE, NCAUTO, NCCHUNKIE, NCDELTA, NCDVAR, NCMERGE, NCPLOT, NCRCATMAT, NC2TABLE, NCVIEW2D, NetCDF Operators, PARTRACE, PGCALC, PLOTPROFILZEIT, PLOTTS, QUICKPLOT, UNK, UNS, VTDK, XTRDATA, XTRLQ2, ZEITR.

Additional Information

Language

Fortran90

Additional software

-

Original Version

G. Lang, P. Schade

Maintenance

Arbeitsgruppe POS

Documentation/Literature

for example input files please refer to $PROGHOME/examples/dataconvert/


back to Program Descriptions


Overview