Actions

DATACONVERT: Difference between revisions

From BAWiki

imported>Schade Peter
No edit summary
(working group POS)
 
(40 intermediate revisions by 8 users not shown)
Line 2: Line 2:
|name_de=DATACONVERT
|name_de=DATACONVERT
|name=DATACONVERT
|name=DATACONVERT
|version=8.x / February 2011
|version=August 2020
|version_descr=February 2011
|version_descr=September 2022
|catchwords=conversion of Delft3D computational grid<br />
|catchwords=conversion of Delft3D computational grid<br />
conversion of Delft3D computational results<br />
conversion of Delft3D computational results<br />
conversion of (DWD) NetCDF data files<br />
conversion of (DWD) NetCDF data files<br />
merge of (DWD) NetCDF data files in one NetCDF file<br />
merge of (DWD) NetCDF data files in one NetCDF file<br />
<font color=Green>new:</font> conversion of meteorological data into the Delft3D format METEO_DLFT
conversion of BDF data into CF NetCDF data <br />
conversion of meteorological data into the Delft3D format METEO_DLFT <br />
conversion of timeseries in BOEWRT format into CF NetCDF data (with optional [[BOEWRT.DAT#Status-Flag_Variable|status flag variable]])<br />
conversion of CF SGRID NetCDF into CF UGRID NetCDF<br />
 
Acknowledgment: ''This project took advantage of netCDF software developed by UCAR/Unidata ([http://www.unidata.ucar.edu/software/netcdf/ www.unidata.ucar.edu/software/netcdf/]).''
 
|shortdescription=Program DATACONVERT is used to convert computational results and data:
|shortdescription=Program DATACONVERT is used to convert computational results and data:
* '''mode 1''': conversion of computational results from the integrated modelling system Delft3D into BAW-specific data formats, with<br />
* '''mode 1''': conversion of computational results from the integrated modelling system Delft3D into BAW-specific data formats, with<br />
Line 16: Line 22:
** conversion of three-dimensional Delft3D computational results (sigma-coordinates) into BDF data format (3D, z-layers).<br />
** conversion of three-dimensional Delft3D computational results (sigma-coordinates) into BDF data format (3D, z-layers).<br />
Dynamic model bathymetry (morphodynamics) is supported for 2D as well as 3D computational results. If Delft3D model results have been produced for a domain decomposition run, the converted results are written to different domain-specific data files and are not yet combined into one single file.<br /><br />
Dynamic model bathymetry (morphodynamics) is supported for 2D as well as 3D computational results. If Delft3D model results have been produced for a domain decomposition run, the converted results are written to different domain-specific data files and are not yet combined into one single file.<br /><br />
Conversion of subsequent physical quantities is currently possible:
A conversion into the subsequent physical output quantities is currently possible:
# water level,
# water level,
# current velocity,
# current velocity,
# salinity,
# salinity,
# temperature,
# temperature,
# suspended sediment (several fractions),
# bathymetry (static),
# bathymetry (static),
# transient bathymetric depth, and
# transient bathymetric depth,  
# vertical erosion.
# vertical erosion,
# suspended load (icode=7),
# ''new'': (mass) bed load transport rate (icode=621), converted from a volume transport rate,
# ''new'': (mass) suspended load transport rate (icode=622), converted from a volume transport rate and
# ''new'': bottom shear stress
* '''mode 2''': conversion of (DWD) NetCDF data files into BAW-specific data formats, with
* '''mode 2''': conversion of (DWD) NetCDF data files into BAW-specific data formats, with
** generation of a grid from data points defined in the NetCDF data file, and
** generation of a grid from data points defined in the NetCDF data file, and
Line 30: Line 39:
* '''mode 3''': merge contents of several (DWD) NetCDF data files into a single NetCDF data file, with
* '''mode 3''': merge contents of several (DWD) NetCDF data files into a single NetCDF data file, with
** transfer of meta data as well as data for identical dates into a single NetCDF data file.
** transfer of meta data as well as data for identical dates into a single NetCDF data file.
* '''<font color=Green>new: mode 6'''</font>: conversion of meteorological data into Delft3D format METEO_DLFT.
* '''mode 4''': conversion of [[DIRZ.BIN|BDF]] data into [[CF-NETCDF.NC|cf-netcdf.nc]] data, for
 
** [[NetCDF synoptic data at multiple locations|synoptic data at multiple locations]].
** [[NetCDF synoptic data for triangular grid|synoptic data for triangular grid]].
** [[NetCDF synoptic (morphological) data for triangular grid|synoptic (morphological) data for triangular grid]].
** [[NetCDF synoptic data for unstructured grid|synoptic data for unstructured grid]].
** [[NetCDF synoptic data for multiple profiles|synoptic data for multiple profiles]].
* '''mode 6''': conversion of meteorological data into Delft3D format METEO_DLFT.
* '''mode 7''': conversion of timeseries and meta information in [[BOEWRT.DAT|BOEWRT format]] into [[CF-NETCDF.NC|cf-netcdf.nc]] data according to NODC's [http://www.nodc.noaa.gov/data/formats/netcdf/#templatesexamples feature type template for timeSeries]. Creation of optional [[BOEWRT.DAT#Status-Flag_Variable|status flag variable]] for description of data quality is supported.
* '''mode 8''': conversion of CF SGRID NetCDF into CF UGRID NetCDF (see [[CF-NETCDF.NC|cf-netcdf.nc]]).
|inputfiles=
|inputfiles=
# '''steering data'''
# '''steering data'''
Line 47: Line 63:
#* '''mode 2''' - no grid file required
#* '''mode 2''' - no grid file required
#* '''mode 3''' - no grid file required
#* '''mode 3''' - no grid file required
#* '''mode 4'''
#** [[LOCATION_GRID.DAT|location_grid.dat]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[GITTER05.DAT and GITTER05.BIN|gitter05.dat and gitter05.bin]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[UNTRIM_GRID.DAT|untrim_grid.dat]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#** [[UTRSUB_GRID.DAT|utrsub_grid.dat]] (only with ''false'' subgrid - one subpolygon/polygon, one subedge/edge).
#** [[PROFIL05.BIN|profil05.bin]] or [[CF-NETCDF.NC|cf-netcdf.nc]] (from [[GRIDCONVERT]]).
#* ''' mode 6'''
#** all grid file formats used with BDF data, e. g. [[GITTER05.DAT and GITTER05.BIN|gitter05.dat and gitter05.bin]].
#* '''mode 7''' - no grid file required
#* '''mode 8''' - no grid file required
# '''(optional) global metadata'''
#* [[Metadata_of_Model_results_in_Coastal_Engineering|Setting metadata via shell scripts]], envrionment variables can of a simulation can be set in a run script. Variables describing the project can be stored in a project script (German: Auftragsskript) under $PROGHOME/bin/dmqs. So, DMQS compliant metadata is generated.
#* [[NC_META.DAT|nc_meta.dat]], in case file ''nc_meta.dat'' is present in the current working directory, this file will be read by the application. Otherwise the respective file from $PROGHOME/cfg will be read.
# '''computational results or data'''
# '''computational results or data'''
#* '''mode 1'''  
#* '''mode 1'''  
Line 54: Line 83:
#* '''mode 3'''
#* '''mode 3'''
#** [[NETCDF.CDF|netcdf.cdf.]]
#** [[NETCDF.CDF|netcdf.cdf.]]
#* ''' mode 4'''
#** BDF data files [[DIRZ.BIN|dirz.bin]], [[DIRZ.BIN.I|dirz.bin.I]] and [[DIRZ.BIN.R|dirz.bin.R]]
#* '''mode 6'''
#* '''mode 6'''
#** meteorological BDF files [[DIRZ.BIN.R|dirz.bin.r]],
#** meteorological BDF files [[DIRZ.BIN|dirz.bin]], [[DIRZ.BIN.I|dirz.bin.I]] and [[DIRZ.BIN.R|dirz.bin.R]].
#** [[DIRZ.BIN.I|dirz.bin.i]], and
#* '''mode 7'''
#** [[DIRZ.BIN|dirz.bin]].
#**time series in [[BOEWRT.DAT|boewrt.dat]].
#* '''mode 8'''
#** [[NETCDF.CDF|netcdf.cdf]] (CF SGRID NetCDF).
#(optional) '''vertical structure'''
#(optional) '''vertical structure'''
#* '''mode 1'''
#* '''mode 1'''
Line 63: Line 96:
#* '''mode 2''' - no vertical structure required
#* '''mode 2''' - no vertical structure required
#* '''mode 3''' - no vertical structure required
#* '''mode 3''' - no vertical structure required
#* '''mode 4''' - no vertical structure required
#* '''mode 6''' - no vertical structure required
#* '''mode 6''' - no vertical structure required
#* '''mode 7''' - no vertical structure required
#* '''mode 8''' - no vertical structure required
|outputfiles=
|outputfiles=
# '''converted computational grid'''
# '''converted computational grid'''
Line 71: Line 107:
#** [[GITTER05.DAT and GITTER05.BIN|gitter05.dat/bin]]
#** [[GITTER05.DAT and GITTER05.BIN|gitter05.dat/bin]]
#* '''mode 3''' - no grid generated
#* '''mode 3''' - no grid generated
#* '''mode 4'''
#** (optional) [[CF-NETCDF.NC|cf-netcdf.nc]]
#* '''mode 6'''
#* '''mode 6'''
#** implicit regular grid
#** implicit regular grid
#* '''mode 7''' - no grid generated
#* '''mode 8''' - no grid generated
# '''converted computational results'''
# '''converted computational results'''
#* '''mode 1'''
#* '''mode 1'''
Line 83: Line 123:
#** [[DIRZ.BIN|dirz.bin.]]
#** [[DIRZ.BIN|dirz.bin.]]
#* '''mode 3'''
#* '''mode 3'''
#** [[NETCDF.CDF|netcdf.cdf.]]
#** [[NETCDF.CDF|netcdf.cdf]].
#* '''mode 4'''
#** [[CF-NETCDF.NC|cf-netcdf.nc]],
#* '''mode 6'''
#* '''mode 6'''
#** [[METEO_DLFT]]
#** [[METEO_DLFT]]
#* '''mode 7'''
#** [[CF-NETCDF.NC|cf-netcdf.nc]].
#* '''mode 8'''
#** [[CF-NETCDF.NC|cf-netcdf.nc]] (CF UGRID NetCDF).
# '''printer file'''
# '''printer file'''
#* dataconvert.sdr.
#* dataconvert.sdr.
# (optional) '''trace file'''
# (optional) '''trace file'''
#* dataconvert.trc.
#* dataconvert.trc.
|methodology=The original computational grid is converted using methods from software package H_GRID. Conversion of computational results is performed using methods from the H_IP package. Read and Write of computational data is carried through using several methods from software package IO_DATASET and in mode 6 also using IO_DELFT.
|methodology=The original computational grid is in case converted using methods from software package H_GRID or L_GRID. Interpolation of computational results is performed using methods from the H_IP package. Read and Write of computational data is carried through essentially using methods from software package IO_DATASET and in mode 6 also using IO_DELFT.
|preprocessor=[http://www.baw.de/methoden/index.php5/Mathematisches_Verfahren_DELFT3D DELFT3D], [[GETDATA]].  
|preprocessor=[http://www.baw.de/methoden/index.php5/Mathematisches_Verfahren_DELFT3D DELFT3D], [[GETDATA]], [[GRIDCONVERT]], [[UNTRIM2007]], [[UNTRIM2]], [[XTRLQ2]].  
|postprocessor=[[ABDF]], [[ADCP2PROFILE]], [[NUMERICAL_METHOD_DELFT3D|DELFT3D]], [[DIDAMERGE]], [[DIDARENAME]], [[DIDASPLIT]], [[ENERF]], [[GVIEW2D]], [[HVIEW2D]], [[IO_VOLUME]], [[METDIDA]], [[PARTRACE]], [[PARTRACE-3D]], [[PGCALC]], [[UNK]], [[UNS]], [[VTDK]], [[XTRDATA]], [[XTRLQ2]], [[ZEITR]].  
|postprocessor=[[ABDF]], [[ADCP2PROFILE]], [[ArcGIS-Applications]], [[DAVIT]], [[Mathematical_Model_DELFT3D|DELFT3D]], [[DIDAMERGE]], [[DIDARENAME]], [[DIDASPLIT]], [[ENERF]], [[GVIEW2D]], [[HVIEW2D]], [[IO_VOLUME]], [[METDIDA]], [[NCANALYSE]], [[NCAUTO]], [[NCCHUNKIE]], [[NCDELTA]], [[NCDVAR]], [[NCMERGE]], [[NCPLOT]], [[NCRCATMAT]], [[NC2TABLE]], [[NCVIEW2D]], [[NetCDF Operators]], [[PARTRACE]], [[PGCALC]], [[PLOTPROFILZEIT]], [[PLOTTS]], [[QUICKPLOT]], [[UNK]], [[UNS]], [[VTDK]], [[XTRDATA]], [[XTRLQ2]], [[ZEITR]].  
|language=Fortran90  
|language=Fortran90  
|add_software=-  
|add_software=-  
|contact_original=[mailto:guenther.lang@baw.de G. Lang]
|contact_original=G. Lang, P. Schade
|contact_maintenance=[mailto:guenther.lang@baw.de G. Lang,], [mailto:susanne.spohr@baw.de S. Spohr,]
|contact_maintenance=[mailto:pos.proghome@baw.de Arbeitsgruppe POS]
|documentation=for example input files please refer to $PROGHOME/examples/dataconvert/
|documentation=for example input files please refer to $PROGHOME/examples/dataconvert/
}}
}}

Latest revision as of 08:50, 6 September 2022

Basic Information

Name of Program

DATACONVERT

Version-Date

August 2020

Description-Date

September 2022

Catchwords

conversion of Delft3D computational grid
conversion of Delft3D computational results
conversion of (DWD) NetCDF data files
merge of (DWD) NetCDF data files in one NetCDF file
conversion of BDF data into CF NetCDF data
conversion of meteorological data into the Delft3D format METEO_DLFT
conversion of timeseries in BOEWRT format into CF NetCDF data (with optional status flag variable)
conversion of CF SGRID NetCDF into CF UGRID NetCDF

Acknowledgment: This project took advantage of netCDF software developed by UCAR/Unidata (www.unidata.ucar.edu/software/netcdf/).

Short Description of Functionality

Program DATACONVERT is used to convert computational results and data:

  • mode 1: conversion of computational results from the integrated modelling system Delft3D into BAW-specific data formats, with
    • conversion of a Delft3D computational grid into UnTRIM grid format,
    • conversion of two-dimensional (depth averaged) Delft3D computational results into BDF data format (2D),
    • conversion and depth averaging of three-dimensional Delft3D computational results into BDF data format (2D), and
    • conversion of three-dimensional Delft3D computational results (sigma-coordinates) into BDF data format (3D, z-layers).

Dynamic model bathymetry (morphodynamics) is supported for 2D as well as 3D computational results. If Delft3D model results have been produced for a domain decomposition run, the converted results are written to different domain-specific data files and are not yet combined into one single file.

A conversion into the subsequent physical output quantities is currently possible:

  1. water level,
  2. current velocity,
  3. salinity,
  4. temperature,
  5. bathymetry (static),
  6. transient bathymetric depth,
  7. vertical erosion,
  8. suspended load (icode=7),
  9. new: (mass) bed load transport rate (icode=621), converted from a volume transport rate,
  10. new: (mass) suspended load transport rate (icode=622), converted from a volume transport rate and
  11. new: bottom shear stress

Input-Files

  1. steering data
    file of type dataconvert.dat. The extended description for this file contains comprehensive informations with respect to steering data, input as well as output data files.
  2. computational grid
  3. (optional) global metadata
    • Setting metadata via shell scripts, envrionment variables can of a simulation can be set in a run script. Variables describing the project can be stored in a project script (German: Auftragsskript) under $PROGHOME/bin/dmqs. So, DMQS compliant metadata is generated.
    • nc_meta.dat, in case file nc_meta.dat is present in the current working directory, this file will be read by the application. Otherwise the respective file from $PROGHOME/cfg will be read.
  4. computational results or data
  5. (optional) vertical structure
    • mode 1
    • mode 2 - no vertical structure required
    • mode 3 - no vertical structure required
    • mode 4 - no vertical structure required
    • mode 6 - no vertical structure required
    • mode 7 - no vertical structure required
    • mode 8 - no vertical structure required

Output-Files

  1. converted computational grid
  2. converted computational results
  3. printer file
    • dataconvert.sdr.
  4. (optional) trace file
    • dataconvert.trc.

Methodology

The original computational grid is in case converted using methods from software package H_GRID or L_GRID. Interpolation of computational results is performed using methods from the H_IP package. Read and Write of computational data is carried through essentially using methods from software package IO_DATASET and in mode 6 also using IO_DELFT.

Program(s) to run before this Program

DELFT3D, GETDATA, GRIDCONVERT, UNTRIM2007, UNTRIM2, XTRLQ2.

Program(s) to run after this Program

ABDF, ADCP2PROFILE, ArcGIS-Applications, DAVIT, DELFT3D, DIDAMERGE, DIDARENAME, DIDASPLIT, ENERF, GVIEW2D, HVIEW2D, IO_VOLUME, METDIDA, NCANALYSE, NCAUTO, NCCHUNKIE, NCDELTA, NCDVAR, NCMERGE, NCPLOT, NCRCATMAT, NC2TABLE, NCVIEW2D, NetCDF Operators, PARTRACE, PGCALC, PLOTPROFILZEIT, PLOTTS, QUICKPLOT, UNK, UNS, VTDK, XTRDATA, XTRLQ2, ZEITR.

Additional Information

Language

Fortran90

Additional software

-

Original Version

G. Lang, P. Schade

Maintenance

Arbeitsgruppe POS

Documentation/Literature

for example input files please refer to $PROGHOME/examples/dataconvert/

back to Program Descriptions

Overview

Retrieved from "http://wiki.baw.de/en/index.php?title=DATACONVERT&oldid=14857"