Actions

NCCUTOUT: Difference between revisions

From BAWiki

imported>Schade Peter
mNo edit summary
imported>Schade Peter
m ((so far) final version)
Line 20: Line 20:
|shortdescription=
|shortdescription=
<P>[[File:Nccutout_one_polygon.png|250px|thumb|right|Fig. 1: Results of the German Bight cut out from the modell area of the project EasyGSH-DB (BAW, 2018)]]
<P>[[File:Nccutout_one_polygon.png|250px|thumb|right|Fig. 1: Results of the German Bight cut out from the modell area of the project EasyGSH-DB (BAW, 2018)]]
The postprocessor NCCUTOUT may help users to reduce the size of result files in order to save disk space and time in the subsequent processing steps. It cuts out data of UGRID compliant NetCDF files of the area type. In UGRID metadata language the files have to have at least one mesh topology variable with the attribute topology_dimension = 2.  The cutting is typically defined by a polygon. The elements inside of the polygon get extracted to the result file. </P>
The postprocessor NCCUTOUT may help users to reduce the size of result files in order to save disk space and computation time in the subsequent processing steps. It cuts out data of UGRID compliant NetCDF files of the area type. In UGRID metadata language the files have to have at least one mesh topology variable with the attribute topology_dimension = 2.  The cutting is typically defined by a polygon. The elements inside of the polygon get extracted to the result file. </P>


<P>[[File:Nccutout_more_polygons.png|250px|thumb|right|Fig. 2: Results at seperate faces (see north western and south eastern part) cut out of a model of the Jade Weser Estuary (BAW, 2018) ]]
<P>[[File:Nccutout_more_polygons.png|250px|thumb|right|Fig. 2: Results at seperate faces (see north western and south eastern part) cut out of a model of the Jade Weser Estuary (BAW, 2018) ]]
But the cut out area can also be defined by two or more polygons which need not be direct neighbours, s. Fig. 2. Though the results may look like seperate spots of a location grid they share a common mesh topology.</P>  
But the cut out area can also be defined by two or more polygons which need not be direct neighbours, s. Fig. 2. Though the results may look like seperate spots of a location grid they share a common mesh topology.</P>  


Furthermore, the user can reduce disk space by extracting only a subset of the original geophysical variables. He can add them to a positive or alternatively to a negative list. <BR>
Furthermore, the user can reduce disk space by extracting only a subset of the original geophysical variables. He can add them to a white list or alternatively to a black list. <BR>
|inputfiles=
|inputfiles=
# '''general input data''' (file type [[NCCUTOUT.DAT|nccutout.dat]]);
# '''general input data''' (file type [[NCCUTOUT.DAT|nccutout.dat]]);
# '''input UGRID CF NetCDFs''' (file type [[CF-NETCDF.NC|cf-netcdf.nc]]);
# '''input UGRID CF NetCDFs''' (file type [[CF-NETCDF.NC|cf-netcdf.nc]]);
# '''cutout polygons''' (file type [[IPDS.DAT|ipds.dat]]);
# '''cutout polygons''' (file type [[IPDS.DAT|ipds.dat]]);
# xxx for [[NetCDF#Automatic quality assurance using NetCDF attributes|automatic quality assurance]] (file type [[BOUNDS.CFG.DAT|bounds_verify.dat]]).
# for [[NetCDF#Automatic quality assurance using NetCDF attributes|automatic quality assurance]] (file type [[BOUNDS.CFG.DAT|bounds_verify.dat]]).


|outputfiles=   
|outputfiles=   
Line 40: Line 40:
<P>[[File:Nccutout_faces_subfaces.png|250px|thumb|right|Fig. 3: Extracting faces with all their subfaces in order to generate consistent meshes.(BAW,2018)]] NCCUTOUT can process NetCDF files supporting the UGRID idea of parent and child meshes, e.g. a computational grid with a coarse and a sub grid with higher resolution. Whether data gets cut out or not depends from the position of the geometric elements in the coarsest mesh. This is displayed in Fig. 3. Certain faces of the coarser computational grid are cut out and subsequently all subfaces inside these coarser faces are extracted. This method leads to consistent meshes and parent child connections.</P>
<P>[[File:Nccutout_faces_subfaces.png|250px|thumb|right|Fig. 3: Extracting faces with all their subfaces in order to generate consistent meshes.(BAW,2018)]] NCCUTOUT can process NetCDF files supporting the UGRID idea of parent and child meshes, e.g. a computational grid with a coarse and a sub grid with higher resolution. Whether data gets cut out or not depends from the position of the geometric elements in the coarsest mesh. This is displayed in Fig. 3. Certain faces of the coarser computational grid are cut out and subsequently all subfaces inside these coarser faces are extracted. This method leads to consistent meshes and parent child connections.</P>
<P>
<P>
In the postprocessing workflow it is recommended to use NCCUTOUT directly after the numerical engines, e.g. UNTRIM2007 and UnTRIM2, so that the complete postprocessing benefits from the reduction.</P>
Regarding the postprocessing workflow it is recommended to use NCCUTOUT directly after the numerical engines, e.g. UNTRIM2007 and UnTRIM2, so that the complete postprocessing benefits from the reduction.</P>
<P>
<P>
An introduction how to collect DMQS metadata can be found [[Metadata_of_Model_results_in_Coastal_Engineering|here]].</P>
An introduction how to collect DMQS metadata can be found [[Metadata_of_Model_results_in_Coastal_Engineering|here]].</P>
Line 55: Line 55:
* Template Files:
* Template Files:
** general template files available in '''$PROGHOME/examples/nccutout'''
** general template files available in '''$PROGHOME/examples/nccutout'''
** in test directory for [[UNTRIM2007]] results: '''$PROGHOME/examples/nccutout/run/utr2007/elbe/nccut'''
** in test directory for hydro-dynamic [[UNTRIM2007]] results: '''$PROGHOME/examples/nccutout/run/utr2007/elbe/nccut'''
** in test directory for [[UNTRIM2]] results: '''$PROGHOME/examples/nccutout/run/utr2009/easy/nccut'''
** in test directory for hydro-dynamic [[UNTRIM2]] results: '''$PROGHOME/examples/nccutout/run/utr2009/easy/nccut'''
** in test directory for [[NCANALYSE]] results: '''$PROGHOME/examples/nccutout/run/ncana/easy/nccut'''
** in test directory for [[NCANALYSE]] results: '''$PROGHOME/examples/nccutout/run/ncana/easy/nccut'''
}}
}}

Revision as of 10:08, 21 November 2018

Basic Information

Name of Program

NCCUTOUT

Version-Date

November 2018

Description-Date

November 2018

Catchwords

data analysis
postprocessor
cut out data
synoptic data sets
tidal characteristic numbers
tide-independent characteristic numbers
differences of data sets
CF NetCDF format for 2D/3D data
support of computational results based on sub-grid bathymetry
support of DMQS metadata and variables

Acknowledgment: This project took advantage of netCDF software developed by UCAR/Unidata (www.unidata.ucar.edu/software/netcdf/).

Short Description of Functionality

Fig. 1: Results of the German Bight cut out from the modell area of the project EasyGSH-DB (BAW, 2018)

The postprocessor NCCUTOUT may help users to reduce the size of result files in order to save disk space and computation time in the subsequent processing steps. It cuts out data of UGRID compliant NetCDF files of the area type. In UGRID metadata language the files have to have at least one mesh topology variable with the attribute topology_dimension = 2. The cutting is typically defined by a polygon. The elements inside of the polygon get extracted to the result file.

Fig. 2: Results at seperate faces (see north western and south eastern part) cut out of a model of the Jade Weser Estuary (BAW, 2018)

But the cut out area can also be defined by two or more polygons which need not be direct neighbours, s. Fig. 2. Though the results may look like seperate spots of a location grid they share a common mesh topology.

Furthermore, the user can reduce disk space by extracting only a subset of the original geophysical variables. He can add them to a white list or alternatively to a black list.

Input-Files

  1. general input data (file type nccutout.dat);
  2. input UGRID CF NetCDFs (file type cf-netcdf.nc);
  3. cutout polygons (file type ipds.dat);
  4. for automatic quality assurance (file type bounds_verify.dat).

Output-Files

  1. output UGRID CF NetCDFs (file type cf-netcdf.nc);
  2. (optional) informative printer file of program execution (file type nccutout.sdr)
  3. (optional) trace of program execution (file type nccutout.trc)

Methodology

Fig. 3: Extracting faces with all their subfaces in order to generate consistent meshes.(BAW,2018)

NCCUTOUT can process NetCDF files supporting the UGRID idea of parent and child meshes, e.g. a computational grid with a coarse and a sub grid with higher resolution. Whether data gets cut out or not depends from the position of the geometric elements in the coarsest mesh. This is displayed in Fig. 3. Certain faces of the coarser computational grid are cut out and subsequently all subfaces inside these coarser faces are extracted. This method leads to consistent meshes and parent child connections.

Regarding the postprocessing workflow it is recommended to use NCCUTOUT directly after the numerical engines, e.g. UNTRIM2007 and UnTRIM2, so that the complete postprocessing benefits from the reduction.

An introduction how to collect DMQS metadata can be found here.

Performance: Most of the program's CPU time is used by basic IO routines. Since output is considerably slower than input a reduction of the output data, area and geophysical variables, makes NCCUTOUT run faster.

Program(s) to run before this Program

NCANALYSE, NCCHUNKIE, NCDELTA, UNTRIM2007, UNTRIM2

Program(s) to run after this Program

DAVIT, NCAGGREGATE, NCANALYSE, NCAUTO, NCCHUNKIE, NCDELTA, NCPLOT, NC2TABLE and MATLAB

Additional Information

Language

Fortran95

Additional software

---

Original Version

P. Schade, G. Lang

Maintenance

P. Schade

Documentation/Literature

  • Template Files:
    • general template files available in $PROGHOME/examples/nccutout
    • in test directory for hydro-dynamic UNTRIM2007 results: $PROGHOME/examples/nccutout/run/utr2007/elbe/nccut
    • in test directory for hydro-dynamic UNTRIM2 results: $PROGHOME/examples/nccutout/run/utr2009/easy/nccut
    • in test directory for NCANALYSE results: $PROGHOME/examples/nccutout/run/ncana/easy/nccut

back to Program Descriptions

Overview

Retrieved from "http://wiki.baw.de/en/index.php?title=NCCUTOUT&oldid=7380"