Project Roadmap
This page outlines the major projects and products created by Kyle O'Neil from August 2013 through October 2016 for the Conte Ecology Research Group. The Project List section identifies the projects outlined. Each project name links to the descriptions in the Project Details section.
Project List
Basin Characteristics
Climate Projections Database
Culvert Delineation
Daymet Data
Fish Site Snapping
HUC/Catchment Assignment
Impoundments Impact Layer
NHD High Resolution Delineation - Version 2
Network Analysis (Trout GRF)
PostGIS Tools
Tidal Influence Layer
Visualization Maps
Project Details
Basin Characteristics
Basin characteristics, or catchment attributes, refer to the average value of a raster calculated within the area of some zone, defined by polygons or a raster. All of the attributes on the SHEDS website or used in any of the models are generated in the Basin Characteristics repository. This includes the riparian buffer statistics.
Links:- GitHub Repository
- Project Page
- Local Directory: C:\KPONEIL\SHEDS\basinCharacteristics
- Backup Directory: \IGSAGBEBWS-MJO7\projects\dataIn\environmental\basinCharacteristics
Climate Projections Database
Raw downscaled climate projection NetCDFs are reformatted and lodaded into the nasa
Postgres database on Osensei. Climate records are linked to catchment IDs from the NHDHRDV2 dataset based on spatial overlap. The method may serve as guidance for similar NetCDF processing and spatial assignment, though the specific nature of NetCDF makes the usage of these scripts with other datasets unlikely.
- GitHub Repository
- Local Directory: C:\KPONEIL\climate\nasaProjections
- Backup Directory: \\IGSAGBEBWS-MJO7\projects\dataIn\environmental\climate\nasa
Culvert Delineation
Culvert and stream gage locations in the Deerfield watershed are delineated creating polygons of the contributing drainage area to each site. Select basin attributes are calculated for each of the sites. The GIS processing utilizes the existing NHDHRDV2 layers and may serve as a template for future work on point delineation. This work was completed as a part of a hydrologic assessment completed by Gordon Clark (geclark330@gmail.com) through UMass Amherst and the MassDOT.
Links:- GitHub Repository
- Project Page
- Local Directory: C:\KPONEIL\culvertDelineation_MassDOT
- Backup Directory: \\IGSAGBEBWS-MJO7\projects\dataIn\environmental\connectivity\culvertDelineation_MassDOT
Daymet Data
The raw Daymet gridded observed climate data are assigned to the NHDHRDV2 catchments and uploaded to the sheds
Postgres database. This process is completed using the custom zonalDaymet
R package along with a series of shell scripts. The zonalDaymet
package was created with functions to download and process the raw climate NetCDFs, assign climate records to catchment featureids, and save to a SQLite database. The SQLite databases are then uploaded to Osensei.
- Daymet Workflow Repository
- Project Page
- R Package Repository
- Data Directory: \IGSAGBEBWS-MJO7\projects\dataIn\environmental\climate\daymet
- R Package Directory: C:\KPONEIL\GitHub\packages\zonalDaymet
Fish Site Snapping
Fish sample locations are snapped to flowlines from the NHDHRDV2 layers. This effort is in support of the Network Analysis project, but may be used as a template for snapping any points to flowlines.
Links:- GitHub Repository
- Local Directory: C:\KPONEIL\fishData
- Backup Directory: \\IGSAGBEBWS-MJO7\projects\dataIn\ecological\fishData
HUC/Catchment Assignment
The NHDHRDV2 dataset is derived from source data that differs from the Watershed Boundary Dataset (WBD), which is traditionally used to define HUC boundaries. This work attempts to map the catchments to the HUC12s from the WBD more accurately than with a basic spatial overlay.
Links:Impoundments Impact Layer
The impoundments impact layer represents the distance downstream of an impoundment that is thermally impacted by the impoundment with regards to observed stream temperature collection. Based on the NHDHRDV2 flowlines, the resulting layer is a polyline that gets uploaded to the sheds
database. The spatial range matches that of the TNC Dams layer (ME to VA) and is used in QAQC of observed stream temperature sites for modeling purposes. A shell script is run to identify temperature sites impacted by impoundments.
- GitHub Repository
- Project Page
- Local Directory: C:\KPONEIL\SHEDS\impoundments
- Backup Directory: \IGSAGBEBWS-MJO7\projects\dataIn\environmental\connectivity\impoundments
NHD High Resolution Delineation - Version 2
The NHDHRDV2 dataset is a high resolution, spatially consistent delineation of the hydrologic network in the Northeast U.S. The catchments and flowlines are used on the SHEDS website and in models created by the Conte Ecology Group. An in depth product description with links to layer and documentation downloads is available in the SHEDS GIS Data Project Page.
Links:- GitHub Repository
- Project Page
- Local Directory: C:\KPONEIL\HRD\V2
Network Analysis (Trout GRF)
This project creates the spatial data in support of a Dan Hocking's work on Gaussian random fields in a dendritic network. A project specific table is created relating sample locations and stream segments to each other in a network format.
Links:- GitHub Repository
- Local Directory: C:\KPONEIL\streamNetwork
- Backup Directory: \\IGSAGBEBWS-MJO7\projects\dataIn\environmental\streamStructure\HRD\V2
PostGIS Tools
Two PostGIS tools exist currently. One tool queries the Daymet climate data in the sheds database based on a user-provided list of lat/lon coordinates. The other tool uses a raster-based method for calculating the basin characteristics of the catchments layer for a provided value raster. The rasters may also be provided by the user.
Links:- GitHub Repository
- Local Directory: C:\KPONEIL\postgisTools
Tidal Influence Layer
The tidal influence polygon layer represents the waterbodies that are considered to be impacted in some capacity by changing tides. The spatial range matches that of the NHDHRDV2 and is used in QAQC of observed stream temperature sites for modeling purposes. A shell script is run to identify tidally influenced temperature sites.
Links:- GitHub Repository
- Project Page
- Local Directory: C:\KPONEIL\SHEDS\tidalFilter
- Backup Directory: \IGSAGBEBWS-MJO7\projects\dataIn\environmental\streamStructure\tidalFilter
Visualization Maps
Spatial data that support the fish movement visualization maps are generated. Raw data from the westbrook
database on Osensei, first-hand knowledge of the sites, and existing hydrography data are combined to create the stream maps. A combination of site-specific and general processing scripts are used to produce both section center and stream boundary locations.
- GitHub Repository
- Local Directory: C:\KPONEIL\visualizationMaps
Contact Info
Kyle O'Neil
koneil@usgs.gov