Edward Hartnett

Edward Hartnett

Boulder, Colorado, United States
4K followers 500+ connections

About

I am an AI engineer with extensive experience with agentic and RAG systems. Before LLMs…

Articles by Edward

Activity

Join now to see all activity

Experience

  • Intelligent Data Design, Inc.

    Boulder, Colorado, USA

  • -

    Boulder, Colorado, United States

  • -

    Boulder

  • -

    United States

  • -

    Boulder, Colorado

  • -

    United States

  • -

    United States

  • -

    United States

  • -

    IDA Enterprise Zone Offices, Dublin

  • -

    United States

Education

Volunteer Experience

  • American Meteorological Society Graphic

    Chapter President

    American Meteorological Society

    - 2 years 1 month

    Science and Technology

    Chaired meetings, arranged speakers, helped manage finances, represented chapter at annual AGU meetings in SF.

  • American Meteorological Society Graphic

    Chapter Vice President

    American Meteorological Society

    - 1 year 1 month

    Science and Technology

    Helped organize chapter, arrange and greet speakers, recruit new members.

Publications

  • NETCDF-4 PERFORMANCE IMPROVEMENTS OPENING COMPLEX DATA FILES

    35th Conference on Environmental Information Processing Technologies, AMS Annual Meeting

    The netCDF-4/HDF5 format offers many advantages for science data users, including built-in compression, a rich data model, and support for parallel I/O. However, several performance bottlenecks have been identified which impact complex files with many variables and attributes defined. These files are especially prevalent in the domain of High Performance Computing (HPC).
    The performance issues appear when files include many variables, attributes, or dimensions, and include slow file opens…

    The netCDF-4/HDF5 format offers many advantages for science data users, including built-in compression, a rich data model, and support for parallel I/O. However, several performance bottlenecks have been identified which impact complex files with many variables and attributes defined. These files are especially prevalent in the domain of High Performance Computing (HPC).
    The performance issues appear when files include many variables, attributes, or dimensions, and include slow file opens.
    A focus on netCDF-4 performance issues has resulted in the elimination of several bottlenecks, including time to open a file, looking up objects in the file, and reading strided arrays. Significant improvement is demonstrated.
    Performance trials are conducted on NOAA’s Thea platform. Results are presented demonstrating the improved performance with real-world example files.

    See publication
  • Presentation: NETCDF-4 PERFORMANCE IMPROVEMENTS OPENING COMPLEX DATA FILES

    35th Conference on Environmental Information Processing Technologies, AMS Annual Meeting

    A focus on netCDF-4 performance issues has resulted in the elimination of several bottlenecks, including time to open a file, looking up objects in the file, and reading strided arrays. Significant improvement is demonstrated.
    Performance trials are conducted on NOAA’s Thea platform. Results are presented demonstrating the improved performance with real-world example files.

    See publication
  • Poster: USING STANDARD TOOLS TO PACKAGE AND DISTRIBUTE SCIENTIFIC SOFTWARE C AND FORTRAN LIBRARIES: A DEMONSTRATION WITH THE GENERAL PURPOSE TIMING LIBRARY (GPTL)

    35th Conference on Environmental Information Processing Technologies, AMS Annual Meeting

    In this poster the conversion of a scientific software package, the General Purpose Timing Library (GPTL) from a home-rolled build system to a standard build is demonstrated.

    See publication
  • USING STANDARD TOOLS TO PACKAGE AND DISTRIBUTE SCIENTIFIC SOFTWARE C AND FORTRAN LIBRARIES: A DEMONSTRATION WITH THE GENERAL PURPOSE TIMING LIBRARY (GPTL)

    35th Conference on Environmental Information Processing Technologies, AMS Annual Meeting

    Important scientific C and Fortran software packages are frequently distributed through use of home-grown approaches rather than the standard GNU tools autoconf, automake, and libtool. This results in wasted effort for the distributors of the software, as they struggle to achieve portability. Home grown approaches also tend to waste the time of all software installers, which have to struggle to correctly build the software. In this poster the conversion of a scientific software package, the…

    Important scientific C and Fortran software packages are frequently distributed through use of home-grown approaches rather than the standard GNU tools autoconf, automake, and libtool. This results in wasted effort for the distributors of the software, as they struggle to achieve portability. Home grown approaches also tend to waste the time of all software installers, which have to struggle to correctly build the software. In this poster the conversion of a scientific software package, the General Purpose Timing Library (GPTL) from a home-rolled build system to a standard build is demonstrated. This results in nearly an order of magnitude decrease in build system complexity, measured by lines of code, and an increase in build system features for the user, including automatic shared library builds, standard configure options, and standard make options, as well as increased portability and ease of use. As demonstrated by major scientific software packages like netCDF and HDF5, these tools can be used very effectively to package software portably, including software that is built and run on High Performance Computing (HPC) systems.

    Other authors
    See publication
  • Learning Old School Linux

    Smashwords

    Collection of Linux columns written for ComputorEdge magazine between 2003 and 2010.

    See publication
  • Recent Development in NetCDF Libraries and Formats

    European Geophysical Union 2001 Poster: EGU2011-8288

    EGU poster outlining developments in the NetCDF libraries and formats.

    See publication
  • EXPERIENCE WITH AN ENHANCED NETCDF DATA MODEL AND INTERFACE FOR SCIENTIFIC DATA ACCESS

    88th AMS Annual Meeting, 24th Conference on IIPS

    The purpose of the Network Common Data Form (netCDF) interface is to support the creation, efficient access, and sharing of data in a form that is selfdescribing, portable, compact, extendible, and archivable. Version 3 of netCDF is widely used in atmospheric and ocean sciences due to its simplicity.

    NetCDF version 4 has been designed to address limitations of netCDF version 3 while preserving useful forms of compatibility with existing application software and data archives.

    Other authors
    See publication
  • NETCDF-4: SOFTWARE IMPLEMENTING AN ENHANCED DATA MODEL FOR THE GEOSCIENCES

    22nd International Conference on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology, AMS

    Developed by the Unidata Program of the University Corporation for Atmospheric Research (UCAR), netCDF is widely used in earth, ocean, and atmospheric sciences because of its simple data model, ease of use, portability, and strong user support infrastructure. Use of the netCDF data model, data access libraries, and machine independent format for the creation, access, and sharing of data in the geosciences continues to grow.

    After providing some background, we describe additions to the…

    Developed by the Unidata Program of the University Corporation for Atmospheric Research (UCAR), netCDF is widely used in earth, ocean, and atmospheric sciences because of its simple data model, ease of use, portability, and strong user support infrastructure. Use of the netCDF data model, data access libraries, and machine independent format for the creation, access, and sharing of data in the geosciences continues to grow.

    After providing some background, we describe additions to the netCDF data model and make recommendations for data providers and developers who may be considering the use of netCDF-4 for future archives or applications.

    Other authors
    See publication

Projects

  • MMS FEEPS Science Data Processing System

    - Present

    Two Fly's Eye Energetic Particle Sensors(FEEPS) will be flown aboard each of the four MMS spacecraft starting in March, 2015. The FEEPS will measure 3D energetic ion and electron flux distributions over the energy ranges ~25 keV to 500 keV (electrons) and ~45 keV to 500 keV (ions). Data from FEEPS are processed by a Java application at LASP.

    Other creators
    • Dave Judd, James Craft
    See project
  • MAVEN Science Data Center

    - Present

    The MAVEN Science Data Center processes instrument data from the MAVEN mission. Written in python, the MAVEN SDC unpacks data and uses instrument team software to produce higher level data products.

    Other creators
    See project
  • MMS Science Data Center

    - Present

    The MMS Science Data Center processes data from the Magnetospheric Multiscale (MMS) mission. MMS consists of 4 satellites, flying in very tight formation through the magnetic fields around our planet. Each MMS spacecraft carries 26 instruments. Some of the insrtuments, and the spacecraft themselves, were built at CU Boulder at LASP. MMS launched in early 2015 and continues to contribute amazing science data, which is processed at the MMS Science Data Center, at LASP.

    Other creators
    See project
  • TSIS SIM Processing System

    - Present

    The SIM Processing System processes the telemetry from the Spectral Irradiance Monitor from the TSIS mission (scheduled to be flown on the International Space Station in 2017). The TSIS SIM will determine the spectral irradiance at the top of the atmosphere.

    Other creators
    See project
  • TIM Processing System

    - Present

    The TIM Processing System processes the data from the Total Irradiance Monitor. Two TIM instruments are currently on-orbit. One is aboard SORCE, another aboard TCTE, Another TIM is scheduled for the TSIS mission in 2016. The TIM Processing System processes telemetry from the instruments and the spacecraft to determine the total solar irradiance - the total amount of energy reaching the top of the Earth's atmosphere from the Sun. This is a key parameter for global climate models.

    Other creators
    See project
  • netcdf-c

    The Unidata network Common Data Form (netCDF) is an interface for scientific data access and a freely-distributed software library that provides an implementation of the interface. The netCDF library also defines a machine-independent format for representing scientific data. Together, the interface, library, and format support the creation, access, and sharing of scientific data.

  • Access Bank 2 Multiplexer

    The Access Bank II combines the functions of intelligent Channel Service Units (CSUs)/Data Service Units (DSUs), digital cross-connect (DCS), and digital voice switch into one product.

    Other creators
    See project
  • Parallel IO Library

    -

    PIO is a software interface layer designed to encapsolate the complexities of parallel IO and make it easier to replace the lower level software backend. It currently supports netcdf and pnetcdf.

    To enhance PIO's power and capability, I have added features such as:
    * Asynchronous write to disk via netCDF API.
    * Multi-level parallelism, with some nodes devoted exclusively to IO.
    * Easy conversion of netCDF-based scientific models to PIO.
    * Integration into netCDF.
    * Better…

    PIO is a software interface layer designed to encapsolate the complexities of parallel IO and make it easier to replace the lower level software backend. It currently supports netcdf and pnetcdf.

    To enhance PIO's power and capability, I have added features such as:
    * Asynchronous write to disk via netCDF API.
    * Multi-level parallelism, with some nodes devoted exclusively to IO.
    * Easy conversion of netCDF-based scientific models to PIO.
    * Integration into netCDF.
    * Better performance.
    * Better netCDF-4 support.

    See project
  • NetCDF-4

    -

    Extension to NetCDF, the popular free software package for storing array-oriented scientific data. The netCDF-4 project added compatibility with HDF5 to the netCDF C/Fortran libraries, adding features such as compression, groups, user defined types, and parallel I/O.

    Other creators
    See project
  • Experiment on Rapidly Intensifying Cyclones over the Atlantic (ERICA)

    -

    The Experiment on Rapidly Intensifying Cyclones over the Atlantic (ERICA) field study is designed to determine physical mechanisms and processes, and their critical spatial and temporal combinations, which can account for the wintertime phenomenon of explosively developing over-ocean atmospheric storms. Theoretical and numerical modeling research, during the five-year Office of Naval Research (ONR) Heavy Weather at Sea Accelerated Research Initiative ERICA program, comprises continuing effort…

    The Experiment on Rapidly Intensifying Cyclones over the Atlantic (ERICA) field study is designed to determine physical mechanisms and processes, and their critical spatial and temporal combinations, which can account for the wintertime phenomenon of explosively developing over-ocean atmospheric storms. Theoretical and numerical modeling research, during the five-year Office of Naval Research (ONR) Heavy Weather at Sea Accelerated Research Initiative ERICA program, comprises continuing effort, including the field study scheduled for 1 December 1988–28 February 1989.

    Other creators
    See project
  • NCEPLIBS

    A collection of libraries commonly known as NCEPLIBS that are required for several NCEP applications e.g. UFS, GSI, UPP, etc.

  • NCEPLIBS-g2c

    -

    This library contains C decoder/encoder routines for GRIB edition 2.

  • netcdf-c

    -

    NetCDF (Network Common Data Form) is a set of software libraries and self-describing, machine-independent data formats that support the creation, access, and sharing of array-oriented scientific data. It's widely used in fields like meteorology, oceanography, and climatology, particularly for climate models and weather data.

Honors & Awards

  • MMS Instrument Suite Team

    NASA

    For the successful design, development, testing and commissioning operations of the MMS SMART Instrument Suite.

  • MMS Instrument Suite Team Group Achievement Award

    NASA

    For outstanding achievements in the engineering/operations development of the instrument suites contributing to the successful launch and commissioning of MMS.

  • SORCE Return to Science Group Achievement Award

    NASA

    For operating SORCE during a 6-month extended emergency period, for a highly successful solar observing campaign, and for recovery of SORCE back to daily science observations.

  • RHG Exceptional Achievement LASP TCTE Team

    NASA

    For the exceptionally dedicated effort of the LASP team in developing and delivering the TCTE instrument for the STPSat3 Mission in five months from "go-ahead."

  • ASGOE/MAESA Experiment Team Group Achievement Award

    NASA

    For recognition of outstanding accomplishments and contributions to the highly successful ASHOE/MAESA campaign conducted from February to November, 1994.

  • The DAO/SDUO Group Achievement Award

    NASA

    For outstanding achievements in the development of software systems.

Languages

  • English

    -

Recommendations received

11 people have recommended Edward

Join now to view

More activity by Edward

View Edward’s full profile

  • See who you know in common
  • Get introduced
  • Contact Edward directly
Join to view full profile

Other similar profiles

Explore top content on LinkedIn

Find curated posts and insights for relevant topics all in one place.

View top content

Add new skills with these courses