Table of contents | Director's message | Highlights | Divisional accomplishments | Community service | Education and Outreach | Publications | Staff, visitors, collaborators | NCAR ASR 2002

Visualization and enabling technologies

The Visualization and Enabling Technologies Section (VETS), now in its third year of existence, is a dynamic and growing program within SCD. It is focused on knowledge development, the primarily post-computational phase where data moves to information, discovery, and communication. Our program includes research, development, deployment, and state-of-the-art facilities and spans the realms of large-scale data analysis and visualization, web environments and infrastructure, collaborative environments and collaboratories, Grid technology, and education and outreach.

VETS has grown by over 50% in the last year, now has a staff of 18, and will continue to grow in FY2003. This was a year of progress on many fronts. We moved our new Visualization Lab and AccessGrid into a fully operational mode, and its popularity, usage, and impact greatly exceeded our initial high expectations. NCL capabilities were dramatically expanded particularly relative to the new release of the Community Climate System Model (CCSM). We made substantial progress in advancing the DOE-sponsored Earth System Grid project, engaged in collaborative work with the Unidata-led THREDDS project, and moved our NSF-funded VGEE project into its final phase. This year we played the lead role in the development of another iteration of the Knowledge Environment for the Geosciences (KEG) proposal to NSF's ITR program and contributed to quite a number of other proposals as well.

We also began work on NCAR Strategic Initiatives in the area of web-based data provision and next-generation web environments, and through the efforts of the Web Engineering Group (WEG) further expanded our core hardware and software information technology for all of UCAR. VETS staff engaged in a broad portfolio of collaborative interactions with people and projects at NCAR and other organizations. We also continued our tradition of maintaining a high level of visibility at both conferences and via a huge number of internal events. In the pages that follow, we briefly summarize our progress in providing facilities for analysis, visualization, and collaboration.

NCAR's new Visualization Lab

SCD officially opened the doors to its new Visualization Lab in October 2001. The new facility, a state-of-the-art scientific workspace, combines powerful visualization computing platforms, an AccessGrid collaboration environment, high-bandwidth networking, flexible system switching, and a large format, high-resolution stereo 3D display system to provide an unprecedented environment for remote collaboration and large-scale data exploration.

Tim Killeen conference with students in the Visualization Lab

Since its opening at the start of FY2002, the heavily subscribed lab has proven to be a focal point for NCAR science, hosting a plethora of scientific workshops, symposia, and collaborative research activities. We have supported and participated in several dozen AccessGrid events including testimony sessions for the NSF Blue Ribbon Panel on Cyberinfrastructure, weekly DOE/NSF Earth System Grid meetings, CCSM software engineering group meetings, Global Science and Technology Week events, multi-agency Grid Coordination meetings, SC Global, a Solar-Terrestrial Physics workshop, the NCAR Advisory Board, meetings with NSF, and the UCAR Board of Trustees event -- just to cite a few. This new resource has enabled us to ramp up our community interactions in a remarkable way, while at the same time reducing travel burdens in cost and time. There are intangible benefits as well: NCAR is an active and visible player "on the Grid" and we're positioned to proliferate the technology throughout our organization and into the community. To this end, we have worked with NCAR and UCAR management to secure additional funding for another AccessGrid node and support staff so that these popular capabilities can be used at our other campuses.

Our initial design of the new lab ended up being remarkably effective, particularly considering the incredible complexity of the overall system. Nonetheless, we decided to make some significant incremental upgrades this year, primarily in the system switching capacity and topology, audio systems, control capabilities and user interface, and stereo projection mechanisms. Bids were solicited and a contract was awarded to effect these improvements, and the contracted work was nearing completion at the end of FY2002. We also expanded our Storage Area Network (SAN) by 2.8 Terabytes, bringing the total capacity of shared, high-performance storage available for visualization and data analysis up to 3.5 TeraBytes. In collaboration with NCAR's Geophysical Turbulence Program (GTP), VETS deployed an additional 1.3 TB of SAN storage, dedicated for GTP analysis and post-processing functions.

VETS deployed its first commodity-component-based visualization cluster this year. The storm cluster, a two-node, four-processor system with a Myrinet 2000 interconnect provides an environment to experiment with commodity hardware components (e.g. graphics cards, CPUs, and main boards), as well as an environment for scalable, parallel rendering. The distributed rendering middleware for the cluster will be the Chromium software system. We acquired, assembled and integrated the system into our existing computing infrastructure this year and plan to conduct experiments with it in FY2003.

Last, VETS made some significant inroads toward deploying a collaborative remote rendering environment in the upcoming year. Following an extensive evaluation period, SCD acquired an SGI Onyx 3800 to be dedicated to a remote visualization pilot project. The software for the pilot project will be SGI's VizServer, which supports distributed rendering as well as collaborative operation. The new system will leverage our investment in Storage Area Networking technology nicely, allowing very large datasets to be centralized while collaborators, who may be geographically dispersed, are permitted interactive visualization over a LAN or possibly a WAN. SGI refers to this as Visual Area Networking (VAN), and it is an important strategic step toward expanding the "virtual walls" of our facility.

Community software for data analysis and visualization

NCAR Graphics continues to be used by thousands of researchers in the geosciences community, as indicated by the high number of downloads on the software's website. The package provides software libraries that support a wide variety of graphing and visualization functions, with extensive and robust mapping capabilities. Use of the NCAR Command Language (NCL), a scripting language that provides data analysis in addition to scientific visualization, continues to grow in the same community, based on the increased number of software downloads and the wide variety of users accessing NCL's various websites. NCL's graphics are based on NCAR Graphics, and thus provide the same superb, publication-quality graphics that are as good or better than anything available from any toolset, including commercial applications.

In FY2002, the mapping capabilities of NCAR Graphics and NCL were extended to include access to a very-high-resolution coastline database called the "Regionally Accessible Nested Global Shorelines" (RANGS), developed by Rainer Feistel from Wessel and Smith's "Global Self-consistent Hierarchical High-resolution Shoreline" (GSHHS) dataset. The data came from the public-domain datasets "World Databank II" (WDBII) and "World Vector Shoreline" (WVS), but Wessel and Smith cleaned up the data greatly, and Feistel added structure to the data.

The ability to automatically generate nice latitude and longitude labels for many of the rectangular map projections was another frequently requested and popular feature added to the mapping capabilities of our software.

As climate models continue to generate more complex and higher-resolution grids, the developers of NCL and NCAR Graphics have started to add support for some of these unique 2D grids. One such grid is the Parallel Ocean Program (POP) grid which was developed at Los Alamos National Laboratory and incorporated in the Community Climate System Model. Other grids that will be added in the future include the ORCA grid and spherical geodesic grids. In conjunction with support for unique 2D grids, work was completed to provide a new contour rasterization algorithm, allowing users to contour their data using a cell-center method, instead of just a cell-boundary method.

Over 30 new data processing functions and procedures were added to NCL. Some of these functions provide the capability to:

  • Calculate various parameters of the binomial, chi-square, gamma, and normal distributions
  • Estimate and remove the least-squares quadratic trend at all grid points
  • Interpolate a vertical column from sigma coordinates to hybrid coordinates
  • Calculate the dew point temperature given temperature and relative humidity
  • Calculate the pressure of the lifting condensation level
  • Calculate the mixing ratio or specific humidity given pressure, temperature, and relative humidity
  • Interpolate from a grid produced by the Regional Climate Model to user-specified locations
  • Plot station model data

In addition to new functions, many existing functions were enhanced to allow for more generality in the size and type of data coming in, and to allow for missing values. Many plotting functions were enhanced to incorporate the new 2D grid contour and vector capabilities, to generate special Lambert Conformal plots, and to provide users with more plotting options in general. The histogram-plotting utility was greatly enhanced to allow for more binning options and to produce nicer-looking plots.

NCL was ported to new operating systems as they became available. Two of the more popular systems include Microsoft Windows (running Cygwin) and MacOSX. The Cygwin port has provided especially useful as it allows users to run NCL from their Windows laptop systems. We also began the process of exploring strategies for layering a Python interface on top of the core NCL functionality.

The graphics below show some of the new capabilities added in FY2002, including the high-resolution coastlines, longitude/latitude labels, special Lambert Conformal grids, 2D POP grids, and enhancements to bar charts.

NCAR Graphics sample output NCAR Graphics sample output
NCAR Graphics sample output NCAR Graphics sample output

SCD has continued to distribute NCAR Graphics as Open Source under the GNU Public License, and the NCAR Command Language (NCL) as "Open Binary" under a special license. Open Source is still planned for NCL in the near future. From the period October 1, 2001 to September 30, 2002, there were 1,533 accesses to the NCL download website, with an estimated 800 of these being unique downloads For the same period, there were 7,795 accesses to the NCAR Graphics download site, with an estimated 1,800 of these being unique. NCL is now running on all major operating systems, with MS Windows (running Cygwin) and MacOSX being the latest operating systems added.

We continue to work with NCAR's Climate and Global Dynamics division to add new functionality to NCL for the Community Climate System Model and for the scientific community. Since February 2001, CGD (with consulting help from SCD) has offered 12 hands-on workshops on NCL, with a total of 122 people in attendance.

We worked indirectly with the Naval Research Lab to get their model and observational data plotted. This involved adding new functionality in NCL to do curly vectors, high-resolution coastlines, and automatic generation of special map tickmarks on many different map projections. We have started to help NCAR's High Altitude Observatory division in laying the groundwork for using NCL as a post-processor for the Thermospheric General Circulation Model (TGCM). Other major new features in NCL include recognition for curvilinear grids and enhanced support for HDF-EOS (version 4) files and GRIB files.

In determining the impact on users, it is helpful to look at the number of unique visits (not just number of hits) that the CSM Graphics Tutorial website (which is all based on NCL scripts) has received in the period February 2001 to September 2002. There were at least 13 foreign countries that visited the site 100 times or more. There were at least 19 North American universities that visited the site more than 100 times, with numbers going up into the 1,400s for some individual universities. The general trend shows an increasing number of visits every month with an average of 3,000 visits a month from May 2002 to September 2002. Locally, there have been about 2,000 visits to the site from February 2001 to September 2002.

NCAR version of Vis5D

NCAR enhancements to Vis5D, a free OpenGL-based volumetric visualization program for scientific datasets in 3+ dimensions, were formally merged into an Open Source community effort called Vis5D+ in FY2002. The Vis5D+ release version 1.2.0 includes the following technology enhancements and modifications developed by NCAR:

  • Support for stereo display mode (requires hardware support and proper configuration)
  • Support for scene output to VRML format
  • Improved screen capture
  • Improved isosurface rendering using decimated, compressed meshes

Free download of this software and documentation are available through SourceForge, an Open Source software development site.

Gvolsh

Gvolsh is an interactive direct volume renderer that permits navigation through time and space of high-resolution, regular-gridded, scalar datasets. Gvolsh provides hooks to facilitate interaction with other data analysis tools such as the popular IDL. When combined with a data manipulation language like IDL, a powerful discovery and analysis environment is provided. In FY2002, a number of new rendering engines were added to take advantage of the advances in ubiquitous hardware texture mapping. Furthermore, the tool was adapted to exploit our new wavelet-based multiresolution data-organization strategy, thus permitting interactive browsing of gigavoxel datasets on even a lowly PC.

Enterprise web services

The UCAR Information Technology Council is in the process of defining the mission of the Web Engineering Group (WEG), which is housed inside SCD/VETS. The current Draft Mission Statement is: "The Mission of the Web Engineering Group (WEG) is to provide first-class World Wide Web services and infrastructure for the benefit of all of UCAR/NCAR/UOP. The set of services and infrastructure to be provided will be identified by the Web Advisory Group (WAG) through its UCAR-wide cooperative efforts and expressed in the WAG Strategic Plan." Progress in addressing this charter accelerated nicely throughout the year with new staff additions and heightened interaction between WEG and WAG.

Web facilities

The UCAR Web Engineering Group (WEG) operates a three-tiered complex of computational platforms as a shared facility for supporting and presenting UCAR's web presence. The architecture emphasizes extensibility along with high performance and high reliability. In FY2002, increases in demand on the central web cluster outstripped the performance envelope of the clustered Linux system that provided the first-tier services. For this reason, we replaced the Linux systems with Sun Netras, which are thin rack-mounted servers that function seamlessly with the larger back-end Sun servers and offer excellent cost/performance. A cluster of six such systems now forms the backbone of web services. The following diagram depicts our current configuration with planned future additions highlighted with red text.

Web server configuration diagram

The front tier is a high-availability cluster of Sun Netra servers running distributed, load-balanced web server software. This provides an easily scalable cluster that appears to be one server to the outside world. The web.ucar.edu system provides a place for content creators and managers to work, and provides remote access to the content. This provides direct and remote access to the content deployed on the front-tier cluster. Behind these clusters are the distributed file services and application services. Each is again a Sun cluster to provide for high availability.

Yearly load summary on UCAR web servers

This web usage summary shows a cyclical load on the UCAR web servers. The lowest levels of activity coincide with the summer months when students are out of school.

Our plans for FY2003 and beyond include the addition of servers and expanded storage to account for the growing demands and aging hardware. We anticipate growth in FY2003 in storage requirements for projects in the NCAR Strategic Plan and Strategic Initiatives, Web Advisory Group priorities, education and outreach efforts, and collaborative work in portal development. A discussion is under way to host more Division and Program web content on WEG servers.

Tools and services

Addressing the Web Advisory Group (WAG) strategic plan, WEG developed and maintained a prioritized list of projects and tasks and made significant progress on expanding and improving UCAR's web environment on several fronts.

The UCAR-wide web authentication security service is a cornerstone of WEG's provisions. This facility was documented in the interest of maintainability and as part of making the service useful and readily deployable for other groups within UCAR. An improved interface to web statistics was installed. The Sawmill software underwent testing by a focus group and proved to provide the richness of capabilities that people had been seeking.

WEG began providing a fundamentally new service for developers who work in Java Server Pages (JSPs) and the associated technologies. The Tomcat server runs on a cluster of two Sun enterprise servers. Developers will be able to deploy sophisticated dynamic websites using this technology. Web-based access to electronic mail was the first application installed in the Tomcat environment. This Java-based server program provides everyone who has a UCAR mail account with secure access to their mail when they cannot use the normal methods. The typical scenario in which it will be most useful is when a staff member is on business travel and does not have their own computer; by visiting a cyber-cafe, they can connect via a web browser to the UCAR webmail server and thereby read and send mail, with attachments. The figure below shows the appearance of the login screen of this application.

UCAR WebMail user interface

Streaming media services have been addressed by installing the Real Networks Helix streaming server software. Running on a cluster of two Sun enterprise servers, this service will stream content from the UCAR web to anyone on the planet. Streaming movie creators now have a way to serve the content they create. The software streams Real, Quicktime, and Windows Media formats, which provides a high level of interoperability for most of the browsers used by our community.

WEG continues to research a number of promising technologies for future applications. An important area of investigation is Content Management Systems (CMSs). This would provide a consistent back-end interface to the content managed under the web cluster. Content creators would have access to information through remote authoring protocols. Web administrators would have control over access to the content, which would be delegated to managers and content creators. Managers would have access to workflow procedures, so that creating content undergoes a well-defined process from beginning to end.

WEG is also investigating a bibliographical database solution, so that researchers could share and access a central repository of bibliographical references while they are writing for publication. WEG will also add a group calendaring solution to its menu of modular options to deploy for website creators. Collaborators working within a group will be able to share the calendar to aid in their work.

Outreach, advocacy, and community building

We have also been engaged in the important task of identifying synergies and building community to improve UCAR's efficiency of operation and collaborative work among developers and content providers across the organization. One way in which we have improved collaboration between people within UCAR working in web development fields (web engineering, design, and authoring) was to create a number of mailing lists. These lists have proven to be a valuable way for people to communicate, as each list has gained 30-50 members through a self-subscription approach. We have also developed a new WEG website that provides documentation, access to information about what WEG is working on, and a way to discuss services, recommend future services, and request help with existing services. WEG staff have established dialog with various divisions and programs that could enhance operational effectiveness and efficiency by using the shared resources that are available. Discussions of Division and Program needs for web access to electronic mail is just one example of this dialog.

Building the NCAR Collaboratory

The Earth System Grid II

During FY2002 we began work on the newly awarded DOE-sponsored Earth System Grid II project with our DOE, university, and NCAR collaborators. The project is focused on building a DataGrid for climate research that facilitates management and access to climate model data across high-performance broadband networks. It builds on one of the more exciting recent developments in computational science, Grid Technologies and the Data Grid. The Data Grid is a next-generation framework for distributed data access in the high-performance computing arena, and it addresses security, transport, cataloging, replica management, and access to secondary storage. We successfully demonstrated the results of this work at the SC2001 conference and established NCAR as a node on the Data Grid. Over the course of the year, we developed a remarkable level of linkage and collaboration with a number of programs that span the globe. These include the Unidata-led THREDDS project, NOAA's NOMADS project, and the U.K. e-Science program. This activity speaks directly to our NSF review recommendations and our own contribution to the rapidly expanding Global Grid effort.

The Visual Geophysical Exploration Environment (VGEE)

Work continued on the NSF-funded Visual Geophysical Exploration Environment project, and functionality for plan views, vertical cross sections, 2D data slices, and color control for all objects were added to expand the visualization tool's capabilities. Also, in a major redesign, the VGEE software base was migrated to Unidata's Integrated Data Viewer (IDV) framework in collaboration with the Unidata Metapps developers. This enhancement opened the door for access to the rich set of IDV library functions for visualizing and analyzing geoscience data.

VGEE user interface

As a feasibility test, the new IDV-VGEE version along with new datasets were released and integrated into the curriculum at West Chester University in Pennsylvania by Professor Rajul Pandya in an undergraduate geoscience course. Results of this experiment and preliminary conclusions were promising. In an end-of-course analysis, VGEE users said that the class contributed to their ability to perform logical analysis, and these students also showed more improvement in test scores than a control group that did not use the VGEE utility.

Strategic Initiatives: The Community Data Portal (CDP) and World Class Web

We have made substantial progress over the past year with our Strategic Initiatives aimed at advancing in areas of Information Technology and focused efforts in the area of managing and sharing data and the development of next-generation web environments. The Community Data Portal (CDP), in particular, has attracted a large amount of additional interest, and at this point, we are certain that we have a special project underway with exceptional opportunities. Progress in the next-generation web area has been advancing as well, and we have found that these two activities complement each other nicely.

The NCAR Community Data Portal

VETS' FY2002 accomplishments on this project include:

  • Established the Community Data Portal system and site, dataportal.ucar.edu, with SCD cosponsoring this thrust with over $100K of computational and data-storage resources (new Sunfire server, dataportal.ucar.edu) along with system administration services.
  • Engaged in pilot project work with ACACIA/ARCAS (CGD) on climate assessment, SCD/DSS on reanalysis data, HAO on TIME-GCM data, VEMAP, and CGD on "eViewers."
  • Worked with the CCSM project to release CCSM V2 dataset to the research community.
  • Collaborated with the Biogeosciences Initiative to develop the CDAS data site.
  • Worked with COLA to establish the DODS/GRADS remote data analysis system.
  • Collaborated with GTP to develop an ITR proposal for providing next-generation data services for turbulence research.
  • Cultivated collaborative partnership with the NOAA NOMADS program and the Earth System Grid (ESG).
  • Coupled dataportal.ucar.edu to the large storage systems on the IBM SP system Data Analysis and Visualization Engine (DAVE) for climate data publication.
  • Effectively served as an implementation project for elements of the UCAR Data Management Working Group (DMWG) strategic plan.
  • Jointly developed dataportal sections of "Windows to Climate" proposal with ESIG and E&O.
  • Played the lead role in the joint development of metadata, catalog, and knowledge representation strategies with the Data Management Working Group. This work is hoped to span data, media, and general information.

The following image is a protoype web-based portal that provides access to a number of datasets coming from different providers.

NCAR Community Data Portal prototype

A world-class web presence for NCAR

The SCD Initiatives website was launched in September 2002 and showcases the progress of SCD across the four information technology initiatives in the NCAR Strategic Plan. In addition, the VETS internal and public websites, which are undergoing final testing, have been completely redesigned using best practices approaches such as audience analysis, site strategy, wireframe interfaces, design comps, and template-based page development. All three websites sport a new visual look that raises the design standard for NCAR websites.

Benefits of information technology website VETS' internal and public websites home page

WEG's beta implementation of a new streaming video server is a significant enhancement to our infrastructure, enabling users to start viewing multi-megabyte scientific animations within seconds instead of waiting for an entire movie to download. With these processes and infrastructure in place, we can now move our attention to the larger NCAR web presence. The following summarizes VETS' FY2002 accomplishments in these areas:

Web presence for IT-related strategic initiatives

  • Developed a new web presence that documents the array of activities described here along with links to related projects.
Develop a digital media gallery for earth system science

  • Collaborated with WEG to configure and evaluate streaming media services and began the process of integrating media-cataloging capabilities with web interfaces to the content.
  • Developed plans with NCAR Education and Outreach to analyze and assess opportunities to leverage our suite of scientific animation for the Windows to the Universe (W2U) project.
Toward a thematic and Semantic web

  • Leveraged the work with catalogs in the CDP thrust to extend to the digital media activity with a long-term goal of providing media-specific (e.g. data, animation, imagery) search capability and ultimately semantic search capabilities.
  • Began development of a new thematic website for collaborative science/visualization projects.

It is impossible to capture the breadth of work accomplished, so we have prepared a website that exposes progress across our thrust areas. It serves dual roles: to demonstrate coupled progress on our activities and to serve as an information source on our directions both internally and to the broader external community.

Chromium

In collaboration with Stanford University and the DOE, we continued investigating Chromium, the Open Source, distributed, parallel rendering middleware. Chromium has been deployed on our newly acquired cluster, and in FY2002 we began learning how to use the software and succeeded in porting a couple of applications, including the widely used Vis5D package.

A Knowledge Environment for the Geosciences (KEG)

KEG is a vision for an integrated knowledge environment that seamlessly connects a federation of tools, portals, and collaboratories created and used by motivated individuals, projects, and organizations around the world. Our research agenda spans knowledge representation and engineering, large-scale component frameworks, collaboration environments, analysis and visualization capabilities, data strategies, data mining, and the new concept of Knowledge Grids -- bodies of cooperating IT groups that provide distributed, discipline-centric services.

While KEG has not yet been funded, pieces of its vision are being accomplished through other integrations of the Community Data Portal and the Earth System Grid.

Next-generation analysis and visualization software

Our current generation of analysis and visualization tools is approaching end-of-life relative to many of today's problems and most of tomorrow's. Rather than continue to incrementally bandage existing software codes, a modern framework is required to facilitate the development of new applications that can cope with data volume (1-10 TB and more) and complexity, collaborative capabilities (e.g. AG), and efficient integration of the most promising new developments from computer science. During FY2002, we began the process of defining a new project that would address this important area. A proposal was prepared and submitted as an NCAR Strategic Initiative entitled "Frameworks and Applications for Terascale Data Analysis and Visualization," and VETS staff began meeting to discuss our future work in this area. This proposed new effort will build upon our own long-term work in data analysis and visualization software (i.e. NCL, Vis5D, volume rendering, etc.), a variety of emerging community efforts by DOE, NSF, and university researchers, and our own collaborative research efforts. While the effort is not funded yet, we intend to pursue it aggressively in FY2003. In the meantime, we have been conducting exploratory research work in a variety of areas.

A whitepaper was authored on developing multi-resolution capabilities for large-scale volume visualization with an emphasis on turbulence-simulation data. In the software realm, VETS staff experimented with Python, an object-oriented scripting language that has excellent capabilities for integrating legacy and extant software. Python's popularity is growing rapidly in the scientific community, and it's a strong candidate as an integrating layer for next-generation capabilities. We also began to explore the functionality and performance offered by Java, Java3D, and VisAD in the context of the Visual Geophysical Exploration Environment (discussed under Research in the VETS report).

Time-varying volume rendering

One of the challenges most ignored in scientific visualization research is the efficient handling of time-varying datasets. These pose numerous bandwidth challenges throughout the visualization pipeline. Numerical simulations in the earth sciences datasets are dominated by such time-varying data. VETS, in partnership with researchers at U.C. Davis, devised a new method for accelerating the rendering of time-varying data volumes using commodity graphics cards. The algorithm employs the advanced texture mapping capabilities provided by many of today's consumer graphics cards to decode a temporally compressed data stream in hardware. The results that were achieved on a low-end PC were previously attainable only on high-end visual supercomputers. An invited paper describing a parallel implementation of the algorithm running on a Lintel cluster was published in IEEE Transactions on Visualization and Computer Graphics.

Novel data organization strategies

Similar to the problems associated with large temporal datasets are the difficulties arising from data having high spatial resolutions. In FY2002 we began researching novel, multi-resolution data organization strategies based on wavelet transformations that permit rapid extraction of data subregions at adaptive resolutions. These wavelet-based methods are highly efficient, designed to take advantages of cache-based microprocessors and access methods of rotating storage. Our preliminary results are highly encouraging, and we hope to publish our methods in the coming year.

Collaborative efforts

VETS collaborates with many modeling efforts, research projects, and working groups in the area of advancing data management, analysis, and visualization capabilities. We also work with other organizations to jointly develop new technology, and our move to an Open Source model will accelerate such activities in the future. Staff members work directly with researchers to identify and deploy analysis and visualization solutions on a project-by-project basis, a process that not only advances the research programs but also provides valuable insights into current and future requirements. The list below summarizes collaborative efforts engaged in by one or more VETS staff members.

MM5 simulation of Hurricane Danny

Scheitlin collaborated with Wen-Chau Lee (ATD) to provide a mesoscale verification of a hurricane near landfall off the U.S. Gulf Coast.

MM5 simulation of Hurricane Danny

Universal fire shape

Scheitlin and Coen (MMM) produced a series of wildfire animations using tracer (smoke) data and vertical vorticity simulations to study fire evolution and universal fire shape.

Wildfire simulation

Perfect storm simulation

Scheitlin worked with Sheri Mickelson (ANL) to produce a perfect storm simulation for AMS2002.

Simulation of a perfect storm

Rotor development

Stobbs collaborated with Joachim Kuettner (JOSS) and Rolf Hertenstein to produce an NCAR Graphics animation that compares two types of rotor development in the lee of mountains, causing moderate to severe flight hazards.

Rotor development on lee side of mountains

Fair-weather cumulus simulation

Scheitlin produced a visualization demonstrating the cycle of fair-weather cumulus evolution over dry land in collaboration with Chin-Hoh Moeng (MMM).

Evolution of fair-weather cumulus clouds

Decaying turbulence

Collaborative work was continued with SCD's Rodney James and MMM's Yoshi Kimura and Jack Herring to visualize high-resolution numerical simulations of decaying turbulence.

Decaying turbulence simulation

MHD simulations

Collaborative work continued with NOAA's Dusan Odstrcil to visualize numerous new MHD simulations exploring the role of solar Coronal Mass Ejections and the ambient solar wind.

Solar CME simulation

SEAM

Collaborative work with CGD's Aime Fournier revisited the simulation of the polar vortex using the newest version of the Spectral Element Atmosphere Model (SEAM), an animation of which will be shown at the keynote address for SC2002.

Polar vortex visualized with SEAM

Ocean temperature and ice visualization

Fred Clare worked with Warren Washington, Gary Strand, and Tom Bettge (CGD) to produce an ocean temperature and sea ice depth animation. The data were generated from the Parallel Ocean Program (POP) ocean model produced at Los Alamos and from a sea ice model developed jointly by Los Alamos National Laboratory, University of Washington, and NCAR scientists. Both of these models are integral parts of the NCAR CCSM (Community Climate System Model).

Ocean temperature and sea ice visualization

Carbon uptake

Modern climate models take into account the growth and decay of vegetation. Using the T85 version of the NCAR Community Climate Model, Fred Clare and Warren Washington (CGD) collaborated to produce two carbon uptake animations showing the rate at which plants absorb carbon dioxide during their growth phase.

Carbon uptake animation

Water vapor visualization

In collaboration with Warren Washington (CGD), Fred Clare produced a visualization depicting the evolution of total vertical water vapor (precipitable water) for a one-year period. The data were produced from the T85 version of the NCAR Community Climate Model using a one-hour time step.

Precipitable water for a one-year period

Warming run from the T42 PCM model

Fred Clare collaborated with Warren Washington (CGD) to produce a visualization depicting temperature anamolies out to year 2150. This animation shows warming of surface temperature in the 21st century as predicted from ensemble integrations of a coupled ocean-atmosphere CGM forced with a full range of projected concentrations of greenhouse gases and sulfate aerosols. The results were produced from the PCM model at resolution 64 latitudes by 128 longitudes, and they indicate that by year 2100 there is an approximate 2.3-degree-C difference of the average global temperature from the 1950-1990 mean.

Projected warming by year 2100

VETS education and outreach activities

VETS continued its outreach program with appearances at SC2001, CAS2002, AMS2002, SIGGRAPH2002, and VETS supported the normal heavy schedule of Visualization Lab presentations (59 total) to visiting researchers, students, educators, and other visiting groups. The schedule also included a large addition of interactive videoconferencing sessions (21 total + regularly scheduled weekly and monthly meetings) using the Access Grid technology.

One Access Grid event in particular involved outreach to both local and remote school kids in a presentation and discussion on wildfires as part of NCAR's participation in the Global Science and Technology Week webcast and Access Grid event. VETS coordinated NCAR's participation with several other remote sites including presentations from President Bush's Science Advisor and the Director of the National Science Foundation.

In an effort to provide the general public and school children exposure to high-end visualization and state-of-the-art scientific data exploration techniques, VETS also began implementation of a joint project with the NCAR Education and Outreach Public Visitor Program to provide visualization theater access for regular demonstrations to school children and public visitors.

Other Education and Outreach presentations in the vislab included:

  • 10/23   NSF F&A visitors
  • 12/05   University of Wyoming student visitors
  • 02/06   Weber Elementary students
  • 02/20   Louisville Middle School students
  • 03/09   Ph.D. students from the University of Colorado
  • 03/15   PAOS department at the University of Colorado
  • 03/18   Iowa State University AMS Chapter
  • 04/08   Science Fair winners
  • 04/29   Global Science and Technology Week session
  • 06/06   SOARS students
  • 06/28   San Ildefonso Tribal Chair
  • 07/22   High school teachers affiliated with R. Johnson conference

Community service activities

John Clyne served as the visualization program chair for the Cray User's Group.

Fred Clare volunteers on the NCAR Library Book Selection Committee.

Susan Cross served as a community mentor for the SOARS program.

Don Middleton served on a National Research Council Committee to develop a long-term research agenda for the NEES (Network for Earthquake Engineering Simulation) project. He contributed to the interagency Middleware and Grid Infrastructure Committee (MAGIC) effort to promote long-term strategies for developing a national Grid infrastructure across the various federal agencies. Middleton also served as a proposal reviewer for the U.S. Department of Energy and NOAA.

Tim Scheitlin assisted SOARS students in producing 3D visualizations of their summer projects.

VETS staff -- Don Middleton, Jeff Boote, John Clyne, Darin Oman, Joey Mendoza, and Tim Scheitlin -- provide an ongoing community service at conferences and for NCAR visitors by explaining, supporting, and demonstrating state-of-the-art scientific visualization techniques and technology in the forms of technical presentations and education and outreach presentations. They also provided interactive virtual conferencing services to the scientific community via the Vislab's function as the NCAR AccessGrid node.

Listing of VETS technical presentations and Access Grid events

Vislab technical presentations

  • 10/09   UCAR Members Open House
  • 10/11   Urban Planning Workshop
  • 10/19   ACE Workshop
  • 10/29   CU and British Petroleum visitors
  • 11/11   Jim Bottom and staff
  • 11/13   Walt Polansky, acting MICS Division Director
  • 11/14   UCAR Management NSF Review Panel
  • 11/15   SCGlobal
  • 11/15   Tadashi Watanabe, NEC
  • 11/16   John Taylor from Argonne
  • 11/16   Director of NIST, Susan Sullivan
  • 11/19   Reinhard Budich, IT Administrator and Director of Prism
  • 12/06   UCAR Auditors
  • 12/13   UCAR Contracts
  • 01/15   GLOBE LAS demo
  • 01/31   Paul Allen Foundation
  • 02/01   Dave Schimel meeting
  • 02/08   SCD Advisory Panel
  • 02/08   StorageTek demo
  • 02/21   Syskonnect's regional manager
  • 02/21   NCAR Advisory Panel
  • 02/22   Demo to Korean visitors
  • 03/01   EPA
  • 03/20   ESIG
  • 04/04   CGD Geophysical Statistics Project
  • 04/04   House Science Staffer demo
  • 04/12   German TV interview with Mickey Glantz
  • 04/19   Singapore visitors
  • 04/22   John Lumsden, Director of the METSERVICE in New Zealand
  • 04/24   A. Eblen, Joint Bureau of Meteorology/CSIRO HPCCC
  • 05/03   BP-Amoco
  • 05/09   Chinese Consulate
  • 05/09   Friends of UCAR
  • 05/15   Environmental journalists
  • 05/17   Facilities demo
  • 05/31   Washington demo to Executive Director of the National Science Board
  • 06/11   THIC conference
  • 06/17   Condit
  • 06/20   CEDAR workshop
  • 06/27   NRC Committee on Partnerships in Weather and Climate Services
  • 07/09   Technical Review with David Roberts, BP Amoco
  • 07/09   NOAA Admiral Lautenbacher
  • 07/17   HAO VIP visitor
  • 08/22   Cosmic Program
  • 09/06   UCAR Auditors
  • 09/19   Belgian Secretary General
  • 09/25   Denver Museum visit

Access Grid events

  • Weekly Earth Systems Grid meeting
  • Monthly SciDAC meeting
  • Multiple MAGIC Project meetings
  • 10/08   UCAR Board of Trustees
  • 11/30   NSF Blue ribbon panel on cyber infrastructure Access Grid (Fulker)
  • 11/30   National Collaboratories investigators
  • 12/05   LANL Oceanic ECO Systems
  • 01/17   AG Training Session - Performance Tuning for Microprocessor-Based Systems
  • 01/22   NSF Blue Ribbon Panel Testimony
  • 01/24   Brown bag lunch with University of Chicago
  • 02/11   CGD Meeting with DOE sites
  • 02/14   CGD CCSM meeting (2 days)
  • 03/07   Web100 meeting
  • 03/26   Net100 meeting
  • 04/24   Bruce Loftis AG presentation from NCAR/AG to Montana
  • 04/29   Global Science and Technology Week session
  • 05/01   NETS AG meeting
  • 05/17   Communicating Effectively over the Access Grid seminar
  • 06/04   NERSC tutorial
  • 09/11   Advisory Council meeting/Peter Freeman (NSF)
  • 09/13   Community Authentication Service
  • 09/19   NCSA/Mead workshop
  • 09/20   NETS AG workshop
  • 09/30   Teragrid workshop

Publications

Bramer, D.*, T. Scheitlin, R. Deardorff, D. Elliott, K.E. Hay, M. Marlino, D. Middleton, R.E. Pandya, M. Ramamurthy, M. Weingroff, and R. Wilhelmson, 2002: Using an Interactive Java-based Environment to Facilitate Visualization Comprehension. 18th International Conference on IIPS, American Meteorological Society.

Clyne, J., 2002: A Multiresolution Approach to Large Data Visualization. Proc. of CUG 2002 Workshop.

Lum, E.B.*, K.-L. Ma*, and J. Clyne, 2002: A Hardware-assisted Scalable Solution for Interactive Volume Rendering of Time-Varying Data. IEEE Trans. on Visualization and Comp. Graphics, 8, 286-301.

Lum, E.B.*, K.-L. Ma*, and J. Clyne, 2001: Texture Hardware-assisted Rendering of Time-Varying Volume Data. Proc. IEEE Visualization 2001, 263-270.

Pandya, R.E., D. Bramer*, D. Elliott, K.E. Hay, M. Marlino, D. Middleton, M. Ramamurthy, T. Scheitlin, M. Weingroff, and R. Wilhelmson, 2002: An Inquiry-based Learning Strategy from the Visual Geophysical Exploration Environment (VGEE). 11th Symposium on Education, American Meteorological Society.

Pandya, R.E., D. Bramer*, D. Elliott, K.E. Hay, L. Mallaiahgari, M. Marlino, D. Middleton, M. Ramamurthy, T. Scheitlin, M. Weingroff, R. Wilhelmson, J. Yoder*, 2002: Computer-Based Tools for Inquiry in Undergraduate Classrooms: Results from the VGEE. Innovative Strategies for Enhancing Space Science and Geoscience Education at All Levels II, American Geophysical Union, Washington, D.C.

Pouquet, A., D. Rosenberg, and J. Clyne, 2002: Computational Challenges for Global Dynamics of Fully Developed Turbulence in the Context of Geophysical Flows. Proc. Stat. Theories and Comp. Approaches to Turbulence, 3-14.

Table of contents | Director's message | Highlights | Divisional accomplishments | Community service | Education and Outreach | Publications | Staff, visitors, collaborators | NCAR ASR 2002

NCAR UCAR NSF ASR 2001 ACD ASR ASP ASR ATD ASR CGD ASR ESIG ASR HAO ASR MMM ASR RAP ASR SCD ASR