Skip to main content
  • UQ Home
  • Contacts
  • Study
  • Maps
  • News
  • Events
  • Library
  • my.UQ
The University of Queensland

Research Computing CentreResearch Computing Centre

Site search
Homepage Site menu
  • Home
  • Core Technologies
    • High Performance Computing
    • Cloud computing
    • Workflow
      • Nimrod
      • Kepler
      • Galaxy
        • Genomics Virtual Lab
    • Data Management
    • Visualisation
  • Infrastructure
    • High Performance Computing
      • Awoonga
      • FlashLite
      • Tinaroo
      • Wiener
      • RCC Active Changes (UQ only)
      • RCC Active Incidents (UQ only)
      • RCC User Guides (UQ only)
      • External resources
    • Cloud computing
    • Data storage
  • Themes
  • Media & Events
    • News
    • Newsletters
    • Events
      • Upcoming seminars
    • RCC seminars
    • RCC presentations
    • Media mentions
  • About
    • RCC's Mission
    • Research impact
    • The RCC team
    • Governance
    • RCC Fellows
    • Student internships in the RCC
    • QURPA
      • QURPA trip report 2020—Edward Davis
      • QURPA trip report 2020—Aviral Kailash Jain
      • QURPA Trip Report 2019
      • QURPA Trip Report 2016
      • QURPA Trip Reports 2015
      • QURPA 2020: Using machine learning to detect falls
    • Acknowledging RCC
  • Contact
  • Support
    • Training
    • Meetups
    • Support Desk
    • Service Status
  • FAQS

RCC assists global geoscience project requiring massive computation

Monday, August 31, 2020 - 14:45
A 3D inversion of the Mount St Helens volcano in the USA. (Image from Dr Lutz Gross.)
A 3D inversion of the Mount St Helens volcano in the USA. (Image from Dr Lutz Gross.)

A global research team, including researchers from the University of Queensland, is developing methods to 3D image the subsurface of the Earth from observational data.

Associate Professor Lutz Gross, from UQ's School of Earth and Environmental Sciences, is leading the software infrastructure development for the project, called Esys-escript, with his team largely creating appropriate computational techniques and algorithms.

Esys-escript is a programming tool for novices and experts to implement mathematical models in Python using the finite element method (FEM) in a wide range of geophysical modelling problems. It has applications in earth mantle convection, plate subduction, environmental surveying, exploration of mineral and carbonous materials, transport modelling and the monitoring of groundwater, erosion, tsunamis and earthquakes.

Esys-escript has been developed over several projects with various partners, including the University of Western Australia, University of Melbourne, and France’s Université Savoie Mont-Blanc.

The project’s goal is to include all available geophysical data sets — such as field, electro-magnetic and seismic data — for a region or province in a single inversion model. (Inversion is the mathematical process of calculating cause from a set of observations.)

This is a massive computational task and requires the use of large parallel computers. The 3D inversions are mostly running on high-performance computers, and Lutz and his team are developing their software to run on these platforms with RCC assistance.

RCC computer systems engineer Mark Endrei helped Lutz and his team with HPC application development on escript. Mark is currently helping the team broaden the supported platforms and simplify user access to the developed software.

“We see a lot of potential to get users interested in our software,” said Lutz.

“To improve the acceptance of the software it is crucial that beginners can work and get trained on a platform they are familiar with.

“We didn’t have expertise [within the research group] in developing the software for all the platforms we needed, so Mark has been tremendously helpful in building new platform support for our software, which is important for expanding our user community.”

As a joint RCC and SEES appointment, former RCC staffer Cihan Altinay worked extensively on the Esys-escript project, largely providing expertise on GPU and OpenMP. 

In terms of compute power, Lutz and his team are using a “little cluster” within SEES for small jobs. For very large inversions, they are using Perth-based Pawsey Supercomputing Centre’s Magnus HPC, and have used Raijin, Canberra-based NCI Australia’s former supercomputer. (In November 2019, NCI replaced Raijin with a much faster supercomputer called Gadi.)

Using national supercomputers meant the team was able to invert a gravity field anomaly data set (mainly satellite imagery) for the entire Australian continent.

“A single inversion on Magnus took four to five hours, using about 1,000 cores. On a PC this would take around 1.5 months. And we had a few (about 50) runs to do to tune some parameters, which would take a couple of years to complete on a PC, I guess,” said Lutz.

“Based on this code the colleagues at WA now do routinely high-resolution inversion of large-scale gravity and magnetic data on Magnus.”

Currently, Lutz and his team are looking into techniques to focus the calculation to regions where “interesting things” are detected, such as the interior structures of volcanoes, carbon storage in mineral deposits or leaks in dams. “This can be achieved by focusing the local resolution while the inversion (simulation) is running. This approach also helps to reduce computational costs and at the same time enhances the quality of results,” said Lutz.

The underlying software infrastructure for Esys-escript is funded through the Australian Government’s National Collaborative Research Infrastructure Strategy (NCRIS) program.

Lutz Gross
Assoc. Prof. Lutz Gross

Figures show the results of 3D inversion of an electric field intensity inversion over the Mount St Helens volcano (USA) using 14.7 million  tetrahedral elements solving for over 150 million unknows using 200 cores of a compute cluster in about 6 hours. Objective of this calculation using synthetic data was to image the conduit and magma chamber from surface observations.  (Image from Dr Lutz Gross.)

 

  • Data storage to undergo major upgrade during holiday season

    21 Dec 2020
  • National sensitive data platform to be set up for secure research collaboration

    21 Dec 2020
  • RCC farewells Martin Nicholls

    21 Dec 2020
  • RCC part of winning ‘Going Viral Award’ team

    21 Dec 2020
  • RCC staff go "Above and Beyond in 2020"

    21 Dec 2020
  • Sarah Walters joins RCC

    21 Dec 2020

View all news

© The University of Queensland
Enquiries: +61 7 3365 1111   |   Contact directory
ABN: 63 942 912 684   |   CRICOS Provider No: 00025B
Emergency
Phone: 3365 3333
Privacy & Terms of use   |   Feedback   |   Updated: 30 Oct 2020
Login