Skip to main content
  • UQ Home
  • Contacts
  • Study
  • Maps
  • News
  • Events
  • Library
  • my.UQ
The University of Queensland

Research Computing CentreResearch Computing Centre

Site search
Homepage Site menu
  • Home
  • Core Technologies
    • High Performance Computing
    • Cloud computing
    • Workflow
      • Nimrod
      • Kepler
      • Galaxy
        • Genomics Virtual Lab
    • Data Management
    • Visualisation
  • Infrastructure
    • High Performance Computing
      • Bunya
      • Tinaroo
      • Wiener
      • RCC User Guides
      • External resources
    • Cloud computing
    • Data storage
    • Characterisation Virtual Laboratory
  • Themes
  • Media & Events
    • News
    • Newsletters
    • Events
      • Upcoming seminars
    • RCC seminars
    • RCC presentations
    • Media mentions
  • About
    • RCC's Mission
    • Research impact
    • The RCC team
    • Governance
    • RCC Fellows
    • Student internships in the RCC
    • QURPA
      • QURPA trip report 2020—Edward Davis
      • QURPA trip report 2020—Aviral Kailash Jain
      • QURPA Trip Report 2019
      • QURPA Trip Report 2016
      • QURPA Trip Reports 2015
      • QURPA 2020: Using machine learning to detect falls
    • Acknowledging RCC
  • Contact
  • Support
    • Training
    • Meetups
    • Support Desk
    • Service Status
  • FAQS

Data storage

At UQ, RCC takes responsibility for the technical aspects of research data storage.

HPC users can ask RCC for help with data archiving. RCC operates a near-line data archive for UQ research data, and also uses QRIScloud as a repository for UQ research data.

RCC can help estimate file storage sizes to assist with data management planning and costing.

For help with data storage, please contact rcc-support@uq.edu.au.

Please note UQ Library is responsible for:

  • Data management plans
  • Metadata design and management
  • Research data publication standards.
     
MeDiCI

RCC has developed MeDiCI (Metropolitan Data Caching Infrastructure), a high performance data storage fabric for UQ.

MeDiCI delivers ultra-fast multi-site data access on demand without user involvement, saving researchers valuable time to focus on their work.

MeDiCI provides seamless access to data, regardless of where they are created, manipulated and archived. It connects campus and QRIScloud data storage with the off-site data centre UQ and QRIScloud uses. It speeds up data access between UQ’s main St Lucia campus and the Polaris Data Centre in Springfield, about 30kms south of St Lucia.

MeDiCI, a distributed file system, holds copies of data on campus until they are not required for some time. It allows data currently being accessed by researchers to be cached on campus, and moves data not accessed for a while back to Polaris.

MeDiCI provides a number of ways for UQ users to access their data. It can be mounted directly on workstations and clusters on campus, using a number of standard protocols (including NFS, Samba, SMB and IBM’s GPFS native clients). It also offers a synch-and-share mode in which portable devices such as laptops can synchronise files into the same file space. Finally, data can be exposed through an object interface such as S3.

A major additional benefit of MeDiCI is that bandwidth bottlenecks between the campus and Polaris are less likely to cause a slowdown in researchers’ work.

Underpinning MeDiCI are SGI DMF, Oracle StorageTek, DDN GRIDScaler storage and IBM Spectrum Scale technologies.

UQ’s Queensland Brain Institute (QBI) has trialled MeDiCI successfully. The data fabric will be rolled out for widespread UQ use in early 2017.

RCC and QBI are currently trialling MeDiCI with the University of California San Diego to test the data fabric’s capabilities for international data collaboration.

Read more about MeDiCI:

  • Qld Uni debuts its own data storage fabric', ITnews, 30 March 2016
  • DDN delivers high performance data storage fabric at the University of Queensland, DDN press release, 7 September 2016

MeDiCI

  • High Performance Computing
    • Bunya
    • Tinaroo
    • Wiener
    • RCC User Guides
    • External resources
  • Cloud computing
  • Data storage
  • Characterisation Virtual Laboratory
© The University of Queensland
Enquiries: +61 7 3365 1111   |   Contact directory
ABN: 63 942 912 684   |   CRICOS Provider No: 00025B
Emergency
Phone: 3365 3333
Privacy & Terms of use   |   Feedback   |   Updated: 30 Nov 2016
Login