eScholarship Repository eScholarship Repository California Digital Library
eScholarship > LBNL > Paper LBNL-1101E

LBNL Papers

LBNL Website

Policies

Search LBNL

Submit a Paper

Notify me of new papers

institute_logo

Lawrence Berkeley National Laboratory
University of California

LBNL Papers  •  LBNL Website  •  Policies  •  Search LBNL  •  Submit a Paper

Large File System Backup: NERSC Global File System Experience
Akbar Mokhtarani

Download the Paper (681 K, PDF file) - November 25, 2008 Tell a colleague about it.
Printing Tips: Select 'print as image' in the Acrobat print dialog if you have trouble printing.

ABSTRACT:

NERSC's Global File system (NGF), accessible from all compute systems at NERSC, holds files and data from many scientific projects. A full backup of this file system to our High Performance Storage System (HPSS) is performed periodically. Disk storage usage by projects at NERSC has grown seven fold over a two year period, from ~;;20TB in June 2006 to ~;;140 TB in June 2008. The latest full backup took about 13 days and more than 200 T10k tape cartridges (.5 TB capacity). Petabyte file systems are becoming a reality in the next few years and the existing utilities are already strained in handling backup tasks.

SUGGESTED CITATION:
Akbar Mokhtarani, " Large File System Backup: NERSC Global File System Experience " (November 25, 2008). Lawrence Berkeley National Laboratory. Paper LBNL-1101E.
http://repositories.cdlib.org/lbnl/LBNL-1101E

 
bar
Open Archives Initiative eScholarship is a service of the California Digital Library bepress