Lustre (file system)

LustreLustre file systemCluster File SystemsLustre filesystemLustre parallel file systemCluster File Systems, Inc.Lustre clustered file systemLustre filesystemsLustre Film System
Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing.wikipedia
117 Related Articles

Peter Braam

Peter J. Braam
The Lustre file system architecture was started as a research project in 1999 by Peter J. Braam, who was a staff of Carnegie Mellon University (CMU) at the time.
Transitioning into the computing industry, Braam created the Lustre parallel file system, which has become a key product for large-scale HPC.

Sequoia (supercomputer)

IBM SequoiaSequoiaIBM's Sequoia
3 ranked TOP500 supercomputers in 2014, Titan and Sequoia. These include: K computer at the RIKEN Advanced Institute for Computational Science, the Tianhe-1A at the National Supercomputing Center in Tianjin, China, the Jaguar and Titan at Oak Ridge National Laboratory (ORNL), Blue Waters at the University of Illinois, and Sequoia and Blue Gene/L at Lawrence Livermore National Laboratory (LLNL).
The entire supercomputer runs on Linux, with CNK running on over 98,000 nodes, and Red Hat Enterprise Linux running on 768 I/O nodes that are connected to the Lustre filesystem.

OpenSFS

Open Scalable File Systems, Inc. (OpenSFS)
Open Scalable File Systems, Inc. (OpenSFS), EUROPEAN Open File Systems (EOFS) and others.
Open Scalable File Systems, Inc. (OpenSFS) is a nonprofit organization promoting the Lustre file system.

Clustered file system

distributed file systemnetwork file systemshared disk file system
Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing.
There are many peer-to-peer network protocols for open-source distributed file systems for cloud or closed-source clustered file systems, e. g.: 9P, AFS, Coda, CIFS/SMB, DCE/DFS, Lustre, PanFS, Google File System, Mnet, Chord Project.

Ext4

4extext4 filesystem
Lustre 1.4.0, released in November 2004, provided protocol compatibility between versions, could use InfiniBand networks, and could exploit extents/mballoc in the ldiskfs on-disk filesystem.
ext4 was initially a series of backward-compatible extensions to ext3, many of them originally developed by Cluster File Systems for the Lustre file system between 2003 and 2006, meant to extend storage limits and add other performance improvements.

Titan (supercomputer)

TitanTitan supercomputerDenovo
3 ranked TOP500 supercomputers in 2014, Titan and Sequoia. These include: K computer at the RIKEN Advanced Institute for Computational Science, the Tianhe-1A at the National Supercomputing Center in Tianjin, China, the Jaguar and Titan at Oak Ridge National Laboratory (ORNL), Blue Waters at the University of Illinois, and Sequoia and Blue Gene/L at Lawrence Livermore National Laboratory (LLNL).
Initially, Titan used Jaguar's 10 PB of Lustre storage with a transfer speed of 240 GB/s, but in April 2013, the storage was upgraded to 40 PB with a transfer rate of 1.4 TB/s.

Sun Microsystems

SunSun Microsystems, Inc.Sun workstation
In September 2007, Sun Microsystems acquired the assets of Cluster File Systems Inc. including its intellectual property.

InterMezzo (file system)

InterMezzoInterMezzo file system
Braam went on to found his own company Cluster File Systems in 2001, starting from work on the InterMezzo file system in the Coda project at CMU.
Its developers moved on to a new project named Lustre at a company called Cluster File Systems, around 2001.

Advanced Simulation and Computing Program

Accelerated Strategic Computing InitiativeASCI QAdvanced Simulation and Computing Initiative
Lustre was developed under the Accelerated Strategic Computing Initiative Path Forward project funded by the United States Department of Energy, which included Hewlett-Packard and Intel.
The ASCI Path Forward project substantially funded the initial development of the Lustre parallel file system from 2001 to 2004.

Extended file attributes

extended attributesextended attributeextended file attribute
An MDT is a dedicated filesystem that stores inodes, directories, POSIX and extended file attributes, controls file access permissions/ACLs, and tells clients the layout of the object(s) that make up each regular file.
In Linux, the ext2, ext3, ext4, JFS, Squashfs, Yaffs2, ReiserFS, Reiser4, XFS, Btrfs, OrangeFS, Lustre, OCFS2 1.6, ZFS, and F2FS filesystems support extended attributes (abbreviated xattr) when enabled in the kernel configuration.

Red Storm (computing)

Red StormASCI Red StormASCI Thor's Hammer
Another approach used in the early years of Lustre is the liblustre library on the Cray XT3 using the Catamount operating system on systems such as Sandia Red Storm, which provided userspace applications with direct filesystem access.
A userspace implementation of the Lustre file system, named liblustre, was ported to the Catamount environment using the libsysio library to provide POSIX-like semantics.

Jaguar (supercomputer)

JaguarJaguar supercomputerCray Jaguar
These include: K computer at the RIKEN Advanced Institute for Computational Science, the Tianhe-1A at the National Supercomputing Center in Tianjin, China, the Jaguar and Titan at Oak Ridge National Laboratory (ORNL), Blue Waters at the University of Illinois, and Sequoia and Blue Gene/L at Lawrence Livermore National Laboratory (LLNL).
Jaguar uses an external Lustre file system called Spider for all file storage.

List of file systems

List of file systems, the distributed parallel fault-tolerant file system sectionDistributed parallel fault-tolerant file systemsList of file systems, the distributed parallel file system section

Portmanteau

portmanteau wordportmanteausportmanteaux
The name Lustre is a portmanteau word derived from Linux and cluster.

Linux

GNU/LinuxLinux on the desktopLin
The name Lustre is a portmanteau word derived from Linux and cluster.

Computer cluster

clusterclusteringclusters
Lustre is a type of parallel distributed file system, generally used for large-scale cluster computing. The name Lustre is a portmanteau word derived from Linux and cluster.

GNU General Public License

GPLGNU GPLGPLv2
Lustre file system software is available under the GNU General Public License (version 2 only) and provides high performance file systems for computer clusters ranging in size from small workgroup clusters to large-scale, multi-site clusters.

TOP500

Top 500fastest supercomputersTOP-500
3 ranked TOP500 supercomputers in 2014, Titan and Sequoia.

Client (computing)

clientclientsclient software
Lustre file systems are scalable and can be part of multiple computer clusters with tens of thousands of client nodes, tens of petabytes (PB) of storage on hundreds of servers, and more than a terabyte per second (TB/s) of aggregate I/O throughput.

Throughput

maximum throughputasymptotic bandwidthBandwidth
Lustre file systems are scalable and can be part of multiple computer clusters with tens of thousands of client nodes, tens of petabytes (PB) of storage on hundreds of servers, and more than a terabyte per second (TB/s) of aggregate I/O throughput.

Meteorology

meteorologicalmeteorologistmeteorologists
This makes Lustre file systems a popular choice for businesses with large data centers, including those in industries such as meteorology, simulation, oil and gas, life science, rich media, and finance.

Simulation

simulatorsimulatesimulations
This makes Lustre file systems a popular choice for businesses with large data centers, including those in industries such as meteorology, simulation, oil and gas, life science, rich media, and finance.

List of life sciences

life scienceslife sciencebioscience
This makes Lustre file systems a popular choice for businesses with large data centers, including those in industries such as meteorology, simulation, oil and gas, life science, rich media, and finance.

Interactive media

Interactive entertainmentrich mediarich-media
This makes Lustre file systems a popular choice for businesses with large data centers, including those in industries such as meteorology, simulation, oil and gas, life science, rich media, and finance.

Carnegie Mellon University

Carnegie Institute of TechnologyCarnegie MellonCarnegie-Mellon University
The Lustre file system architecture was started as a research project in 1999 by Peter J. Braam, who was a staff of Carnegie Mellon University (CMU) at the time.