High Performance Filesystems for HPC clusters
Most HPC clusters
require a shared data area
to store users' jobs and results files. Smaller clusters rely on
network-attached storage (NAS) servers which use the NFS or SAMBA
protocols to deliver storage to compute nodes. Parallel or distributed filesystems for HPC
clusters are most often used on medium and large clusters with a
high-performance data storage requirement.
Lustre Parallel Filesystem
Capable of almost linear
performance scalability as the amount of available storage is
increased, Lustre is widely acknowledged as the fastest open-source
parallel filesystem currently available. In order to maximize
filesystem
performances, Lustre utilities
dedicated servers to store metadata and data objects; each storage
client accesses these servers directly via a high-performance network.
Each machine must be configured with a particular Linux distribution
with customized kernels to ensure maximum stability and throughput.
Alces Software has experience in delivering large parallel filesystem systems based on Lustre, including commercial, research and academic customers. Available with both Ethernet and Infiniband interconnects, our solutions can deliver hundreds of terrabytes of storage accessible from multiple client nodes at aggregate performance of several gigabytes per second.
Gluster Distributed Filesystem
Designed to provide simultaneous access for mutliple clients to a
single shared filesystem, Gluster uses FUSE to allow cluster nodes to
store and retrieve files from a central location. Compatible with a
wide range of storage hardware solutions, Gluster can be configured to
provide high performance distributed or replicated file storage for HPC
clusters utilising the FUSE extensions already present in the majority
of Linux kernels. With careful configuration, Gluster filesystems can
provide good scaling for small to medium sized compute clusters.
Developed to provide resiliant storage for web services platformts, Gluster is capable of holding practically any type of file with a range of plug-in modules to further extend functionatliy. Our expert consultants can advise customers on optimal configurations, along with indications of the expected performance characteristics of particular configurations.
High performance storage systems
Alces Software specializes in the specification, installation and
configuration of parallel filesystem solutions including advice on
suitable
hardware platforms to host the storage services. Once installed in your
environment, Alces can demonstrate a range of performance verification
and benchmark utilities to ensure maximum return on your investment.
Our rapid deployment tools can neatly demonstrate the trade-off between
availability and performance, allowing customers to evaluate their
options as quickly as possible.
Contact us for more information on engaging Alces Software integration services on your site.
Alces Software has experience in delivering large parallel filesystem systems based on Lustre, including commercial, research and academic customers. Available with both Ethernet and Infiniband interconnects, our solutions can deliver hundreds of terrabytes of storage accessible from multiple client nodes at aggregate performance of several gigabytes per second.
Gluster Distributed Filesystem
Designed to provide simultaneous access for mutliple clients to a
single shared filesystem, Gluster uses FUSE to allow cluster nodes to
store and retrieve files from a central location. Compatible with a
wide range of storage hardware solutions, Gluster can be configured to
provide high performance distributed or replicated file storage for HPC
clusters utilising the FUSE extensions already present in the majority
of Linux kernels. With careful configuration, Gluster filesystems can
provide good scaling for small to medium sized compute clusters. Developed to provide resiliant storage for web services platformts, Gluster is capable of holding practically any type of file with a range of plug-in modules to further extend functionatliy. Our expert consultants can advise customers on optimal configurations, along with indications of the expected performance characteristics of particular configurations.
High performance storage systems
Alces Software specializes in the specification, installation and
configuration of parallel filesystem solutions including advice on
suitable
hardware platforms to host the storage services. Once installed in your
environment, Alces can demonstrate a range of performance verification
and benchmark utilities to ensure maximum return on your investment.
Our rapid deployment tools can neatly demonstrate the trade-off between
availability and performance, allowing customers to evaluate their
options as quickly as possible.Contact us for more information on engaging Alces Software integration services on your site.