Loading…
Cephalocon 2022 has ended
July 11 - 13, 2022 | Portland, Oregon + Virtual
View More Details & Registration

Please note: This schedule is automatically displayed in Pacific Daylight Time (PDT). To view the schedule at your preferred time, please choose your location on the right-hand navigation panel under ’Timezone.’
The schedule is subject to change.
Back To Schedule
Tuesday, July 12 • 11:45am - 12:25pm
DisTRaC: Accelerating High-Performance Compute Processing for Temporary Data Storage - Gabryel Mason-Williams, Rosalind Franklin Institute

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
There is a growing desire within scientific and research communities to start using object stores to store and process their data in high performance (HPC) clusters. However, object stores are not necessarily designed for performance and are better suited for long term storage. Therefore, users often use a High-Performance File system when processing data. However, network filesystems have issues where one user could potentially thrash the network and affect the performance of everyone else's data processing jobs in the cluster. This talk presents a solution to this problem DisTRaC - (Dis)tributed (T)raisent (Ra)m (C)eph. DisTRaC offers a solution to this problem by providing a method for users to deploy Ceph onto their HPC clusters using RAM. Their intermediate data processing can now be done in RAM, taking the pressure off the networked filesystem by using the node interconnect to transfer data. In addition, all the data is localized, creating a hyper-converged HPC cluster for the duration of the job. DisTRaC reduces the I/O overhead of the networked filesystem and offers a potential data processing performance increase.

Speakers
avatar for Gabryel Mason-Williams

Gabryel Mason-Williams

Junior Research Software Engineer, Rosalind Franklin Institute
Gabryel Mason-Williams is a junior research software engineer focusing on HPC, cloud and storage. They studied computer science at the University of Plymouth, where they did a year in industry at Diamond Light Source researching high-performance object stores for tomography data... Read More →


Tuesday July 12, 2022 11:45am - 12:25pm PDT
Regency Ballroom B