Loading…
Cephalocon 2022 has ended
July 11 - 13, 2022 | Portland, Oregon + Virtual
View More Details & Registration

Please note: This schedule is automatically displayed in Pacific Daylight Time (PDT). To view the schedule at your preferred time, please choose your location on the right-hand navigation panel under ’Timezone.’
The schedule is subject to change.
Back To Schedule
Tuesday, July 12 • 12:30pm - 1:10pm
Over A Billion Requests Served Per Day: Ensuring Everyone is Happy with Our Ceph Clusters’ Performance - Jane Zhu & Matthew Leonard, Bloomberg LP

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Bloomberg's Ceph clusters are the backbone of our internal S3 cloud storage systems, which handle billions of requests per day. This traffic comes in many shapes and sizes based on unpredictable instantaneous client workloads. Our workload is an ever-changing combination of reads, writes, small and large objects, bursty and consistent loads. Regardless, we must ensure the overall performance of our Ceph clusters, as well as guarantee the performance of Bloomberg's applications, which deliver the accurate and market-moving information that our clients use to help make financial decisions. We built a distributed software-defined Quality of Service (QoS) product that is running on Layer 7 of the OSI model, which sits in front of our Ceph clusters. This allows us to do aggregated QoS and traffic shaping using multiple dimensions. These flows are controlled through policies generated based on instantaneous usage patterns and clients’ system needs. These policies can be applied on various combinations of IP addresses, Ceph users, S3 buckets, number of simultaneous connections, as well as request type. To productionize this for our internal cloud users, dashboards and alarms are provided to enable users to monitor their system’s adherence to, and violations of, their QoS policy.

Speakers
avatar for Jane Zhu

Jane Zhu

Senior Software Engineer, Bloomberg LP
Dr. Jane Zhu is a Senior Software Engineer at Bloomberg. She is part of the Storage Engineering team in the company’s Technology Infrastructure department. Jane designed and built a highly available, scalable, and durable software-defined cloud storage platform. In addition to shepherding... Read More →
avatar for Matthew Leonard

Matthew Leonard

Storage Engineering Manager, Bloomberg LP
Matthew Leonard leads the Storage Engineering organization in Bloomberg Engineering’s Technology Infrastructure department. Matthew worked on software for fighter planes, and now leverages his “slow is smooth, smooth is fast” mentality from the aerospace industry to direct Bloomberg’s... Read More →


Tuesday July 12, 2022 12:30pm - 1:10pm PDT
Regency Ballroom D