Back To Schedule
Wednesday, October 21 • 07:00 - 07:30
Sharding: DIY or Out of the Box Solution?

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.

Once vertically scaling your databases can’t help you any further you need to think about sharding them. Sharding basically means you are going to distribute your (write) workload over multiple database hosts using an algorithm. For some open source databases, you get sharding out of the box, but for MySQL, you don’t. This means you either implement a sharding yourself and have absolute control over what data goes where or choose an out of the box solution like Vitess.

When MessageBird hit the limits on one of our cornerstone databases, we had to implement a sharding solution fast. With strong time constraints at hand, this meant we had to act fast and created our own sharding solution. Luckily we were able to reuse most of our existing infrastructure for this purpose. However, once it was time to shard another database, we took a step back and evaluated whether we should use our own solution once more or pick a sharding platform like Vitess.

In this talk, I’ll take you through the good, bad, and ugly of sharding, the choices you have to make, and the obstacles you can expect during your journey.

avatar for Art van Scheppingen

Art van Scheppingen

Senior Database Engineer, MessageBird
Art van Scheppingen is a Senior Database Engineer at MessageBird with focus on database scalability and reliability. He's a pragmatic MySQL and Database expert with over 20 years experience in web development. He previously worked in various database architectural roles and as Senior... Read More →

avatar for Dimitri Vanoverbeke

Dimitri Vanoverbeke

Senior Solutions Engineer, Percona
As a young padwan, Dimitri was triggered into IT by an early adoption in BASIC, DOS, the early windows era, and early Linux adoption. This made him aware of the numerous pitfalls, challenges and actual fun of working in IT. In his career, Dim0 has worked for emerging technology organisations... Read More →

Wednesday October 21, 2020 07:00 - 07:30 EDT
  Other OSDB
  • Difficulty Advanced
  • Why this level of difficulty? Sharding is definitely not for the faint hearted and not even Vitess will solve that. ;)
  • Speaker Location Netherlands