Loading…
Tuesday, October 20 • 21:30 - 22:00
Introducing Kunlun Distributed Database Cluster

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.


Kunlun Distributed Database Cluster is a distributed DBMS that aims to combine the best of both MySQL and PostgreSQL to meet the challenges of an ever-growing amount of data to manage and provide users with a highly performant, highly available, highly scalable and fault-tolerant, easy to use and manage database system that requires minimal human maintenance.

Kunlun Distributed Database Cluster enables users to define table sharding rules so that it automatically distributes tablets properly to available storage shards. We implemented the two-phase commit protocol to do distributed transaction commit; We use MySQL group replication for high availability in storage shards. We fixed a series of MySQL XA bugs to make Kunlun's distributed transaction processing highly reliable. We modified PostgreSQL to do far more than its FDW capabilities --- we implemented not only the global transaction coordinator but also concurrent asynchronous communication with MySQL storage shards and enhanced its query processing for best performance when accessing remote data in storage shards. Also, we implemented reliable DDL synchronization among multiple computing nodes of a cluster, the benefit is that all computing nodes have consistent metadata stored locally so that they can do query processing accurately with the best performance.

Come and see:
  1. Kunlun design and architecture, key features, performance metrics, and how&why Kunlun can make the use of MySQL-8.0 group replication convenient and easy.
  2. What issues exist with MySQL-8.0 XA transaction processing and how they are fixed in Kunlun Distributed Database Cluster, besides performance enhancements to MySQL-8.0.
  3. How distributed query optimization in Kunlun makes queries performant and minimizes distribute query execution costs.
  4. How dynamic table sharding distributes tablets properly as more storage shards are added to the cluster.
  5. How global deadlocks come into being and how they are detected and resolved.
  6. How DDL statements are synchronized among all computing nodes of a Kunlun cluster and how to make the synchronization fault-tolerant and reliable.

Speakers
avatar for David Zhao

David Zhao

database systems expert, zettadb
Zhao Wei (David Zhao) has been working on database kernels throughout his career. He worked on Oracle Berkeley DB and MySQL in the two outstanding global teams in Oracle during 2007 and 2015, and he worked in Tencent to upgrade its TDSQL from a table sharding solution to a full-fledged... Read More →

Hosts
avatar for Travis Futas

Travis Futas

Senior Compliance Manager, Percona
Travis is an in-house attorney that manages Percona's privacy and compliance practices. His background is in technology and commercial law, with an emphasis on information security, privacy, and healthcare compliance. Outside of Percona, Travis sits on the board of a private organization... Read More →



Tuesday October 20, 2020 21:30 - 22:00 EDT
Online
  Cool New Technologies, MySQL
  • Difficulty Intermediate
  • Core Technology MySQL
  • Why this level of difficulty? I want more people to know about Kunlun distributed database and the technologies behind it. People will grasp some of all of the session based on their existing knowledge to DBMS, mysql and/or postgresql.
  • Speaker Location China