![]() ![]() Once we decided to update the service and move to MyRocks, migrating data between storage systems while keeping Messenger up and running for more than 1 billion accounts proved to be an interesting challenge. Also, the replication topology for MySQL is more compatible with the way Facebook data centers operate in production, enabling us to reduce the number of physical replicas of data while producing better availability and disaster recovery. We can now leverage our new Lightning Server SKU, from the Open Compute Project, to serve data housed in flash storage instead of relying on spinning disks. HBase had been our database since 2010 and it served us well, but the change to MyRocks helped us realize several important benefits. Handling the challenge of migrating at scale This was achieved in a seamless way that did not cause any disruption or downtime, but it required us to plan for and execute two different migration flows to account for every single Messenger user. We also have improved system resiliency, reduced latency, and decreased storage consumption by 90 percent. The result has been a better experience for Messenger users themselves, who can now enjoy a more responsive product with enhanced functionality, such as mobile content search. We moved from storing the database on spinning disks to flash on our new Lightning Server SKU.We moved from HBase, an open source distributed key-value store based on HDFS, to MyRocks, Facebookâs open source database project that integrates RocksDB as a MySQL storage engine.We redesigned and simplified the data schema, created a new source-of-truth index from existing data, and made consistent invariants to ensure that all data is formatted correctly. ![]() This evolution involved several major changes: To help improve Messenger even more, we now have overhauled and modernized the storage service to make it faster, more efficient, more reliable, and easier to upgrade with new features. This design optimized Messenger for a mobile-first world and helped fuel its success. The original monolithic service was separated into a read-through caching service for queries Iris to queue writes to subscribers (such as the storage service and devices) and a storage service to retain message history. To enable that shift, we have made many changes through the years to update the backend system. Today, Messenger is a mobile-first, real-time communications system used by businesses as well as individuals. When Messenger was originally designed, it was primarily intended to be a direct messaging product similar to email, with messages waiting in your inbox the next time you visited the site. As we have evolved the product and added new functionality, the underlying technologies that power Messenger have changed substantially. More than a billion people now use Facebook Messenger to instantly share text, photos, video, and more.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |