Lessons Learned Running Presto at Meta Scale

Presto is a free, open source SQL query engine. We’ve been using it at Meta for the past ten years, and learned a lot while doing so. Running anything at scale tools, processes, services takes problem solving to overcome unexpected challenges. Here are four things we learned while

Philip Bell 8 min readOriginal

Presto is a free, open source SQL query engine. We’ve been using it at Meta for the past ten years, and learned a lot while doing so. Running anything at scale - tools, processes, services - takes problem solving to overcome unexpected challenges. Here are four things we learned while scaling up Presto to Meta scale, and some advice if you’re interested in running your own queries at scale.

Scaling Presto rapidly to meet growing demands: What challenges did we face?

Deploying new Presto releases

Figure 1: Process workflow for pushing new versions of Presto (Diagram by Philip S. Bell)

Keep reading High Scalability with Pro

This source is part of the Pro library. Unlock every premium source, AI translation and custom feeds.

HS

Originally published on

High Scalability

Read original

Keep reading