Skip to main content
Engineering Leadership16 min read·

Scaling Distributed Engineering Teams Without Losing Speed or Coherence

At 60 engineers across four time zones, coordination costs grow faster than output. Three specific practices prevent the tax from becoming permanent.

Scaling Distributed Engineering Teams Without Losing Speed or Coherence

TL;DR. At 15 engineers, coordination is nearly free — everyone knows what everyone is working on. At 60 engineers across four time zones, the same organization is often slower than it was at 15, not because the engineers are less capable, but because the coordination cost has grown faster than the output. The shared context that was automatic at small scale must be deliberately created at large scale. ADRs, async-first decision processes, and explicit service ownership are the three practices that keep the coordination tax linear rather than super-linear as you grow.

At 15 engineers, coordination is almost free. Everyone knows who's working on what. Decisions happen in a hallway or a Slack message. The team can react quickly because communication is fast and shared context is high.

At 60 engineers across four time zones, the same organization often finds itself slower than it was at 15. Not because the engineers are less competent. Because the coordination costs have grown faster than the technical output.

This is one of the most predictable failure modes in fast-growing engineering organizations, and it's preventable, but only if you anticipate it rather than react to it.

What actually breaks as you scale from 15 to 60 engineers — and why it is predictable

The first thing that breaks is shared context. At 15 engineers, most people have a working understanding of most of the system. They know which parts are fragile, who owns what, and where the bodies are buried. This shared context is not a formal artifact, it lives in people's heads and gets refreshed through casual conversation.

At 60 engineers, you can no longer assume that the person working on the payment service has any idea what the platform team changed last week. The shared context that was free at small scale has to be explicitly created and maintained at large scale. Teams that don't do this end up with decisions made in isolation, duplicated work, and integration failures that surprise everyone.

The second thing that breaks is decision velocity. A small team can make a hundred small architectural decisions per week through informal conversation. A large team either formalizes a decision process, which adds latency, or allows each squad to make decisions independently, which produces inconsistency and integration debt.

Neither option is wrong. But you need to be deliberate about which decisions require cross-team alignment and which can be delegated entirely. Organizations that try to align on everything become slow. Organizations that delegate everything become incoherent. The interesting engineering leadership work is figuring out which category each decision belongs in.

Service ownership debt — the failure mode nobody discusses until it produces a 2am archaeology session

Beyond shared context and decision velocity, there is a third failure mode that is less frequently discussed: service ownership debt. As organizations scale, the number of services, integrations, and data pipelines typically grows faster than the team does. Each new capability adds something to the estate. But unlike the team, the estate rarely shrinks.

By the time an organization reaches 60 engineers, it typically has dozens of services, of which a meaningful fraction were built by engineers who are no longer at the company. These services continue to run, continue to generate alerts, and continue to require maintenance. But they have no active owner. When something breaks, the team that gets the alert has to perform archaeology to understand the system before they can diagnose the problem.

This is not an inevitable consequence of growth. It is the consequence of growth without explicit ownership management. Organizations that maintain a service catalog, with every service having a named owning team, a designated subject matter expert, and a documented runbook, find that the archaeology problem largely disappears. When something breaks at 2am, the on-call engineer has a starting point.

The service catalog is not a complex system. It is a document, maintained in the same place as architectural decisions and runbooks, that answers three questions for every service: who owns it, what does it do, and where do I start if something goes wrong? Getting this information out of people's heads and into a shared, trusted document is engineering work that does not show up on the product roadmap but pays significant returns over time.

The three practices that keep coordination costs proportional as the organization grows

The teams that scale well share a few specific practices. None of them are secret knowledge, but the execution discipline required to sustain them is underestimated.

Architecture Decision Records (ADRs) are the highest-leverage documentation practice I've seen at scale. An ADR is a short document that captures a significant technical decision: what the decision was, what alternatives were considered, and why the chosen option was selected. They're not long. They're not formal. But they create a durable record of why the system looks the way it does, which is invaluable for engineers who join later and for preventing the same debates from happening over and over.

Teams that introduce ADRs consistently report that they reduce the "why was this built this way?" frustration that slows down new engineers significantly. They also create a natural checkpoint that slightly improves decision quality, writing down the reasoning forces a level of clarity that verbal decisions often lack.

Asynchronous-first communication is the second practice that doesn't feel important until it breaks. In a globally distributed team, decisions made synchronously in a video call exclude the half of the team that's asleep. This is obvious, but the default behavior in most organizations is still to hold decision-making meetings during the overlap hours and send everyone else a summary.

Asynchronous-first doesn't mean no video calls. It means that decisions are written down before the call, feedback is collected asynchronously when possible, and the call is for alignment and questions rather than for the initial proposal and debate. This levels the playing field for engineers in minority time zones and creates a written record as a byproduct.

Clear service ownership is the third practice. At scale, "everyone is responsible" reliably becomes "no one is responsible." Every service, every piece of infrastructure, every data pipeline should have a named team and a named point of contact. This is not bureaucracy for its own sake. It's the prerequisite for fast incident response, for making good prioritization decisions about technical debt, and for preventing the accumulation of orphaned systems that no one feels authorized to improve or retire.

Async-first in practice: the gap between claiming it and building it

The gap between organizations that describe themselves as "async-first" and those that have actually built the practices is significant. The distinction shows up most clearly in how decisions get made.

In a genuinely async-first organization, a proposal for a significant technical change follows a specific lifecycle. Someone writes the proposal in a shared, searchable location. They give a defined window, usually 48 to 72 hours, for feedback. Feedback arrives in writing. The proposer responds to questions and objections in writing. A decision is made and recorded, along with the considerations that shaped it.

In an organization that aspires to async-first but has not built the practices, the proposal gets written, waits for feedback that doesn't arrive, and then gets decided in a synchronous call anyway because the proposer lost confidence that the async feedback would come.

The transition to genuine async-first requires two things that are organizational rather than technical. The first is a norm that written feedback is expected and that not providing it is a choice with consequences, specifically, that your input will not be available when the decision is made. The second is a leadership model that does not require synchronous alignment for decisions that could be made asynchronously. Engineering managers who are uncomfortable making or approving decisions without a meeting are the most common obstacle to async-first culture.

How you organize teams matters as much as any technical decision at this scale

As teams scale, the question of how to organize them becomes as important as any technical decision. The choices made here determine how easily information flows, where coordination bottlenecks form, and how much autonomy individual teams have.

The team topologies framework, popularized by Matthew Skelton and Manuel Pais, offers a useful vocabulary for thinking about this: stream-aligned teams (focused on delivering product value), enabling teams (helping other teams improve their practices), complicated-subsystem teams (managing genuinely complex technical domains), and platform teams (providing internal products to other teams). Most large engineering organizations need all four, but many accidentally end up with all their teams in stream-aligned mode with no enabling function and no platform.

The result is that every product team reinvents the same infrastructure and tooling independently. Every team develops its own CI setup. Every team manages its own observability. Every team onboards new engineers in a different way. The duplication is invisible in any individual team's budget but enormous at the organizational level.

The enabling team function is the most underinvested in most organizations. An enabling team's job is to make other teams more effective: identifying the highest-friction practices across the engineering organization, developing improvements, and helping teams adopt them. This is a force-multiplier function that does not show up in delivery metrics directly but is responsible for much of the efficiency delta between high-performing engineering organizations and average ones.

Two metrics that surface coordination health before it shows up in DORA numbers

Most engineering organizations measure delivery health through the DORA metrics: deployment frequency, lead time, change failure rate, and mean time to restore. These metrics capture the output of the delivery system well but are less useful for diagnosing coordination problems specifically.

Two additional measurements are useful for distributed team coordination health.

The first is cross-team dependency resolution time: how long does it take from when a team identifies that they need something from another team to when that need is addressed? Organizations where this resolution time is measured in days tend to have strong coordination practices. Organizations where it is measured in weeks have a coordination debt problem that will worsen as they grow.

The second is meeting load as a fraction of total work time. The most coordinated organizations tend to have lower meeting loads than their less-coordinated peers, because asynchronous practices have replaced synchronous coordination. When meeting load is high and growing, it is often a sign that coordination infrastructure, documentation, decision records, shared context, is not scaling with the team.

The coordination tax is real — and the time to invest is before it becomes obvious

There is no way to scale an engineering organization without paying some coordination tax. The question is whether the tax is proportional to the coordination required or inflated by poor practices.

Organizations that have thought deliberately about distributed team structure, invested in the documentation and tooling that makes asynchronous work effective, and defined clear ownership models pay a coordination tax that is roughly linear with team size. Organizations that haven't pay a super-linear tax: each new team makes coordination harder for all the existing teams.

The time to invest in these practices is not when the pain of scaling is undeniable. By then, you're paying to fix a broken system at the same time you're trying to add to it. The time to invest is when the org is still small enough to make changes without fighting organizational inertia. If you're at 30 engineers and considering going to 60, the most important engineering investment you can make in the next quarter is probably not a new feature. It's the coordination infrastructure that will allow 60 engineers to stay coherent.

The knowledge transfer problem: moving institutional knowledge from the people who have it to the people who need it

One of the most concrete manifestations of the coordination challenge at scale is the knowledge transfer problem: the difficulty of moving institutional knowledge from the engineers who have it to the engineers who need it.

At 15 engineers, knowledge transfer happens naturally through daily conversation. Senior engineers answer questions, review code, and pair with junior engineers as a normal part of the workday. The knowledge moves because the proximity and time availability make it easy.

At 60 engineers, none of these conditions hold. Senior engineers are in demand from multiple teams simultaneously. New engineers are distributed across time zones. The knowledge that needs to transfer cannot move through conversation efficiently because the conversations are too infrequent and too context-limited.

The organizations that solve this well invest in two specific mechanisms. The first is structured knowledge capture: requiring that significant technical decisions, system characteristics, and operational procedures be written down in accessible, searchable form rather than held in memory. This includes ADRs, runbooks, architecture documentation, and post-incident analyses. The discipline of capturing knowledge as it is created costs time in the moment but pays returns exponentially as the organization grows.

The second is deliberate mentorship structure. As the organization grows, the informal mentorship that happened through proximity needs to be replaced with explicit pairing relationships, defined expectations for senior engineer mentorship time, and tracked outcomes. The senior engineer who mentors three junior engineers in a year is doing something at least as valuable as shipping a major feature, and it should be recognized as such.

Remote-first is not remote-optional — the distinction that decides whether distributed engineers are full participants

A subtle but important distinction exists between engineering organizations that describe themselves as "remote-friendly" and those that have genuinely redesigned their processes for distributed work. The difference shows up most clearly in how decisions get made and how new engineers are integrated.

Remote-optional organizations have physical offices where most decision-making happens in person, with remote employees watching on video calls or receiving decisions through Slack. The processes were designed for co-located teams and have not changed. Remote engineers are second-class participants in the key moments of organizational life.

Remote-first organizations have redesigned their decision processes to work equally well regardless of physical location. No decision that matters is made in a hallway conversation. Documentation is the default, not the exception. The processes were designed from the ground up for a world where nobody is in the same room, which means they work well whether the team is distributed or not.

For distributed engineering teams, the remote-first design is not a preference. It is the prerequisite for equitable participation and good decision quality. The organization that has built genuinely remote-first processes has also built the coordination infrastructure required for distributed excellence. These are the same thing.

The distributed incident response problem — and why it needs to be designed before 2am

Distributed teams face a specific incident response challenge that co-located teams do not: when a major production incident occurs outside of normal business hours in the primary time zone, the on-call engineer may need to pull in additional expertise from engineers who are not on call and who may be in a different time zone.

The coordination infrastructure for this scenario needs to be designed explicitly, not improvised during the incident. Who are the domain experts for each critical service, and how do they prefer to be reached for out-of-hours escalations? What is the escalation threshold that justifies waking someone up rather than waiting for business hours? How are decisions about rollbacks and emergency changes made when the full team is not available?

These questions need to be answered in advance, documented in the incident response playbook, and practiced before the scenario arises. The distributed team that has this infrastructure in place handles a 2am incident with significantly less chaos than the team that improvises the coordination as it goes.

The documentation that matters most: for each critical service, who are the two engineers with the deepest knowledge, in which time zones are they located, and what is the escalation path if neither is reachable? This information should be in the runbook, not in the team lead's head.

The documentation investment that replaces the shared context you had at 15 engineers

The most durable investment for distributed team effectiveness is the documentation infrastructure that allows any engineer on the team, regardless of when they joined, what time zone they are in, or whether they were present for key decisions, to understand the current state of the system and the reasoning behind its design.

This is not documentation for its own sake. It is documentation as the foundation of team scalability. The team that can onboard a new engineer in Singapore to full productivity in four weeks is the team that has invested in making the knowledge accessible. The team where full productivity requires six months of learning from colleagues' time-zone-constrained schedules is the team that has underinvested in this foundation.

The engineering organizations that are most effective at global scale share a common characteristic: they treat writing as a core engineering skill, not a separate communication skill. The engineer who can implement a system well and explain why it was built the way it was is more valuable to a distributed team than the engineer who can only do the former.

Frequently asked questions

Why do engineering organizations get slower as they add engineers?

The shared context that is automatic at 15 engineers has to be explicitly created and maintained at 60. At small scale, everyone knows what everyone is working on, decisions happen through casual conversation, and inconsistencies surface quickly because the team is close enough to notice them. At large scale, the coordination cost of keeping this context current grows faster than the individual output of the engineers added. Organizations that do not invest in explicit coordination infrastructure — ADRs, async decision processes, service ownership documentation — pay a super-linear coordination tax that more than offsets the headcount growth.

What is service ownership debt?

Service ownership debt accumulates when the number of services and integrations grows faster than the team, and ownership of earlier services is never formally transferred. By the time an organization reaches 60 engineers, a meaningful fraction of services were built by engineers who have since left. When those services generate alerts or require changes, the on-call engineer performs archaeology to understand the system before diagnosing the problem. A service catalog with named owning teams, designated subject matter experts, and documented runbooks prevents most of this archaeology.

What is the difference between remote-friendly and remote-first?

Remote-friendly organizations have physical offices where decision-making happens in person, with remote employees watching on video calls or receiving decisions through Slack. The processes were designed for co-located teams. Remote-first organizations have redesigned decision processes to work equally well regardless of physical location — no important decision is made in a hallway conversation, documentation is the default. For distributed teams across four time zones, remote-first is not a preference. It is the prerequisite for equitable participation.

When is the right time to invest in coordination infrastructure?

Before the pain of scaling is undeniable. By the time the coordination tax is obvious, the organization is paying to fix a broken system while simultaneously trying to add to it. If your team is at 30 engineers and considering growth to 60, the most important engineering investment in the next quarter is probably the documentation, ADR practice, and service ownership model that will allow 60 engineers to stay coherent — not a new product feature.


If you are navigating a scaling transition and want a specific assessment of where coordination costs are coming from, reach out. The patterns are recognizable and the interventions are specific. For the platform engineering approach that supports distributed teams at scale, read about the Foundations Framework.

Distributed TeamsTeam ScalingEngineering LeadershipDeveloper Experience

Found this useful? Share it with your network.

Matías Caniglia

Mat Caniglia

LinkedIn

Founder of Clouditive. 18+ years transforming engineering organizations across LATAM and globally through Developer Experience consulting.

79 articles published

Related Articles

Engineering Leadership

Team Topologies in Practice: What the Four Team Types Look Like at 60 Engineers

Team Topologies is the most useful org framework for Series A–C engineering leaders. Here is what it actually looks like applied to a 60-engineer company, not an enterprise.

Read More →
Engineering Leadership

DORA Metrics for Engineering Leaders: What They Actually Tell You

Most engineering leaders have seen a DORA dashboard. Fewer understand what the numbers mean in context — or why the platform shapes the metrics more than the teams do.

Read More →
Engineering Leadership

What a Platform Team Actually Costs at Series B

The question every VP Engineering gets: why do we need a team that doesn't ship product features? The answer requires math, not just philosophy.

Read More →

Stay updated with Clouditive

Long-form analysis on platform engineering, DORA, and AI readiness from Mat Caniglia. Sent when there is something worth reading.

Start here

See where your delivery stands.

A fifteen minute self-diagnostic that scores your platform across DORA metrics, deployment frequency, change failure rate, and cognitive load. No sales call required.

Want to read first? See the Foundations Framework