One Firmware Maintainer's Bus Factor Was One Person With One Laptop

Jul 18, 2026 By Lucas Mendes

In early 2025, a security researcher discovered that the firmware powering a popular series of microcontrollers—used in everything from consumer electronics to industrial sensors—was maintained by exactly one person. That person held the sole copy of the signing keys on a single laptop. If that laptop were lost, stolen, or encrypted by ransomware, the entire supply chain for that chip would grind to a halt. A hardware recall might be the only path forward. This is not an edge case. It is a structural feature of the embedded ecosystem.

The Laptop and the Line: One Person Holding a Chip's Fate

The maintainer in question, who asked to remain anonymous for fear of backlash, inherited the project from a former colleague who left the company abruptly. The codebase was undocumented. The build environment lived on a single virtual machine. The signing keys—used to authenticate firmware updates—were stored in an encrypted directory on that VM, with no backup. The maintainer told me, "If my laptop dies, the chip is dead."

This is not a startup story. The microcontroller is produced by a mid-sized semiconductor firm with hundreds of employees. The firmware itself is open source, hosted on GitHub, with dozens of contributors. But the release process—the actual signing and publishing of binaries—is gated by one person. The company has no formal bus factor policy. The project has no documented handover protocol.

Bus factor is a measure of how many people can be hit by a bus before a project collapses. In this case, the number is one. The risk is not hypothetical. In 2024, a similar project lost its sole maintainer to a prolonged illness. For six months, no firmware updates were released. Critical security patches sat in pull requests. Users were left exposed to known vulnerabilities.

The embedded world is full of such stories. A 2023 survey by the Eclipse Foundation found that roughly 40% of open-source IoT projects had no more than two active maintainers. For firmware projects, the number is likely higher. The reasons are structural: low-level software is hard to fund, hard to learn, and easy to ignore—until it breaks.

Bus Factor One: How Firmware Became a Single-Point Failure

Firmware occupies a strange place in the software stack. It is not quite hardware, not quite application code. It runs on bare metal, often with no operating system, and its failures can brick devices. Yet it is rarely treated as critical infrastructure. Hardware companies often view firmware as a cost center, a necessary evil to ship chips. Open-source firmware projects, in particular, struggle to attract sustained funding.

Maintainer burnout is endemic. The work is detail-intensive, poorly documented, and often invisible. A firmware bug might not manifest for years, only to cause a recall. The pressure is high, the recognition low. Many maintainers work alone, in their spare time, with no institutional support. The result is a fragile ecosystem where key projects depend on the goodwill of a handful of people.

In 2024, a widely-used bootloader project was locked for weeks because the maintainer forgot the password to the signing server. The server was a cloud instance tied to a personal email account that had been compromised. The maintainer had to reset the account through a lengthy support process, during which no signed updates could be issued. The incident was not malicious, but the impact was the same: a single point of failure brought the project to a standstill.

The cost of a bus factor event is measured in months of patching delays. For a chip used in medical devices, that can mean patient risk. For a chip used in industrial controllers, it can mean production downtime. The supply chain is only as strong as its weakest maintainer.

Consider also the case of a real-time operating system (RTOS) for automotive controllers. In 2022, the sole maintainer of a critical memory management component left the project without notice. It took the community roughly four months to find a replacement and bring them up to speed. During that period, two CVEs were reported and remained unpatched. The delay forced several automakers to deploy workarounds that increased cost and complexity. The bus factor was one, and the entire automotive supply chain felt the ripple effects.

The Funding Gap: Why Nobody Pays for Firmware Maintenance

Hardware companies rarely fund upstream firmware work. They benefit from open-source bootloaders, real-time operating systems, and driver stacks, but they see little incentive to pay for their maintenance. Crowdfunding campaigns cover initial development—a new board, a novel feature—but not the years of bug fixes, security updates, and documentation that follow.

The Linux Foundation's Zephyr project is an exception. It has corporate backing from Intel, NXP, and others, and employs a small team of maintainers. But Zephyr is a full RTOS. Most firmware projects are smaller: a USB stack, a cryptographic library, a bootloader. These projects often have no funding at all.

Enterprise users are the worst offenders. A company might deploy a chip in thousands of devices, relying on its firmware for security-critical functions, yet never contribute a dollar to its maintenance. The maintainer of a common cryptographic library for microcontrollers told me, "I get emails from Fortune 500 companies asking for urgent fixes. They don't offer to pay. They expect free labor."

The plea is familiar: "We need a sustainable model." Some projects have turned to foundations like the OpenHW Group, which provides shared infrastructure and legal support. Others have tried sponsorship programs, with mixed results. The core problem is that firmware maintenance is invisible work. It doesn't ship new features. It doesn't generate press. It just keeps the lights on.

There is a counter-argument worth considering: some hardware vendors argue that funding upstream firmware maintenance is not cost-effective because they already pay for internal validation and certification. They see open-source firmware as a free component that they can customize as needed. But this view ignores the fact that without healthy upstream projects, the entire ecosystem suffers. A single unpatched vulnerability in a shared bootloader can affect dozens of downstream products. The cost of collective inaction is far higher than the cost of shared maintenance.

Security at the Boundary: When One Person Controls the Boot Chain

Firmware vulnerabilities are a growing attack surface. The LogoFAIL exploit (CVE-2023-40238) showed how a malicious image could compromise the UEFI boot chain. The vulnerability affected millions of devices and required coordinated patching across multiple vendors. But many firmware projects lack the resources to respond quickly to such threats.

A single maintainer means slow response to critical CVEs. The maintainer must triage the report, reproduce the bug, develop a fix, test it across multiple hardware variants, sign the update, and publish it. If the maintainer is on vacation, sick, or overwhelmed, the fix sits. In the meantime, attackers have a window of opportunity.

The risk is compounded when signing keys are compromised. In 2025, a small IoT vendor discovered that a stolen firmware key had been used to sign malicious updates. The key was stored on a developer's laptop, which was infected with malware. The vendor had to revoke the key and issue a recall—a process that cost millions. The root cause was not sophisticated espionage. It was poor key management, a direct consequence of bus factor one.

Trusted Platform Module (TPM) integration can help by keeping keys in hardware, but such integration is often under-documented and under-utilized in open-source firmware projects. The expertise required to set up a proper HSM-based signing pipeline is rare. Most maintainers do what is easiest: store keys on their machine.

Furthermore, the complexity of modern firmware supply chains means that a single compromised key can have cascading effects. Consider the case of a popular IoT platform that used a shared signing key across multiple product lines. When that key was leaked, attackers could sign firmware for any device in the family. The vendor had to revoke the key and update all devices in the field—a process that took over a year. The root cause was again a single maintainer who had sole access to the key and no secure backup process.

How the Best Teams Mitigate the Bus Factor

Some teams have cracked the code. The RISC-V ecosystem's Tock project, for example, enforces peer review for all commits. No single person can merge code or sign a release. The project uses a hardware security module (HSM) for key storage, and the build pipeline is fully automated on a shared CI server. If one maintainer disappears, the others can continue.

Formal handover protocols are another best practice. A documented process for transferring signing keys, access to cloud accounts, and domain names can save weeks of recovery time. Some teams use a shared vault—like HashiCorp Vault or a physical safe—to store secrets. Access requires multiple people to authenticate.

Cross-training is essential. Two maintainers per critical component is a minimum. This means investing time in mentoring, documentation, and code review. It means accepting that a single expert is a liability. The upfront cost is real, but the alternative is a single point of failure that can halt an entire supply chain.

Regular audits of single points of failure in firmware repos can identify risks before they become crises. A simple spreadsheet listing each project, its maintainers, and their backup can reveal gaps. The act of auditing forces conversations that otherwise never happen.

Another approach is to adopt a "four-eyes" principle for all critical operations. For example, the signing process should require approval from at least two maintainers. This can be enforced through tools like Sigstore, which provides a transparent and auditable signing workflow. While Sigstore is more common in the cloud-native world, its principles apply equally to firmware. The key is to remove the dependency on any single individual.

Practical Steps for Maintainers to Protect Their Work

If you are a firmware maintainer, start by documenting every signing procedure. Write down the exact commands, the file paths, the passphrase rules. Store this document in a shared vault that at least one other person can access. Do not rely on memory or a single encrypted file.

Set up a CI/CD pipeline that does not depend on your machine. Use a cloud-based build service that can reproduce your environment. Ensure that the signing step is automated and uses an HSM or a cloud key management service. If you must use a local key, back it up in a tamper-evident envelope and store it in a safe deposit box.

Reproducible builds are your friend. If your firmware builds can be verified by anyone, the loss of your laptop does not mean the loss of the build process. Tools like the Reproducible Builds project provide guidance for embedded systems. The effort is modest; the payoff is enormous.

Create a succession plan. Name at least one person who will inherit the keys and the knowledge. Schedule a quarterly handover drill where that person actually performs a release. The drill will expose gaps in documentation and build confidence. Finally, consider joining a foundation like the OpenHW Group or the Linux Foundation's Zephyr project, which provide shared infrastructure and reduce the burden on individuals.

For maintainers who are hesitant to share keys due to trust concerns, consider using a threshold signing scheme. With threshold ECDSA, for instance, a group of maintainers can collectively sign a release without any single person holding the full private key. This approach distributes trust and eliminates the bus factor for key compromise. While the setup is more complex, it provides strong guarantees that no single laptop is a single point of failure.

The Cost of Inaction: A Cautionary Tale from the Field

In 2023, a popular bootloader project went silent for eight months. The sole maintainer had a family emergency and could not work. The project had no backup maintainer, no documented release process, and no shared signing infrastructure. Pull requests piled up. Security patches for a known vulnerability—one that allowed arbitrary code execution during boot—went unmerged.

Derivative forks appeared, each with its own set of patches. The ecosystem fragmented. Users had to choose between an unmaintained upstream and a fork of unknown quality. Some forks introduced new bugs. Others removed attribution. The trust that had taken years to build was eroded in months.

When the maintainer eventually returned, the project was in chaos. They spent weeks merging forks, reconciling divergent codebases, and apologizing to users. The incident was not malicious. It was a simple bus factor event. But the damage was real: delayed security patches, lost trust, and a fragmented community.

The lesson is clear. Bus factor is not an abstract concept. It is a concrete supply-chain risk that can delay security fixes, fragment ecosystems, and expose users to known exploits. The fix is not glamorous. It is documentation, automation, and cross-training. It is the boring operational work that prevents disasters. The next time you rely on a firmware project, ask yourself: who holds the keys? And what happens if they disappear?

There is also a positive side to this story. After the bootloader project's crisis, the community rallied to create a formal governance structure. They set up a foundation, recruited additional maintainers, and implemented a multi-signature release process. Today, the project is more resilient than ever. The bus factor went from one to five. The lesson is that recovery is possible, but it requires collective action and a willingness to invest in the boring operational work that prevents future crises.

In summary, the bus factor is a critical metric for firmware projects. It is not just about code ownership—it is about the entire release pipeline, from signing keys to build servers to documentation. By addressing these single points of failure, we can make the embedded ecosystem more secure and sustainable for everyone.

Recommend Posts
Tech

One React Render Architecture Shapes Three UI Team Career Paths

By Sara Park/Jul 18, 2026

React's Fiber architecture creates three distinct career tracks: build-infrastructure specialist, client-side performance engineer, and design-system architect. Each path pays differently and demands different trade-offs.
Tech

One iOS Dev's App Store Review Bypass Took Three Months of Negotiation

By Deepa Iyer/Jul 18, 2026

A solo iOS developer spent 12 weeks negotiating with Apple for a review bypass. This article examines the hidden costs of platform lock-in, career trade-offs, and how indie devs can build leverage.
Tech

One Maintainer's Two-Factor Bypass Was a Flag in an Unread Config File

By Deepa Iyer/Jul 18, 2026

A single misconfigured 2FA bypass flag sat unread for 18 months, enabling a Steam crypto theft. The story reveals how authentication failures hide in the operational noise of config drift.
Tech

One Postgres DBA Traced a Quarter-Million Dollar Query to One Missing Index

By Deepa Iyer/Jul 18, 2026

A missing index on a Postgres orders table cost $250k per year in extra compute. A DBA traced it in weeks. This is the economics of indexing at scale.
Tech

Three Database Migrations Delayed a Quarterly Release by Six Weeks Each

By Lucas Mendes/Jul 18, 2026

Three large-scale database migrations each delayed a quarterly release by six weeks, costing an estimated $10M–$20M per migration. An analysis of the operational failures and business impact.
Tech

One Frontend Framework Paid for Faster Renders With a Two-Week Onboarding Cliff

By Sara Park/Jul 18, 2026

Framework X cuts render times by 40% but introduces a two-week onboarding cliff. Teams weigh performance gains against cognitive overhead and hiring challenges.
Tech

One CI Platform Standardized on JSON Schema Then Broke Every Config's Default

By Sara Park/Jul 18, 2026

CircleCI adopted JSON Schema for validation but omitted default values, breaking every config. This analysis explores the fallout, workarounds, and lessons for schema-driven tooling.
Tech

Architects Bill Two Million Dollars a Year Running a Query That Returns Zero Rows

By Lucas Mendes/Jul 18, 2026

A query that returns zero rows can cost over $2 million annually in cloud spend. This article explores why engineers don't delete dead code and how to fix the waste.
Tech

One Apache License Fork Broke an Open Source Trust Model No Contributor Had Written Down

By Deepa Iyer/Jul 18, 2026

The Redis-to-Valkey fork exposed unwritten rules of open source trust. When an Apache-licensed project changes license, contributors have no recourse—unless they write the contract first.
Tech

One Rust Package Manager’s Build Cache Broke Across Eight Maintainer Machines

By Sara Park/Jul 18, 2026

A corrupted Cargo cache stumped eight maintainers for days. The root cause: filesystem assumptions that broke across Docker, macOS, and NFS. A deep dive into reproducible build challenges.
Tech

One CDN SRE Tracks a Thousand Dollar Spike to a Single Misconfigured Cache Key

By Sara Park/Jul 18, 2026

How a single misconfigured cache key caused a $1,000 CDN spike overnight, and what it reveals about the economics of edge infrastructure in 2026.
Tech

One NVIDIA Switch Fabric Took Fifteen Minutes to Map a Topology That Changed Every Day

By Deepa Iyer/Jul 18, 2026

NVIDIA's NVSwitch fabric remaps topology daily, costing clusters 1% throughput. The firmware gap between hardware and software leaves operators patching around bugs.
Tech

One Document Store Renewal Tied a SaaS Company Into a Five-Year Licensing Lock

By Yusuke Tanaka/Jul 18, 2026

How a SaaS startup's $200k document store migration ballooned to $2.8 million, and why MongoDB's SSPL license and proprietary extensions made escape nearly impossible.
Tech

Platform Fees Fund One iOS Calendar but Block Two Android Widgets

By Deepa Iyer/Jul 17, 2026

How Apple's and Google's platform fees shape mobile development: iOS calendar apps thrive under subscription models, while Android widgets struggle to monetize. A look at the economics behind the code.
Tech

One Firmware Maintainer's Bus Factor Was One Person With One Laptop

By Lucas Mendes/Jul 18, 2026

The story of a single maintainer holding a chip's fate on one laptop. How firmware becomes a single-point failure, the funding gap, and practical mitigation steps.
Tech

One Monorepo's Build Graph Cache Completely Vanished on a Patch Tuesday Commit

By Sara Park/Jul 18, 2026

A Patch Tuesday commit wiped a monorepo's build cache to zero. Here's how Windows updates, timestamp poisoning, and toolchain drift caused the outage—and what Google and Meta do differently.
Tech

One Sidecar Container Signed All Images and Then Validated None of Them

By Deepa Iyer/Jul 18, 2026

A sidecar signed every image in a registry but never verified a single signature afterward. That gap opened a supply-chain attack path that most teams still ignore.
Tech

One Auth0 Engineer Compressed Twenty MFA Vendor Logins Into One SAML Bridge

By Lucas Mendes/Jul 18, 2026

How an Auth0 engineering team reduced twenty separate MFA vendor portals to a single SAML bridge, boosting adoption from 40% to 98% and cutting incident response time.
Tech

One iOS Market Forces Forty Teams to Dual-Write Every Screen

By Sara Park/Jul 18, 2026

An investigation into why forty teams across ten companies maintain parallel iOS and Android codebases, and why cross-platform tools haven't eliminated the dual-write burden.
Tech

One Package Manager's Storage Bill Exceeds Its Entire Maintainer Budget

By Lucas Mendes/Jul 18, 2026

npm's storage bill runs millions yearly, far outstripping what it pays maintainers. The economics of centralized package registries and what can be done.