Skip to content

Epic: Prebuilds stability #10361

Closed
Closed
@geropl

Description

@geropl

Summary

The goal of this epic is to focus on two things:

  1. fix the most glaring issues we currently have with prebuilds
  2. ensure quality beyond that by adding tests and metrics as we see fit

Context

Historically the "prebuild experience" has been really shaky (cmp. #7812, for instance), mostly because:

  • it's a rather high-level feature that involves a lot of moving parts to ⚙️ into each other
  • it has close to zero test coverage
  • it's opaque to users as to a) why and b) if a prebuild is executed after they "triggered" it: some of the perceived instability is actually working as intended but a) we're doing a bad job at explaining it and b), it's not observable for users (not exactly this epic, but touches parts of this one)
  • we do not have proper metrics + alerts setup (SLI anyone)

As one of our quarterly goals is to improve perceived reliability, and we're driving usage-based pricing now, it feels like the right time to step up our game in this area. 💪

We already have two other related epics that have a certain overlap:

We might tackle those as well if there's time. But we start out with the issues listed here, and and work our way towards those. Also, I expect that the individual issues are a) outdated and b) have overlap themselves, so we'll have to draw and move the line as we go.

Value

  • we fix some immediate issues that plague our customers
  • we ensure those do not happen again, or are detected earlier when they happen again next time

Acceptance Criteria

  • all issues referenced in this epic are done ✔️
  • we have metrics from which we can derive a "success rate" (bonus points for having an SLI dashboard)

Measurement

The user perceived reliability increased.

Tasks:

Issues

deferring

Observability/Metrics

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions