Skip to content

[alerts] Reduce trigger duration for Stripe Webhook Failure alert #15953

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 23, 2023

Conversation

easyCZ
Copy link
Member

@easyCZ easyCZ commented Jan 23, 2023

Description

Related Issue(s)

Fixes #15202

How to test

Release Notes

NONE

Documentation

Build Options:

  • /werft with-github-actions
    Experimental feature to run the build with GitHub Actions (and not in Werft).
  • leeway-no-cache
    leeway-target=components:all-ci
  • /werft no-test
    Run Leeway with --dont-test
  • /werft with-local-preview
    If enabled this will build install/preview
  • /werft with-preview
  • /werft with-large-vm
  • /werft with-integration-tests=all
    Valid options are all, workspace, webapp, ide, jetbrains, vscode, ssh

@easyCZ easyCZ requested a review from a team January 23, 2023 09:31
@github-actions github-actions bot added the team: webapp Issue belongs to the WebApp team label Jan 23, 2023
@@ -57,17 +57,6 @@ spec:
summary: Usage reconciliation has not run successfully for {{ printf "%.2f" $value }} seconds. Usage data is stale.
description: We have not executed scheduled usage reconciliation for {{ printf "%.2f" $value }} seconds. We expect the data to update every 15 minutes to avoid stale usage records and stale invoices.

- alert: GitpodUsageStripeWebhookFailures
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moves this alert to the public-api file, as it's more appropriate given that's the receiver of the webhook


- alert: GitpodStripeWebhookFailures
expr: sum(increase(gitpod_http_request_duration_seconds_count{handler="/stripe/invoices/webhook", code=~"5.*"}[30m])) > 0
for: 10m
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reduces the trigger period to 10m

@roboquat roboquat merged commit 63817fd into main Jan 23, 2023
@roboquat roboquat deleted the mp/public-api-alert-stripe branch January 23, 2023 10:45
@roboquat roboquat added deployed: webapp Meta team change is running in production deployed Change is completely running in production labels Jan 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
deployed: webapp Meta team change is running in production deployed Change is completely running in production release-note-none size/S team: webapp Issue belongs to the WebApp team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix alerting on Stripe webhook failures
3 participants