Skip to content

feat: add alerts for cost monitoring system#8238

Draft
jnywong wants to merge 1 commit into
2i2c-org:mainfrom
jnywong:cost-monitoring-alerts
Draft

feat: add alerts for cost monitoring system#8238
jnywong wants to merge 1 commit into
2i2c-org:mainfrom
jnywong:cost-monitoring-alerts

Conversation

@jnywong

@jnywong jnywong commented May 6, 2026

Copy link
Copy Markdown
Member

Ref #8123

To Do

  • Update support/values.jsonnet with grouped cost-monitoring alerts
  • Ensure PagerDuty system is set up to route these alerts to app engineers

@github-actions

github-actions Bot commented May 6, 2026

Copy link
Copy Markdown
Contributor

Merging this PR will trigger the following deployment actions.

Support deployments

Cloud Provider Cluster Name Reason for Redeploy
aws reflective Support helm chart has been modified
aws ucmerced Support helm chart has been modified
aws smithsonian Support helm chart has been modified
gcp 2i2c-uk Support helm chart has been modified
aws nasa-ghg-hub Support helm chart has been modified
kubeconfig projectpythia-binder Support helm chart has been modified
gcp 2i2c Support helm chart has been modified
kubeconfig utoronto Support helm chart has been modified
aws bnext-bio Support helm chart has been modified
aws earthscope Support helm chart has been modified
aws openscapeshub Support helm chart has been modified
aws nasa-cryo Support helm chart has been modified
aws nmfs-openscapes Support helm chart has been modified
gcp cloudbank Support helm chart has been modified
aws jupyter-health Support helm chart has been modified
aws aimatx-2i2c-hub Support helm chart has been modified
aws disasters Support helm chart has been modified
aws maap Support helm chart has been modified
gcp hhmi Support helm chart has been modified
aws nasa-veda Support helm chart has been modified
aws victor Support helm chart has been modified
gcp awi-ciroh Support helm chart has been modified
gcp leap Support helm chart has been modified
gcp dubois Support helm chart has been modified
kubeconfig 2i2c-jetstream2 Support helm chart has been modified
aws berkeley-geojupyter Support helm chart has been modified
aws temple Support helm chart has been modified
aws opensci Support helm chart has been modified
aws projectpythia Support helm chart has been modified
aws 2i2c-aws-us Support helm chart has been modified

Staging deployments

No staging hub upgrades will be triggered

Production deployments

No production hub upgrades will be triggered

@yuvipanda

Copy link
Copy Markdown
Member

@jnywong what is needed to drive this to completion?

@jnywong

jnywong commented Jul 24, 2026

Copy link
Copy Markdown
Member Author

The image bumps is so that the cost monitoring services exports Prometheus metrics for every HTTP request made to the system

plus updating the helm chart to add pod annotations to tell Prometheus to scrape from the cost-monitoring pod.

The remaining work in this PR is to come up with a sensible alert(s) for the cost monitoring application that I want to be alerted on via PagerDuty. I'll add this to the top card so that's clearer.

I've not been able to push this work to completion because I've been focused on other things, but I hope we can pick this up again as goal-driven work for this quarter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants