Reduce ARP WG Costs

[beyhan]

This is a tracking issue for all cost reduction activities in the ARP WG.

As discussed during the TOC meeting on 3rd of June 2025 we agreed on the following activities:

• WG leads should get Ternary access
• Make a report for your Working Group that you should track
• 1 month from now at next meeting, report an idea (implemented or not) for how you will reduce costs
• Contribute to the cost optimization guide Create Automtion Cost Optimization Guide #1185
• Implement cost optimiztion ideas Create Automtion Cost Optimization Guide #1185
• Explore the cost optimization ideas suggested in Ternary

GCP Compute:

ID	Recommendation Type	Resource	Sub Account	Status	Created On	Est. Monthly Savings
3ce4cc10-6442-4377-9b67-b1eca2956780	Unattached Storage	disk-7c591ce9-47b9-435a-407e-2d4ad4eaf77a	app-runtime-platform-wg	New	05/03/2025	5

GCP Storage:

ID	Recommendation Type	Resource	Sub Account	Status	Created On	Est. Monthly Savings
abbf12df-5873-49f1-bdef-9d7d5778c6aa	Object Lifecycle Policy	silk-candidate-tarballs	app-runtime-platform-wg	New	04/20/2025	5
4565d38f-0c67-4065-88c8-18e8d4ea7a6f	Object Lifecycle Policy	cf-networking-candidate-tarballs	app-runtime-platform-wg	New	04/20/2025	5

Diego Recommendaitons:

GCP Compute:

ID	Recommendation Type	Resource	Sub Account	Status	Created On	Est. Monthly Savings
c029cafb-757c-4cb2-8f9b-8df3cb60682f	VM Rightsizing	vm-15419752-dbc3-4316-6531-9b1772e84e6b	cf-diego-pivotal	New	04/21/2025	106
bcf34db7-a1d6-454a-a293-c4a3f52f1019	VM Rightsizing	vm-813bc149-bfee-4224-7217-ed7afe006c23	cf-diego-pivotal	New	04/21/2025	49
2f68d8b1-050d-4f8a-8f33-25b9f096b76e	VM Rightsizing	vm-f3077717-020c-4ac7-54dc-5b2d7bc9e24e	cf-diego-pivotal	New	04/21/2025	46
26514f30-3084-426d-be5f-47ac40707414	Unused Static IP Address	cf-diego-pivotal (us-central1)	cf-diego-pivotal	New	04/24/2025	29
70d5e978-a83c-4736-b6e6-5715fe3b3c36	VM Rightsizing	vm-73ac6efc-733c-4e68-45cb-5894e414ac73	cf-diego-pivotal	New	05/21/2025	24
74e834e0-9aef-46ee-bbc1-087a17be0fdf	VM Rightsizing	vm-a6bbfaa9-21c7-48b3-468c-088058564e46	cf-diego-pivotal	New	04/25/2025	11
0429080b-d3d0-4e8d-b600-000a34491408	Zombie Resource	vm-8f3ccd93-db54-4493-42ab-803b6e87ccba	cf-diego-pivotal	New	04/18/2025	6
15350622-dbe7-4e07-b715-e7f90f6372bb	Unattached Storage	disk-40e1687a-bfe4-4be6-48f7-d8d742375a7e	cf-diego-pivotal	New	04/18/2025	5

Garden Recommendations:

ID	Recommendation Type	Resource	Sub Account	Status	Created On	Est. Monthly Savings
996f5aed-7950-4ff7-a17d-3f56ce64da60	Unused Static IP Address	cf-garden-windows-dev (us-east1)	cf-garden-windows-dev	New	04/24/2025	43
890f4275-4c2e-4636-9a55-76b76349bfa1	Unattached Storage	disk-4d79fe8a-a55d-43ec-7793-889c512b7d8b	cf-garden-windows-dev	New	05/31/2025	5

[ameowlia]

Long Term Plan

We plan on moving to the shared concourse. Here are the savings I expect...

ARP Concourse VM Costs

GCP Account	Purpose	Size	Past 30 day cost (from Ternary)	Savings if we moved to shared Concourse	Notes
App-Runtime-Platform-WG	HA Proxy concourse	t2d-standard-4	105	105	-
CF-diego-pivotal	Bosh Director + Web x2	e2-medium	30	30	-
CF-diego-pivotal	Bosh jump box	e2-micro	5	5	-
CF-diego-pivotal	DB	e2-standard-2	107	107	-
CF-diego-pivotal	Windows worker	n1-highmem-16	264	264	we don't use it often, but it is expensive to run and the shared concourse already has a windows worker
CF-diego-pivotal	Generic Workers x6	e2-standard-16	2000	???	Given recent changes, they spend 90% of time at ~20% CPU utilization
CF-diego-pivotal	Custom Diego Workers x3	e2-standard-4	105	0	we will keep running these custom workers in our GCP

Guaranteed Savings: $511/mo (and we don't have to maintain our own concourses)
Additional Possible Savings: $0-2000 / depending on how many more workers concourse will need to run. The Concourse WG can also buy CUDs to get this cost down.

[ameowlia]

We recently switched to bbl-envs and have some bugs with our starting/stoping scripts. I am currently putting my effort into making sure that we are not running env VMs when we don't need to. I have my own script that I have been using to monitor this.

$ check_gcp_status_locally
* project 'cf-diego-pivotal' has '0' unattached disks

* project 'app-runtime-platform-wg' has '0' unattached disks

* project 'cf-diego-pivotal' has '10' running VMs
      1 diego-worker-cgroupsv2-worker
      9 vanern-2020-12-04t22-44z

* project 'app-runtime-platform-wg' has '3' running VMs
      1 concourse
      2 diego

* suspicious long running VMs for project 'cf-diego-pivotal'

* suspicious long running VMs for project 'app-runtime-platform-wg'
     diego - vm-bc18ce43-63c2-4a40-6525-e0d90a1b842c - 13 hours
     diego - vm-cb3f8385-ae01-4ffb-528d-486f8ec594c1 - 13 hours

[beyhan]

New optimisation recommendations based on PointFive tooling as discussed during the TOC meeting 8th of July:

ARP:

account_name	name	recommendations	current_cost	potential_savings	resource_name	resource_id	resource_type	region
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.02	0.014776	gdn-linux-release	//storage.googleapis.com/projects/_/buckets/gdn-linux-release	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.52	0.412298	silk-release-blobs	//storage.googleapis.com/projects/_/buckets/silk-release-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.46	0.364662	routing-final-releases	//storage.googleapis.com/projects/_/buckets/routing-final-releases	GCPStorageBucket	us
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.49	0.440389	vm-77e1bd43-a4a9-46d2-71e3-55e8208c1f09	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/8028207624991681722	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.54	0.45	vm-371fdeca-2dba-43d4-449b-091dcec1f9b4	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/342440442858815643	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Inactive GCS Bucket	Delete the bucket if it is no longer in use, ensuring data is backed up beforehand.	0.46	0.455828	routing-final-releases	//storage.googleapis.com/projects/_/buckets/routing-final-releases	GCPStorageBucket	us
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	3.8	3.79	vm-ddc595d4-b8fe-440d-772a-b80efa51b49b	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/5188699729404568724	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.38	0.361743	vm-19249c91-7fbe-4b9e-5a19-9f51c071cc73	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/960373678545255227	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	2.56	2.38	vm-d352662b-9405-42fb-6719-254223963760	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/9048670968139167781	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	2.34	2.32	vm-e84584b9-ee48-40ee-72d9-c8f72c198968	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/1372184213816468301	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.24	0.225794	vm-75632657-f06b-4f7b-76f5-1f17cf898465	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/5855498229651757433	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.82	0.681457	vm-cf17344d-c981-4554-4a5f-9abcaf1042a1	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/4531168750674886725	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.29	0.2395	vm-cb3f8385-ae01-4ffb-528d-486f8ec594c1	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/1432654973972408100	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.42	0.334105	nats-release-blobs	//storage.googleapis.com/projects/_/buckets/nats-release-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	1.59	1.48	vm-cf142e3f-e526-4ae3-50f8-fc0d8de3ed11	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/2856493416359024282	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.74	0.594394	cf-networking-release-blobs	//storage.googleapis.com/projects/_/buckets/cf-networking-release-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.31	0.251321	pcap-release	//storage.googleapis.com/projects/_/buckets/pcap-release	GCPStorageBucket	eu
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.98	0.915287	vm-9861fdd8-5110-43e5-45e6-6507ff471283	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/2289455092158637940	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Inactive GCS Bucket	Delete the bucket if it is no longer in use, ensuring data is backed up beforehand.	0.88	0.875278	silk-candidate-tarballs	//storage.googleapis.com/projects/_/buckets/silk-candidate-tarballs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.94	0.751902	routing-release-blobs	//storage.googleapis.com/projects/_/buckets/routing-release-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.82	0.653558	cf-networking-candidate-tarballs	//storage.googleapis.com/projects/_/buckets/cf-networking-candidate-tarballs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.82	0.681438	vm-93c8f100-f24e-4242-61e9-836908cc243e	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/9141425975216816283	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	2.17	1.93	vm-bc18ce43-63c2-4a40-6525-e0d90a1b842c	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/9088594832344114292	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.99	0.808722	vm-88e0641c-17e4-4feb-7be9-7a27c74a838a	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/2652772268422358104	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Inactive GCS Bucket	Delete the bucket if it is no longer in use, ensuring data is backed up beforehand.	0.31	0.314151	pcap-release	//storage.googleapis.com/projects/_/buckets/pcap-release	GCPStorageBucket	eu
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.49	0.371099	vm-811d16fd-fd5b-4ab9-4b59-e8e061341fea	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/6301018314002120776	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.07	0.065753	vm-86372915-1a37-498d-6ccd-079342bd5b59	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/5806281297423622770	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.07	0.069967	vm-b2e6c979-5c9c-4d6d-6717-9d9e3193d754	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/4957427534495204174	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.08	0.0606888	healthchecker-release-bosh-blobs	//storage.googleapis.com/projects/_/buckets/healthchecker-release-bosh-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	147.03	87.16	concourse	//compute.googleapis.com/projects/869596632845/zones/europe-west3-a/instances/5522770239952380715	GCPComputeInstance	europe-west3
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.6	0.082853	vm-b76ed018-3239-4a99-4066-464a2e9b73b6	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/2688486141259400055	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.63	0.082948	vm-f105a98a-07f6-425b-7a1f-6258e32c0497	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/2652141969086858045	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.1	0.094059	vm-766682d0-5214-48d8-685d-da5a86077e7b	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/3690628579807445855	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Inactive GCS Bucket	Delete the bucket if it is no longer in use, ensuring data is backed up beforehand.	0.04	0.039703	test-log-emitter-blobs	//storage.googleapis.com/projects/_/buckets/test-log-emitter-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.04	0.034635	vm-bf338b1c-c7c1-4c28-40a3-cc585cf2f75c	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/1714997340759535503	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.04	0.0317624	test-log-emitter-blobs	//storage.googleapis.com/projects/_/buckets/test-log-emitter-blobs	GCPStorageBucket	us-east1
App-Runtime-Platform-WG	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.17	0.10833	vm-9dfcc790-846f-42b6-524d-bd5cdbf8c063	//compute.googleapis.com/projects/869596632845/zones/us-central1-a/instances/6592206634130498797	GCPComputeInstance	us-central1
App-Runtime-Platform-WG	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.04	0.0300048	haproxy-boshrelease	//storage.googleapis.com/projects/_/buckets/haproxy-boshrelease	GCPStorageBucket	eu

Diego:

account_name	name	recommendations	current_cost	potential_savings	resource_name	resource_id	resource_type	region
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.02	0.00482	windows-dev-2025	//compute.googleapis.com/projects/627887276226/zones/us-central1-f/instances/8744588305740665965	GCPComputeInstance	us-central1
CF-Diego-pivotal	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.01	0.0085664	tas-journey-runtime-ecosystem	//storage.googleapis.com/projects/_/buckets/tas-journey-runtime-ecosystem	GCPStorageBucket	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	24.12	10.16	manager	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/56703389786382494	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	45.72	45.08	vm-73ac6efc-733c-4e68-45cb-5894e414ac73	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/8620140271184551392	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	45.1	45.08	vm-a85b6f3d-996e-4ab1-7286-93339bbd678a	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/1968280813619289116	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	0.05	0.008341	garden-windows-ci-smb-server	//compute.googleapis.com/projects/627887276226/zones/us-central1-c/instances/2111603971063878447	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	4.15	4.12	vm-8f3ccd93-db54-4493-42ab-803b6e87ccba	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/66153546134760450	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	90.19	90.16	vm-813bc149-bfee-4224-7217-ed7afe006c23	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/436949445856388095	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	22.56	22.54	vm-6506e9b5-27af-40d1-6080-828b094cf58e	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/7847570951356647723	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	363.42	360.65	vm-15419752-dbc3-4316-6531-9b1772e84e6b	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/5341647784009791165	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	361.85	360.65	vm-a6bbfaa9-21c7-48b3-468c-088058564e46	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/5147339559413479091	GCPComputeInstance	us-central1
CF-Diego-pivotal	Inactive GCS Bucket	Delete the bucket if it is no longer in use, ensuring data is backed up beforehand.	0.01	0.010708	tas-journey-runtime-ecosystem	//storage.googleapis.com/projects/_/buckets/tas-journey-runtime-ecosystem	GCPStorageBucket	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	363.05	360.65	vm-f3077717-020c-4ac7-54dc-5b2d7bc9e24e	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/343099548537190077	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	361.85	360.65	vm-18aab4f4-189a-4dac-6432-9a04303841b4	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/1598952517078087347	GCPComputeInstance	us-central1
CF-Diego-pivotal	Suboptimal Compute VM Machine Type	Switch to the more cost-effective machine type based on your usage.	362.11	360.65	vm-d0a1b007-d4ce-4b0f-75b7-27711aa59c30	//compute.googleapis.com/projects/627887276226/zones/us-central1-a/instances/7756025123599546046	GCPComputeInstance	us-central1

Garden:

account_name	name	recommendations	current_cost	potential_savings	resource_name	resource_id	resource_type	region
CF-Garden-Windows-Dev	Missing Autoclass on GCS Bucket	Activate Autoclass for this storage bucket.	0.03	0.0212944	artifacts.cf-garden-windows-dev.appspot.com	//storage.googleapis.com/projects/_/buckets/artifacts.cf-garden-windows-dev.appspot.com	GCPStorageBucket	us
CF-Garden-Windows-Dev	Inactive GCS Bucket	Delete the bucket if it is no longer in use, ensuring data is backed up beforehand.	0.03	0.026618	artifacts.cf-garden-windows-dev.appspot.com	//storage.googleapis.com/projects/_/buckets/artifacts.cf-garden-windows-dev.appspot.com	GCPStorageBucket	us