Add retry mechanism for 502s

[vepatel]

Proposed changes

• Add retry mechanism on 502s during CI test executions

Checklist

Before creating a PR, run through this checklist and mark each as complete.

• I have read the CONTRIBUTING doc
• I have added tests that prove my fix is effective or that my feature works
• I have checked that all unit tests pass after adding my changes
• I have updated necessary documentation
• I have rebased my branch onto main
• I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

[codecov-commenter]

Codecov Report

Merging #3298 (44ebd12) into main (9d94d45) will decrease coverage by 0.02%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main    #3298      +/-   ##
==========================================
- Coverage   52.66%   52.64%   -0.03%     
==========================================
  Files          59       59              
  Lines       16117    16117              
==========================================
- Hits         8488     8484       -4     
- Misses       7345     7347       +2     
- Partials      284      286       +2     

Impacted Files	Coverage Δ
internal/k8s/configuration.go	95.39% <0.00%> (-0.37%)	⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more