Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
a148cef
fix: increase a http timeout
aburlutskiy May 26, 2021
81389e6
fix: change the name of docker image
aburlutskiy May 26, 2021
4863af5
chore: add one spare TM node
aburlutskiy Jun 29, 2021
faf241b
feat: make bluegreen deployment automatic based on time (#2)
aburlutskiy Sep 23, 2021
4d60a94
feat: integrate with HPA (#3)
aburlutskiy Oct 12, 2021
48ccb38
chore: some changes related with logging
aburlutskiy Oct 12, 2021
478bf49
doc: fix description in crd.md for parallelism field
aburlutskiy Nov 2, 2021
e8471a8
fix: address a data race in flinkapplication reconciler (#4)
aburlutskiy Nov 3, 2021
23f719b
fix: ignore last-applied-configuration to calculate a hash (#5)
aburlutskiy Nov 3, 2021
ddac92e
feat: introduce new field initialParallelism (#6)
aburlutskiy Nov 3, 2021
ac93445
fix: add an ability to ignore changes if app is DeployFailed
aburlutskiy Nov 18, 2021
428b225
chore: use initialParallelism within wordcount application
aburlutskiy Nov 26, 2021
90601c6
chore: use wordcount image of ec
aburlutskiy Nov 26, 2021
f5023fe
chore: set period to 600 in hpa
aburlutskiy Nov 26, 2021
861ae6f
chore: comply Google LogEntry format for fields: message, severity at…
aburlutskiy Dec 6, 2021
7121fb5
fix: address some logic issues in flink-state-machine (#9)
aburlutskiy Dec 6, 2021
b7c9e0b
fix: add reconciler's loop inside operator (#8)
aburlutskiy Dec 16, 2021
1fd179a
fix: use correct image name
aburlutskiy Dec 16, 2021
80dedc9
fix: set type of TeardownCompleted event normal
aburlutskiy Dec 16, 2021
86d0cc4
fix: check if flinkapplication doesn't exist
aburlutskiy Jan 17, 2022
d5f2bbe
fix: retry if taking a savepoint failed
aburlutskiy Jan 19, 2022
4137ff0
feat: bump flink to 1.13.6 from 1.9.1 in wordcount example
aburlutskiy Mar 16, 2022
f9428ee
feat: expose K8s HA properties
aburlutskiy Mar 24, 2022
2f8c9ba
increase time in dual running state to 15 minutes (#11)
adam-lally Oct 7, 2022
6cf6c48
increase time limit for canceling new cluster during blue/green trans…
adam-lally Oct 10, 2022
1d29dee
build and deploy instructions (#13)
adam-lally Oct 10, 2022
9c572cd
Use working crd (#14)
olegy2008 Nov 8, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions README_EC.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# Instructions for building and deploying a new image


In all the following replace `<HASH>` with latest commit hash.


## Build and push new image

```
docker build -t us-east4-docker.pkg.dev/elementalcognition-app-source/docker-all/lyft/flinkk8soperator:<HASH> --progress=plain .
```

```
docker push us-east4-docker.pkg.dev/elementalcognition-app-source/docker-all/lyft/flinkk8soperator:<HASH>
```

## Edit the deployment directly, for testing
```
kubectl edit deploy lyft-flink-flink-operator -n lyft-flink-operator
```

And change the previous hash to the new one (I changed two locations - one in the image name and one elsewhere).

## Update the infrastructure repo

Once changes are tested, to make them permanent, merge a PR in the infrastrucutre repo, for example:
https://github.com/ElementalCognition/infrastructure/commit/875ed9c6f657300d2ca221ff11c610d63368e918


11 changes: 11 additions & 0 deletions cmd/flinkk8soperator/cmd/root.go
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ import (
"context"
"flag"
"fmt"
"github.com/sirupsen/logrus"
"os"
"strings"

Expand Down Expand Up @@ -75,6 +76,16 @@ func init() {
// allows `$ flinkoperator --logtostderr` to work
klog.InitFlags(nil)
pflag.CommandLine.AddGoFlagSet(flag.CommandLine)

logrus.SetFormatter(&logrus.JSONFormatter{
FieldMap: logrus.FieldMap{
logrus.FieldKeyTime: "timestamp",
logrus.FieldKeyLevel: "severity",
logrus.FieldKeyMsg: "message",
logrus.FieldKeyFunc: "logName",
},
})

err := flag.CommandLine.Parse([]string{})
if err != nil {
logAndExit(err)
Expand Down
Loading