@@ -30,11 +30,11 @@ Install the Stackable command line utility xref:management:stackablectl:index.ad
30
30
31
31
The Stackable operators are components that translate the service definitions deployed via Kubernetes into deploy services on the worker nodes. These can be installed on any node that has access to the Kubernetes control plane. In this example we will install them on the controller node.
32
32
33
- Stackable operators can be installed using `stackablectl`. Run the following commands to install ZooKeeper, Kafka and NiFi from the Stackable 23.7 release.
33
+ Stackable operators can be installed using `stackablectl`. Run the following commands to install ZooKeeper, Kafka and NiFi from the Stackable 23.11 release.
34
34
35
35
[source,bash]
36
36
----
37
- stackablectl release install -i commons -i secret -i listener -i zookeeper -i kafka -i nifi 23.7
37
+ stackablectl release install -i commons -i secret -i listener -i zookeeper -i kafka -i nifi 23.11
38
38
----
39
39
40
40
.Using Helm instead
@@ -53,34 +53,26 @@ Install the operators:
53
53
54
54
[source,bash]
55
55
----
56
- helm install zookeeper-operator stackable-stable/zookeeper-operator --version=23.7
57
- helm install kafka-operator stackable-stable/kafka-operator --version=23.7
58
- helm install secret-operator stackable-stable/secret-operator --version=23.7
59
- helm install listener-operator stackable-stable/listener-operator --version=23.7
60
- helm install commons-operator stackable-stable/commons-operator --version=23.7
61
- helm install nifi-operator stackable-stable/nifi-operator --version=23.7
56
+ helm install zookeeper-operator stackable-stable/zookeeper-operator --version=23.11.0
57
+ helm install kafka-operator stackable-stable/kafka-operator --version=23.11.0
58
+ helm install secret-operator stackable-stable/secret-operator --version=23.11.0
59
+ helm install listener-operator stackable-stable/listener-operator --version=23.11.0
60
+ helm install commons-operator stackable-stable/commons-operator --version=23.11.0
61
+ helm install nifi-operator stackable-stable/nifi-operator --version=23.11.0
62
62
----
63
63
====
64
64
65
65
You can check which operators are installed using `stackablectl operator installed`:
66
66
67
67
[source,console]
68
68
----
69
- ┌────────────────────┬─────────┬─────────────────────┬──────────┬──────────────────────────────────────────┐
70
- │ OPERATOR ┆ VERSION ┆ NAMESPACE ┆ STATUS ┆ LAST UPDATED │
71
- ╞════════════════════╪═════════╪═════════════════════╪══════════╪══════════════════════════════════════════╡
72
- │ commons-operator ┆ 23.7.0 ┆ stackable-operators ┆ deployed ┆ 2023-09-26 14:59:10.447836367 +0200 CEST │
73
- ├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
74
- │ kafka-operator ┆ 23.7.0 ┆ stackable-operators ┆ deployed ┆ 2023-09-26 14:59:25.162058457 +0200 CEST │
75
- ├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
76
- │ listener-operator ┆ 23.7.0 ┆ stackable-operators ┆ deployed ┆ 2023-09-26 14:59:30.40162331 +0200 CEST │
77
- ├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
78
- │ nifi-operator ┆ 23.7.0 ┆ stackable-operators ┆ deployed ┆ 2023-09-26 14:59:35.881227443 +0200 CEST │
79
- ├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
80
- │ secret-operator ┆ 23.7.0 ┆ stackable-operators ┆ deployed ┆ 2023-09-26 14:59:44.51273442 +0200 CEST │
81
- ├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
82
- │ zookeeper-operator ┆ 23.7.0 ┆ stackable-operators ┆ deployed ┆ 2023-09-26 14:59:58.196949027 +0200 CEST │
83
- └────────────────────┴─────────┴─────────────────────┴──────────┴──────────────────────────────────────────┘
69
+ OPERATOR VERSION NAMESPACE STATUS LAST UPDATED
70
+ commons 23.11.0 default deployed 2023-11-30 17:58:32.916032854 +0100 CET
71
+ kafka 23.11.0 default deployed 2023-11-30 17:58:55.036115353 +0100 CET
72
+ listener 23.11.0 default deployed 2023-11-30 17:59:18.136775259 +0100 CET
73
+ nifi 23.11.0 default deployed 2023-11-30 17:59:51.927081648 +0100 CET
74
+ secret 23.11.0 default deployed 2023-11-30 18:00:05.060241771 +0100 CET
75
+ zookeeper 23.11.0 default deployed 2023-11-30 18:00:08.425686918 +0100 CET
84
76
----
85
77
86
78
== Deploying Stackable Services
@@ -101,7 +93,7 @@ metadata:
101
93
name: simple-zk
102
94
spec:
103
95
image:
104
- productVersion: " 3.8.1"
96
+ productVersion: 3.8.3
105
97
clusterConfig:
106
98
tls:
107
99
serverSecretClass: null
@@ -136,7 +128,7 @@ metadata:
136
128
name: simple-kafka
137
129
spec:
138
130
image:
139
- productVersion: "3.4.0"
131
+ productVersion: 3.5.1
140
132
clusterConfig:
141
133
zookeeperConfigMapName: simple-kafka-znode
142
134
tls:
@@ -173,53 +165,69 @@ spec:
173
165
clusterRef:
174
166
name: simple-zk
175
167
---
176
- apiVersion: v1
177
- kind: Secret
178
- metadata:
179
- name: nifi-admin-credentials-simple
180
- stringData:
181
- username: admin
182
- password: AdminPassword
183
- ---
184
168
apiVersion: nifi.stackable.tech/v1alpha1
185
169
kind: NifiCluster
186
170
metadata:
187
171
name: simple-nifi
188
172
spec:
189
173
image:
190
- productVersion: "1.21.0"
174
+ productVersion: 1.23.2
191
175
clusterConfig:
192
176
listenerClass: external-unstable
193
177
zookeeperConfigMapName: simple-nifi-znode
194
178
authentication:
195
- method:
196
- singleUser:
197
- adminCredentialsSecret: nifi-admin-credentials-simple
179
+ - authenticationClass: nifi-users
198
180
sensitiveProperties:
199
181
keySecret: nifi-sensitive-property-key
200
- autoGenerate: true
201
182
nodes:
202
183
roleGroups:
203
184
default:
204
185
replicas: 1
186
+ ---
187
+ apiVersion: authentication.stackable.tech/v1alpha1
188
+ kind: AuthenticationClass
189
+ metadata:
190
+ name: nifi-users
191
+ spec:
192
+ provider:
193
+ static:
194
+ userCredentialsSecret:
195
+ name: nifi-admin-credentials
196
+ ---
197
+ apiVersion: v1
198
+ kind: Secret
199
+ metadata:
200
+ name: nifi-admin-credentials
201
+ stringData:
202
+ admin: AdminPassword
203
+ ---
204
+ apiVersion: v1
205
+ kind: Secret
206
+ metadata:
207
+ name: nifi-sensitive-property-key
208
+ stringData:
209
+ nifiSensitivePropsKey: mYsUp3rS3cr3tk3y
205
210
EOF
206
211
----
207
212
208
213
You can check the status of the services using `kubectl get pods`. This will retrieve the status of all pods running in the default namespace.
209
214
210
215
----
211
- NAME READY STATUS RESTARTS AGE
212
- commons-operator-deployment-598c744f6f-gfj2h 1/1 Running 0 15m
213
- kafka-operator-deployment-7c4bd694d5-xjwsj 1/1 Running 0 15m
214
- listener-operator-controller-deployment-5f59496965-4c2xq 2/2 Running 0 14m
215
- listener-operator-node-daemonset-xlcwg 2/2 Running 0 14m
216
- nifi-operator-deployment-748d748487-qg885 1/1 Running 0 15m
217
- secret-operator-daemonset-wr57f 3/3 Running 0 14m
218
- simple-kafka-broker-brokers-0 2/2 Running 0 7m50s
219
- simple-nifi-create-reporting-task-1-21-0-jltpv 0/1 Completed 4 5m13s
220
- simple-nifi-node-default-0 1/1 Running 0 5m13s
221
- simple-zk-server-primary-0 1/1 Running 0 14m
222
- zookeeper-operator-deployment-64fcccc797-pckhf 1/1 Running 0 14m
216
+ NAME READY STATUS RESTARTS AGE
217
+ commons-operator-deployment-5b589f4494-slqx7 1/1 Running 0 14m
218
+ kafka-operator-deployment-5db5d8c846-564pd 1/1 Running 0 14m
219
+ listener-operator-controller-deployment-65f8bbdff4-fz9fh 2/2 Running 0 14m
220
+ listener-operator-node-daemonset-ffjdx 2/2 Running 0 14m
221
+ listener-operator-node-daemonset-rfd6k 2/2 Running 0 14m
222
+ listener-operator-node-daemonset-wtw8j 2/2 Running 0 14m
223
+ nifi-operator-deployment-546fdb6bf8-6zptt 1/1 Running 0 13m
224
+ secret-operator-daemonset-4cqfl 3/3 Running 0 13m
225
+ secret-operator-daemonset-p9579 3/3 Running 0 13m
226
+ secret-operator-daemonset-wktz8 3/3 Running 0 13m
227
+ simple-kafka-broker-brokers-0 2/2 Running 0 12m
228
+ simple-nifi-node-default-0 1/1 Running 0 11m
229
+ simple-zk-server-primary-0 1/1 Running 0 13m
230
+ zookeeper-operator-deployment-7bcdcbb558-xc77h 1/1 Running 0 13m
223
231
----
224
232
225
233
Since this is the first time that each of these services has been deployed to these nodes, it will take some time to download the software from the Stackable repository and deploy the services. Once all the pods are in the running state your cluster is ready to use.
@@ -241,7 +249,7 @@ The shell should connect automatically to the ZooKeeper server running on the po
241
249
242
250
----
243
251
[zk: localhost:2181(CONNECTED) 0] ls /
244
- [znode-81484420-e097-4b13-a121-84f0211b99db , znode-9076785e-39d0-49cc-b067-30be25bf4faa , znode-a4b12f66-48c2-40dc-91d8-a42135eaf371 , zookeeper]
252
+ [znode-17951052-3ffd-4e7a-9cfe-6865f827752d , znode-2d752976-f37c-4baf-a3af-2eed96ba57f5 , znode-f946b36f-a0bc-4d11-93d6-8ac6a321c836 , zookeeper]
245
253
----
246
254
247
255
=== Apache Kafka
@@ -299,8 +307,8 @@ If a password has not been specified for the admin user the Apache NiFi operator
299
307
300
308
[source,bash]
301
309
----
302
- kubectl get secrets nifi-admin-credentials-simple \
303
- -o jsonpath="{.data.password }" | base64 -d && echo
310
+ kubectl get secrets nifi-admin-credentials \
311
+ -o jsonpath="{.data.admin }" | base64 -d && echo
304
312
----
305
313
306
314
Once you have these credentials you can log in and you should see a blank NiFi canvas.
0 commit comments