3,675 questions
2
votes
1
answer
34
views
Facing connectivity issue on this traditional compose file on podman, unbale to rectify what is exact issue
Image details:
Service
Container ID
Image
Status
Ports
Name
Zookeeper
17025a6f1e4b
confluentinc/cp-zookeeper:latest
Up 18s
2181,2888,3888
composefiles_zookeeper_1
Kafka
4a0964b3f368
confluentinc/cp-...
0
votes
0
answers
29
views
Magento 2.4.2 with Zookeeper lock provider throws ZookeeperNoNodeException(code: -101): no node
We recently switched the lock provider in our Magento 2.4.2 devstack from the default database to zookeeper. Initially, everything works fine, but after some time, Magento starts throwing the ...
0
votes
1
answer
72
views
Kafka Zookeeper still using NIOServerCnxnFactory, also with serverCnxnFactory "org.apache.zookeeper.server.NettyServerCnxnFactory" [closed]
Kafka Zookeeper insists on using NIOServerCnxnFactory as the connection factory, even after setting serverCnxnFactory=org.apache.zookeeper.server.NettyServerCnxnFactory.
The grep log for this issue:
[...
-3
votes
1
answer
57
views
Solr reporting wrong host-IP to Zookeper [closed]
I have Solr and Zookeeper both running in a Docker-Container on the same machine. When everything stays within the ecosystem it works quite well. However I need to integrate it with another tool that ...
0
votes
0
answers
54
views
ActiveMQ artemis HA + Zookeeper
I'm about to set up Artemis HA as primary\backup, with connection to zookeeper as a curator. I can see that my Artemis instances are connected to ZOO:
"connections": [
{
"...
0
votes
0
answers
72
views
How to fix kafka connection to zookeeper (kubernetes)?
I want to start kafka + zookeeper with kubernetes using docker desktop but I have an error:
Unable to canonicalize address zookeeper/:2181 because it's not resolvable
my yaml:
apiVersion: v1
kind: ...
0
votes
0
answers
33
views
Order of Child node removed and added event in zookeeper
I am watching the child nodes using curator PathChildrenCache.
I am receiving the child node added/removed events but the order is not guaranteed across Zondes.
e.g:
Below 3 steps are performed in ...
0
votes
1
answer
93
views
ZooKeeper with ECS ServiceConnect: ConnectionLossException: KeeperErrorCode = ConnectionLoss
I have a docker compose stack that includes ZooKeeper. It has worked beautifully for years.
zoo:
container_name: zoo
image: public.ecr.aws/docker/library/zookeeper:3.9.3
restart: unless-...
0
votes
0
answers
39
views
Zookeeper node not able to copy snapshots from existing leader
I am trying to add new nodes to my existing Zookeeper cluster (v3.4.14). The strategy is to add nodes with newer version (3.5.x) and add it one by one to old cluster, sync data and phase out older ...
0
votes
1
answer
105
views
Pysolr JWT Token can't be passed as authentication
Structure
SOLR v. 9.8.0, 3 Nodes
Zookeeper v. 3.9.3, 3 Instances
Pysolr latest
The SOLR and Zookeeper Nodes run in a docker environment.
The Solr Authentication is a MultiAuthPlugin with the ...
0
votes
0
answers
54
views
Azure functions previously known cluster id issue on Kafka Trigger
I have an Azure Function app and have a kafka trigger which works on other environments. I get this error when trying to to use a new cluster locally in a docker container. The cluster id is ...
0
votes
0
answers
137
views
Enabling Zookeeper ACL Using Digest Scheme in a Three Nodes Kafka Zookeeper Cluster
I am trying to enable zookeeper kafka authentication using Digest but it failing to come up. My configuration changes.
Zookeeper version : 3.8.4
zookeeper-jaas.conf
Server {
org.apache.zookeeper....
0
votes
0
answers
31
views
Solr Instance is running in cloud mode
Solr(7.7.2) and Zookeeper version is installed in the corresponding servers via octopus script.
Both Solr and Zookeeper is running invidually.
Solr is running in the port number 8983.
Zookeeper is ...
1
vote
0
answers
27
views
In which cases Multi-Paxos couldn't support Primary Order required in Primary-Backup replication system?
In paper Zab: High-performance broadcast for primary-backup systems, the figure 1 shows that Paxos could violate primary order of requests.
I understand the result will be like that if each proposer ...
0
votes
0
answers
162
views
How to verify the state of Kafka Migration from ZooKeeper to KRaft
I’m in the middle of migrating from Zookeeper to KRaft in my Kafka cluster running on Kubernetes. Following the official Zookeeper to KRaft migration guide, I provisioned the KRaft controller quorum, ...
1
vote
0
answers
485
views
Trying to setup Kafka on windows and getting 'wmic' is not recognized error
I am trying to setup Kafka (version - kafka_2.13-3.9.0.tgz) on windows 11 and zookeeper is running smoothly on windows but kafka server is not starting up..
When i try to execute kafka-server-start....
0
votes
0
answers
94
views
Docker containers doesnt start after docker-compose - kafka , zookeeper and debezium
Iam new to docker, I have utilized almost 7.7 GB of my 8 GB memory. I have to runkafka-ui , schema registry, kafka , zookeeper , debzium , pyspark for an etl process. I couldnt run all of them ...
0
votes
0
answers
14
views
why zookeeper creates znode multiple times
Analysis of the ZooKeeper transaction log (version-2/log.1) reveals a pattern where a znode is initially created, subsequently deleted after a 3-second interval, and then recreated approximately 5 ...
0
votes
2
answers
174
views
Kafka consumer is missing messages during deployment
My consumers are inherited from the BasicKafkaConsumerV2. During deployments when the pods are rotating I am missing few messages which is visible from the offsets printed after the manual commit().
...
-1
votes
1
answer
274
views
Zookeeper Startup Failed: Permission Denied for Log Files:
I'm trying to set up a Kafka producer in a Spring Boot application to send messages to a specific topic. I'm getting a SerializationException. I've checked my serializer and the schema of the messages,...
0
votes
2
answers
1k
views
Need to run kafka-storage.sh on every broker and controller [closed]
We've been running Kafka with Zookeeper for years. The setup was to form Zookeeper cluster and then let brokers connect to it. Everything in Puppet. No extra steps and after some restarts cluster ...
1
vote
0
answers
388
views
Facing error while Enabling SSL in SOLR 9.6.1 with Zookeeper 3.8.1
I'm using SOLR with zookeeper in Ubuntu 24.04.1 server, installed SOLR with 1 shard, 2 replicas and 3nodes of zookeeper(localhost) and all are running in same server with basic solr authentication. ...
1
vote
0
answers
66
views
Ways to optimize zookeeper znode throughput
For reasons, I am trying to write a program to maximize Zookeeper throughput of znode creation. Here is the rust program I have currently:
#![allow(dead_code)]
use std::sync::atomic::{AtomicUsize, ...
0
votes
1
answer
125
views
Zookeeper Confluent Kafka 'Error opening file zookeeper-gc.log' when Running Confluent
I'm building a Kafka Application on Windows Subsystem for Linux 2 (WSL2).
I'm using Zookeeper 3.5.8, confluent-6.1.0 and java openjdk version 17.0.12.
I successfully installed all the above platforms ...
0
votes
1
answer
481
views
Zookeeper unimplemented error after upgrading to jdk 17
Objective
I am trying to migrate my application from jdk 11 to 17.
Issue
After migrating to jdk17, i got the error mentioned here (Unable to canonicalize address error) - Zookeeper connection error.
...
0
votes
1
answer
458
views
Unable to canonicalize address 127.0.0.1/<unresolved>:2181 because it's not resolvable
2024-09-12 10:16:28.896 INFO 18540 --- [ main] o.a.d.c.d.DefaultApplicationDeployer : [DUBBO] use registry as config-center: <dubbo:config-center highestPriority="false" ...
0
votes
1
answer
246
views
Getting "Cluster not found/not ready. Expected node '/aliases.json' does not exist." error on Solr Cloud
We are trying to upgarde to Solr 9.6.1 and Zookeeper 3.7.1. But when connecting to Solr from Java using SolrJ Api we are getting below error.
Cannot connect to cluster at 172.23.152.117:2181: cluster ...
0
votes
0
answers
145
views
Set up Zookeeper Stretch cluster in Kubernetes environment
I have one requirement to set up Kafka stretch cluster (we are not using confluent) in 3 Kubernetes environments. Kubernetes clusters will be independent, and they are NOT stretched.
Problem is that ...
0
votes
2
answers
543
views
Spark Executor Fails to Connect to Driver in Cluster Standalone mode: "Connection refused: hostname/ip:randomport"
I'm setting up a Spark cluster (standalone mode) with ZooKeeper for high availability. I have 2 master nodes (s1, s2) and 3 worker nodes (s3, s4, s5). When I try to run a Spark job (even a simple ...
0
votes
1
answer
228
views
kafka broker immediately shuts down upon starting
We are running a kafka cluster of 6 brokers. 5 of the brokers seem to be totally fine, but when we turn on the 6th one it causes lag and we see the below in the logs. Any assistance into what could be ...
-1
votes
1
answer
76
views
Kafka broker does not receive message from python producer
Hello i use the following configuration for Kafka using docker compose
compose_kafka.yml
version: '3'
services:
zookeeper:
image: wurstmeister/zookeeper
container_name: zookeeper
ports:
...
0
votes
0
answers
174
views
Getting the error, while creating the topic in Kafka server? ERROR Exiting JVM with code 1
I'm encountering the following error: ERROR Exiting JVM with code 1 (org.apache.zookeeper.util.ServiceUtils) when attempting to create a topic on a Kafka server running on Ubuntu. This issue occurs ...
0
votes
0
answers
56
views
CMAK has zero brokers
I am trying to create a topic after creating a cluster within CMAK ( https://medium.com/simform-engineering/set-up-kafka-ecosystem-on-local-machine-1a00a436c0ba ).
version: '3'
services:
zookeeper:
...
-1
votes
1
answer
273
views
CMAK Yikes! Ask timed out on [ActorSelection[Anchor(akka://kafka-manager-system/)
i am trying to implement apache kafka on docker based on this article https://medium.com/simform-engineering/set-up-kafka-ecosystem-on-local-machine-1a00a436c0ba.
I have altered the yml compose file ...
1
vote
0
answers
37
views
Getting IOException when used basic authentication on the time of indexing in Solr 8.9.0
I have install solr 8.9.0 in cloud mode. I have created 2 shards. I have enabled the Basic Authentication using security.json. not use the authorization part.
security.json
{
"authentication&...
0
votes
1
answer
265
views
Performing SASL (with SSL) implementation with Kafka 2.8.1 version
I am encountering the following issue while implementing SASL (with SSL) with Kafka version 2.8.1 on Windows. Any assistance would be appreciated.
Kafka Server Logs with ERROR:
[2024-08-01 10:45:09,...
0
votes
1
answer
896
views
zookeeper large memory size
I have a zk cluster set up , however, I ran into errors:
in zookeeper.properties, I have jute.maxbuffer=1073741824
But in zk logs during start up, I've got
2024-07-09 14:12:58,105 [myid:] - INFO [...
1
vote
1
answer
136
views
error in linking zookeeper-client-c: unresolved symbols
so i have a simple module in C++ which uses some of the zookeeper-client-c API, particularly the functions:
zoo_exists, zoo_create, zoo_get_children, zoo_get, zookeeper_init, zookeeper_close
and ...
1
vote
0
answers
241
views
kafka broker restart failed without me knowing why
I'm facing an issue with my 3-node Kafka cluster, and perhaps you can help me troubleshoot.
Several times a day, I notice that my Kafka service restarts on my servers, and I'm struggling to understand ...
0
votes
1
answer
79
views
Clone a Kafka / ZooKeeper cluster for testing
I have started at a new company, and they only have two environments, one is a test environment and the other is a Prod environment. In the test environment, lots of development teams are using this ...
1
vote
0
answers
156
views
labs.play-with-docker.com Session timed out! Your session has expired and all of your instances have been deleted
When I use an online lab environment through my browser: https://labs.play-with-docker.com/, I can start the container when I execute the docker-compose.yml file through the docker-compose up -d ...
0
votes
1
answer
93
views
Where is Cassandra useful if it has no concept of Isolation Levels?
I read here that Cassandra has no concept of Isolation Levels and that you need to use External Locking(say Zookeeper) to enforce any kind of locking, which will magnify the latency manyfold.
I wonder,...
1
vote
0
answers
229
views
About ZK with snapshot startup failure problem
zk version: 3.8.3
3.8.3-6ad6d364c7c0bcf0de452d54ebefa3058098ab56, built on 2023-10-05 10:34 UTC
first of all
my zk cluster crushed, and i want to findout the reason.
i dump the snapshot and datalog ...
0
votes
0
answers
323
views
Multiple instances of springboot running on same database - best way to handle concurrent db access
We have an environment where we run multiple spring boot web services all linked to a single database schema. All of them are registered to Eureka and a gateway is responsible of accepting client ...
0
votes
1
answer
101
views
Invalid version (expected 2, but 31) or the data in not in 'javabin' format for Solr8.11.3
Upgrading my Solrj to 8.11.3. Using a java application that uses solr-solrj-8.11.3 to communicate to Solr. Getting the below error.
Invalid version (expected 2, but 31) or the data in not in 'javabin' ...
2
votes
0
answers
353
views
Flink job crashing due to OutOfMemoryError after ZooKeeper leadership change
I recently introduced ZooKeeper to my Flink Job for Checkpointing and High Availability. Things were running smoothly until a ZooKeeper leadership changed and the JobManager disconnected. The pattern ...
1
vote
0
answers
170
views
Kafka with Zookeeper connections issue on EKS
I am quite new to Kafka.
I want to deploy Kafka with Zookeeper on EKS cluster. [without Kraft]
I am using bitnami helm charts for the same.
Here are followed steps:
Step1:
I have deployed zookeeper ...
0
votes
1
answer
129
views
Kafka consumerdoesn't receive messages in docker
I am creating a very basic consumer/producer setup for Kafka. I am using both Zookeper and Kafka with a Docker compose. Both seem to be connecting but when it comes to produce or consume, nothing ...
0
votes
0
answers
78
views
Getting NoClassDefFound Error org/apache/zookeeper/KeeperException$NoNodeException while using solr-solrj-8.11.3
I have a java app which uses solrj jar to communicate to apache solr 8 and 9. Recently due to security vulnerabilities in solr-solrj-6.6.1.jar i upgraded to solr-solrj-8.11.3.jar. Compilation was ...
0
votes
0
answers
282
views
Error: Could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain
While starting the server for Zookeeper in windows 10, getting this error
Error: Could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain
Confluent community version : 7.6.1
...