Apache Kafka is a distributed streaming platform designed to store and process high-throughput data streams.

learn more…| top users | synonyms (1)|apache kafka jobs

0
votes
1answer
12 views

Kafka design topic/partitions

I am considering Kafka to stream updates from the back-end to the front-end applications. - Data streams are specific to a user requests, so each request will generate a stream in the back-end. - ...
0
votes
1answer
11 views

Kafka broker throwing ConfigException Invalid value configuration log.segment.bytes: Not a number of type INT

I have a single node kafka broker and single node zookeeper with the server.properties like below broker.id=0num.network.threads=3num.io.threads=8socket.send.buffer.bytes=102400socket.receive....
1
vote
1answer
16 views

How to do the transformations in Kafka (PostgreSQL-> Red shift )

I'm new to Kafka/AWS.My requirement to load data's from several sources into DW(Redshift).One of my sources is PostgreSQL. I found a good article using Kafka to Sync data into Redshift.This ...
0
votes
0answers
10 views

Missing records when using EventTime in Flink

I'm trying to read all of the records from a Kafka Topic in Flink. With the following setup it works fine and Flink gets all of the 45k records:val env=StreamExecutionEnvironment....
1
vote
1answer
11 views

Can we create kafka time windowed stream from historical data?

I have some historical data, each record has their timestamp. I would like to read them and feed them into kafka topic, and use kafka stream to process them in a time windowed manner.Now the ...
1
vote
1answer
18 views

How to shift back the offset of a topic within a stable Kafka consumer group?

I try to shift back the offset of topic within consumer group using following command:bin/kafka-consumer-groups.sh --bootstrap-server loclahost:9092 --group xxx-0 --topic schedule-changed --reset-...
0
votes
1answer
17 views

Kafka Offsets out of range

I'm writing a program in scala for spark streaming connection with kafka and I'm getting the following error:18/02/19 12:31:39 ERROR Executor: Exception in task 0.0 in stage 3.0 (TID 39)org.apache....
0
votes
0answers
10 views

Issue with filebeat kafka output lz4 compression

I am trying to setup filebeat (6.2) with kafka output using lz4 compression, but always getting error asERR Invalid kafka configuration: kafka: invalid configuration (lz4 compression requires ...
1
vote
1answer
11 views

Failed to start broker after enabling Zookeeper Authentication

Started Zookeeper with the following properties ie zookeeper.properties dataDir=/tmp/zookeepeeer clientPort=2186 maxClientCnxns=0 auto.offset.reset=smallest ...
0
votes
0answers
11 views

Apache Kafka: …StringDeserializer is not an instance of …Deserializer

In my simple application i am trying to instantiate a KafkaConsumer my code is nearly a copy of the code from javadoc ("Automatic Offset Committing"):@Slf4jpublic class MyKafkaConsumer {...
0
votes
0answers
8 views

Spark Yarn Remote Submit

Currently I'm working on spark-streaming project. Just starting, and I am still newbie in spark-kafka-yarn-cloudera. To try (or to see) the result of the program, currently I have to build jar of the ...
0
votes
0answers
18 views

kafka controller broker is unable to create a topic

I am using a dockerized static Kafka cluster having 3 brokers. The problem with this cluster is that the controller node is not allowing to create a topic if all the brokers are running on the same ...
0
votes
0answers
21 views

Hyperledger fabric first network not working by kafka and using TLS

I try to run First network sample (v1.1.0-preview) from official docs with kafka orderer type. I did the change exactly as what is done in this post: Hyperledger fabric first network not working with ...
-5
votes
0answers
20 views

kafka -python liberary is pure python or implemented in C [on hold]

Hi all,my question is if kafka-python library a pure python or have some C coding?
-2
votes
1answer
11 views

Connect kafka to jdbc database

Can someone show me how to connect my kafka server to a jdbc postgresql database and retrieve data from it ? all the tutorials on the internet got me more confused !

153050per page
angop.ao, elkhabar.com, noa.al, afghanpaper.com, bbc.com, time.com, cdc.gov, nih.gov, xnxx.com, github.com,