apache kafka - worker not recovered - Current config state offset 5 is behind group assignment 20, reading to end of config log -


i using 3 nodes kafka connect cluster write data source to kafka topic , topic destination. works fine in distributed mode when 1 of worker stopped , restarted getting below message.

[2017-09-13 23:48:44,519] warn catching assignment's config offset. (org.apache.kafka.connect.runtime.distributed.distributedherder:741) [2017-09-13 23:48:44,519] info current config state offset 5 behind group assignment 20, reading end of config log (org.apache.kafka.connect.runtime.distributed.distributedherder:785) [2017-09-13 23:48:45,018] info finished reading end of log , updated config snapshot, new config log offset: 5 (org.apache.kafka.connect.runtime.distributed.distributedherder:789) [2017-09-13 23:48:45,018] info current config state offset 5 not match group assignment 20. forcing rebalance. (org.apache.kafka.connect.runtime.distributed.distributedherder:765) [2017-09-13 23:48:45,018] info rebalance started (org.apache.kafka.connect.runtime.distributed.distributedherder:1187) [2017-09-13 23:48:45,018] info wasn't unable resume work after last rebalance, can skip stopping connectors , tasks (org.apache.kafka.connect.runtime.distributed.distributedherder:1219) [2017-09-13 23:48:45,018] info (re-)joining group connect-cluster (org.apache.kafka.clients.consumer.internals.abstractcoordinator:432) [2017-09-13 23:48:45,023] info joined group connect-cluster generation 38 (org.apache.kafka.clients.consumer.internals.abstractcoordinator:399) [2017-09-13 23:48:45,023] info joined group , got assignment: assignment{error=0, leader='connect-1-e51c1e8b-c95a-406b-8c56-2a0d4fc432f6', leaderurl='http://10.10.10.10:8083/', offset=20, connectorids=[], taskids=[oracle_jdbc_sink_test-0]} (org.apache.kafka.connect.runtime.distributed.distributedherder:1166) [2017-09-13 23:48:45,023] warn catching assignment's config offset. (org.apache.kafka.connect.runtime.distributed.distributedherder:741) [2017-09-13 23:48:45,023] info current config state offset 5 behind group assignment 20, reading end of config log (org.apache.kafka.connect.runtime.distributed.distributedherder:785) [2017-09-13 23:48:45,535] info finished reading end of log , updated config snapshot, new config log offset: 5 (org.apache.kafka.connect.runtime.distributed.distributedherder:789) [2017-09-13 23:48:45,535] info current config state offset 5 not match group assignment 20. forcing rebalance. (org.apache.kafka.connect.runtime.distributed.distributedherder:765) [2017-09-13 23:48:45,535] info rebalance started (org.apache.kafka.connect.runtime.distributed.distributedherder:1187) [2017-09-13 23:48:45,535] info wasn't unable resume work after last rebalance, can skip stopping connectors , tasks (org.apache.kafka.connect.runtime.distributed.distributedherder:1219) [2017-09-13 23:48:45,535] info (re-)joining group connect-cluster (org.apache.kafka.clients.consumer.internals.abstractcoordinator:432) [2017-09-13 23:48:45,540] info joined group connect-cluster generation 38 (org.apache.kafka.clients.consumer.internals.abstractcoordinator:399) [2017-09-13 23:48:45,540] info joined group , got assignment: assignment{error=0, leader='connect-1-e51c1e8b-c95a-406b-8c56-2a0d4fc432f6', leaderurl='http://10.10.10.10:8083/', offset=20, connectorids=[], taskids=[oracle_jdbc_sink_test-0]} (org.apache.kafka.connect.runtime.distributed.distributedherder:1166) [2017-09-13 23:48:45,540] warn catching assignment's config offset. (org.apache.kafka.connect.runtime.distributed.distributedherder:741) [2017-09-13 23:48:45,540] info current config state offset 5 behind group assignment 20, reading end of config log (org.apache.kafka.connect.runtime.distributed.distributedherder:785) [2017-09-13 23:48:46,042] info finished reading end of log , updated config snapshot, new config log offset: 5 (org.apache.kafka.connect.runtime.distributed.distributedherder:789) [2017-09-13 23:48:46,042] info current config state offset 5 not match group assignment 20. forcing rebalance. (org.apache.kafka.connect.runtime.distributed.distributedherder:765) [2017-09-13 23:48:46,042] info rebalance started (org.apache.kafka.connect.runtime.distributed.distributedherder:1187) [2017-09-13 23:48:46,042] info wasn't unable resume work after last rebalance, can skip stopping connectors , tasks (org.apache.kafka.connect.runtime.distributed.distributedherder:1219) 


Comments

Popular posts from this blog

ZeroMQ on Windows, with Qt Creator -

unity3d - Unity SceneManager.LoadScene quits application -

python - Error while using APScheduler: 'NoneType' object has no attribute 'now' -