Invalid offsets on successful delivery of message with 0.11.3

[koushikchitta]

With 0.11.3 version I see offsets as Invalid (-1001) for majority of messages on successful delivery of message.
Works fine with 0.11.1 version.

Below is output snippet
(Offset in the last column)
3/7/2018 12:54:59.704,INFO,-1001
3/7/2018 12:54:59.720,INFO,-1001
3/7/2018 12:54:59.720,INFO,-1001
3/7/2018 12:54:59.720,INFO,-1001
3/7/2018 12:54:59.720,INFO,-1001
3/7/2018 12:54:59.735,INFO,-1001
3/7/2018 12:54:59.735,INFO,-1001
3/7/2018 12:54:59.735,INFO,511462
3/7/2018 12:54:59.735,INFO,-1001
3/7/2018 12:54:59.783,INFO,-1001
3/7/2018 12:54:59.783,INFO,503620

How to reproduce

private void SendMessages(string topic, long messageCount)
        {
            string payload = RandomString(1000);
            Int64 currentMessageCount = 0;
            using (var producer = new Producer<int, string>(getConfig(), new IntSerializer(), new StringSerializer(Encoding.UTF8)))
            {
                while (currentMessageCount < messageCount)
                {
                    try
                    {
                        // send messages for all listed topics
                        int keyCount = 0;
                        while (keyCount < 25 * 10000 && currentMessageCount < messageCount)
                        {
                            var deliveryReport = producer.ProduceAsync(topic, keyCount, payload);
                            keyCount++;

                            deliveryReport.ContinueWith(task =>
                            {
                                if (!task.Result.Error.HasError)
                                {
                                    logger.Info(task.Result.Key + "," + task.Result.Value + "," + task.Result.Offset.Value);
                                    Interlocked.Increment(ref currentMessageCount);
                                }else
                                {
                                    logger.Info(task.Result.Error);
                                }
                            });
                        }
                    }
                    catch (Exception exception)
                    {
                        logger.Error(exception);
                    }
                    finally
                    {
                        producer.Flush(TimeSpan.FromMilliseconds(100));
                    }
                }
                Console.WriteLine(producer.Flush(TimeSpan.FromSeconds(30)));
                Thread.Sleep(180000);
            }
        }

Debug logs

7|2018-03-07 13:06:53.259|rdkafka#producer-1|STATE| [thrd:10.27.190.125:9092/3]: 10.27.190.125:9092/3: Broker changed state APIVERSION_QUERY -> UP
7|2018-03-07 13:06:53.213|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature MsgVer1: Produce (2..2) supported by broker
7|2018-03-07 13:06:53.228|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.259|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: OffsetCommit (1..2) supported by broker
7|2018-03-07 13:06:53.244|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature BrokerBalancedConsumer: OffsetCommit (1..2) supported by broker
7|2018-03-07 13:06:53.259|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature BrokerBalancedConsumer: OffsetFetch (1..1) supported by broker
7|2018-03-07 13:06:53.259|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature BrokerBalancedConsumer: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.259|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature BrokerBalancedConsumer: SyncGroup (0..0) supported by broker
7|2018-03-07 13:06:53.275|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature BrokerBalancedConsumer: Heartbeat (0..0) supported by broker
7|2018-03-07 13:06:53.228|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature BrokerGroupCoordinator
7|2018-03-07 13:06:53.259|rdkafka#producer-1|BROADCAST| [thrd:10.27.190.125:9092/3]: Broadcasting state change
7|2018-03-07 13:06:53.259|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature MsgVer1: Fetch (2..2) supported by broker
7|2018-03-07 13:06:53.259|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: OffsetFetch (1..1) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: SyncGroup (0..0) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: Heartbeat (0..0) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature BrokerBalancedConsumer: LeaveGroup (0..0) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Enabling feature BrokerBalancedConsumer
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature ThrottleTime: Produce (1..2) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature ThrottleTime: Fetch (1..2) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Enabling feature ThrottleTime
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature Sasl: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: OffsetCommit (1..2) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: OffsetFetch (1..1) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: SyncGroup (0..0) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: Heartbeat (0..0) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature BrokerBalancedConsumer: LeaveGroup (0..0) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature BrokerBalancedConsumer
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature ThrottleTime: Produce (1..2) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature ThrottleTime: Fetch (1..2) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature ThrottleTime
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature Sasl: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature Sasl
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature SaslHandshake: SaslHandshake (0..0) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature SaslHandshake
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature LZ4: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature LZ4
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6:  Feature OffsetTime: Offset (1..1) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Enabling feature OffsetTime
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature BrokerBalancedConsumer: LeaveGroup (0..0) supported by broker
7|2018-03-07 13:06:53.338|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Enabling feature BrokerBalancedConsumer
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature ThrottleTime: Produce (1..2) supported by broker
7|2018-03-07 13:06:53.306|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature MsgVer1
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature MsgVer2: Produce (3..3) NOT supported by broker
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature MsgVer2: Fetch (4..4) NOT supported by broker
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Disabling feature MsgVer2
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature ApiVersion: ApiVersion (0..0) supported by broker
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature ApiVersion
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerGroupCoordinator: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature BrokerGroupCoordinator
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.322|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Enabling feature Sasl
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature SaslHandshake: SaslHandshake (0..0) supported by broker
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Enabling feature SaslHandshake
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature LZ4: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Enabling feature LZ4
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9:  Feature OffsetTime: Offset (1..1) supported by broker
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Enabling feature OffsetTime
7|2018-03-07 13:06:53.369|rdkafka#producer-1|FEATURE| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4,OffsetTime
7|2018-03-07 13:06:53.369|rdkafka#producer-1|STATE| [thrd:10.27.190.136:9092/9]: 10.27.190.136:9092/9: Broker changed state APIVERSION_QUERY -> UP
7|2018-03-07 13:06:53.369|rdkafka#producer-1|BROADCAST| [thrd:10.27.190.136:9092/9]: Broadcasting state change
7|2018-03-07 13:06:53.338|rdkafka#producer-1|FEATURE| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4,OffsetTime
7|2018-03-07 13:06:53.369|rdkafka#producer-1|STATE| [thrd:10.27.190.128:9092/6]: 10.27.190.128:9092/6: Broker changed state APIVERSION_QUERY -> UP
7|2018-03-07 13:06:53.369|rdkafka#producer-1|BROADCAST| [thrd:10.27.190.128:9092/6]: Broadcasting state change
7|2018-03-07 13:06:53.353|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature ThrottleTime: Fetch (1..2) supported by broker
7|2018-03-07 13:06:53.384|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Enabling feature ThrottleTime
7|2018-03-07 13:06:53.384|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature Sasl: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.384|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Enabling feature Sasl
7|2018-03-07 13:06:53.384|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature SaslHandshake: SaslHandshake (0..0) supported by broker
7|2018-03-07 13:06:53.384|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Enabling feature SaslHandshake
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature LZ4: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Enabling feature LZ4
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4:  Feature OffsetTime: Offset (1..1) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Enabling feature OffsetTime
7|2018-03-07 13:06:53.400|rdkafka#producer-1|FEATURE| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4,OffsetTime
7|2018-03-07 13:06:53.400|rdkafka#producer-1|STATE| [thrd:10.27.190.126:9092/4]: 10.27.190.126:9092/4: Broker changed state APIVERSION_QUERY -> UP
7|2018-03-07 13:06:53.400|rdkafka#producer-1|BROADCAST| [thrd:10.27.190.126:9092/4]: Broadcasting state change
7|2018-03-07 13:06:53.400|rdkafka#producer-1|METADATA| [thrd:main]: Requesting metadata for 1/1 topics: refresh unavailable topics
7|2018-03-07 13:06:53.400|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7: Request metadata for 1 topic(s): refresh unavailable topics
7|2018-03-07 13:06:53.369|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: OffsetCommit (1..2) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: OffsetFetch (1..1) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: SyncGroup (0..0) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: Heartbeat (0..0) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature BrokerBalancedConsumer: LeaveGroup (0..0) supported by broker
7|2018-03-07 13:06:53.416|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature BrokerBalancedConsumer
7|2018-03-07 13:06:53.416|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature ThrottleTime: Produce (1..2) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|METADATA| [thrd:10.27.190.136:9092/9]: Skipping metadata refresh of 1 topic(s): connected: already being requested
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature ThrottleTime: Fetch (1..2) supported by broker
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature ThrottleTime
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature Sasl: JoinGroup (0..0) supported by broker
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature Sasl
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature SaslHandshake: SaslHandshake (0..0) supported by broker
7|2018-03-07 13:06:53.400|rdkafka#producer-1|METADATA| [thrd:10.27.190.125:9092/3]: Skipping metadata refresh of 1 topic(s): connected: already being requested
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature SaslHandshake
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature LZ4: GroupCoordinator (0..0) supported by broker
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature LZ4
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5:  Feature OffsetTime: Offset (1..1) supported by broker
7|2018-03-07 13:06:53.478|rdkafka#producer-1|APIVERSION| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Enabling feature OffsetTime
7|2018-03-07 13:06:53.494|rdkafka#producer-1|FEATURE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Updated enabled protocol features to MsgVer1,ApiVersion,BrokerBalancedConsumer,ThrottleTime,Sasl,SaslHandshake,BrokerGroupCoordinator,LZ4,OffsetTime
7|2018-03-07 13:06:53.400|rdkafka#producer-1|METADATA| [thrd:10.27.190.128:9092/6]: Skipping metadata refresh of 1 topic(s): connected: already being requested
7|2018-03-07 13:06:53.494|rdkafka#producer-1|SEND| [thrd:10.27.190.130:9092/7]: 10.27.190.130:9092/7: Sent MetadataRequest (v2, 35 bytes @ 0, CorrId 2)
7|2018-03-07 13:06:53.400|rdkafka#producer-1|METADATA| [thrd:10.27.190.126:9092/4]: Skipping metadata refresh of 1 topic(s): connected: already being requested
7|2018-03-07 13:06:53.494|rdkafka#producer-1|RECV| [thrd:10.27.190.130:9092/7]: 10.27.190.130:9092/7: Received MetadataResponse (v2, 326 bytes, CorrId 2, rtt 0.00ms)
7|2018-03-07 13:06:53.494|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7: ===== Received metadata (for 1 requested topics): refresh unavailable topics =====
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7: ClusterId: g6z37qAUTmWaf4CuxaY3ww, ControllerId: 5
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7: 10 brokers, 1 topics
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #0/10: 10.27.190.131:9092 NodeId 8
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #1/10: 10.27.181.16:9092 NodeId 2
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #2/10: 10.27.190.127:9092 NodeId 5
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #3/10: 10.27.190.126:9092 NodeId 4
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #4/10: 10.27.190.130:9092 NodeId 7
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #5/10: 10.27.181.15:9092 NodeId 1
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #6/10: 10.27.190.136:9092 NodeId 9
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #7/10: 10.27.190.125:9092 NodeId 3
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #8/10: 10.27.190.128:9092 NodeId 6
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Broker #9/10: 10.27.181.14:9092 NodeId 0
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7:   Topic #0/1: metrics4 with 1 partitions
7|2018-03-07 13:06:53.509|rdkafka#producer-1|METADATA| [thrd:main]:   Topic metrics4 partition 0 Leader 5
7|2018-03-07 13:06:53.509|rdkafka#producer-1|BRKDELGT| [thrd:main]: metrics4 [0]: delegate to broker 10.27.190.127:9092/5 (rktp 05D508A0, term 0, ref 3, remove 0)
7|2018-03-07 13:06:53.509|rdkafka#producer-1|BRKDELGT| [thrd:main]: metrics4 [0]: broker 10.27.190.127:9092/5 is now leader for partition with 100000 messages (500000 bytes) queued
7|2018-03-07 13:06:53.525|rdkafka#producer-1|PARTCNT| [thrd:main]: Partitioning 0 unassigned messages in topic metrics4 to 1 partitions
7|2018-03-07 13:06:53.525|rdkafka#producer-1|UAS| [thrd:main]: 0/0 messages were partitioned in topic metrics4
7|2018-03-07 13:06:53.525|rdkafka#producer-1|METADATA| [thrd:main]: 10.27.190.130:9092/7: 1/1 requested topic(s) seen in metadata
7|2018-03-07 13:06:53.494|rdkafka#producer-1|STATE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Broker changed state APIVERSION_QUERY -> UP
7|2018-03-07 13:06:53.541|rdkafka#producer-1|BROADCAST| [thrd:10.27.190.127:9092/5]: Broadcasting state change
7|2018-03-07 13:06:53.541|rdkafka#producer-1|METADATA| [thrd:10.27.190.127:9092/5]: Skipping metadata refresh of 1 topic(s): connected: already being requested
7|2018-03-07 13:06:53.541|rdkafka#producer-1|TOPBRK| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Topic metrics4 [0]: joining broker (rktp 05D508A0)
7|2018-03-07 13:06:53.541|rdkafka#producer-1|BROADCAST| [thrd:10.27.190.127:9092/5]: Broadcasting state change
7|2018-03-07 13:06:53.697|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 100000+0 msgs
7|2018-03-07 13:06:53.713|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: No more space in current MessageSet (25639 message(s), 999974 bytes)
7|2018-03-07 13:06:53.713|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 25639 message(s) (999921 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:53.728|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: No more space in current MessageSet (25639 message(s), 999974 bytes)
7|2018-03-07 13:06:53.728|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 25639 message(s) (999921 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:53.744|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: No more space in current MessageSet (25639 message(s), 999974 bytes)
7|2018-03-07 13:06:53.759|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 25639 message(s) (999921 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:53.776|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 23083 message(s) (900237 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:53.776|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:53.776|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 999974 bytes @ 0, CorrId 2)
7|2018-03-07 13:06:53.776|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 999974 bytes @ 0, CorrId 3)
7|2018-03-07 13:06:53.776|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 999974 bytes @ 0, CorrId 4)
7|2018-03-07 13:06:53.776|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 900290 bytes @ 0, CorrId 5)
7|2018-03-07 13:06:53.776|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:53.853|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 2, rtt 78.00ms)
7|2018-03-07 13:06:53.853|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 25639 message(s) delivered
7|2018-03-07 13:06:53.853|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:53.947|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 3, rtt 125.00ms)
7|2018-03-07 13:06:53.963|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 25639 message(s) delivered
7|2018-03-07 13:06:53.963|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 9605+0 msgs
7|2018-03-07 13:06:53.963|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 9605 message(s) (388224 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:53.978|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:53.978|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 388277 bytes @ 0, CorrId 6)
7|2018-03-07 13:06:53.978|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 210+0 msgs
7|2018-03-07 13:06:54.072|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 5743+210 msgs
7|2018-03-07 13:06:54.072|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 5953 message(s) (250025 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:54.072|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.072|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 250078 bytes @ 0, CorrId 7)
7|2018-03-07 13:06:54.072|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 258+0 msgs
7|2018-03-07 13:06:54.166|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 4, rtt 375.00ms)
7|2018-03-07 13:06:54.166|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 25639 message(s) delivered
7|2018-03-07 13:06:54.181|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 14590+258 msgs
7|2018-03-07 13:06:54.197|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 14848 message(s) (623616 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:54.197|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.197|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 623669 bytes @ 0, CorrId 8)
7|2018-03-07 13:06:54.197|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 180+0 msgs
7|2018-03-07 13:06:54.197|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 5, rtt 422.00ms)
7|2018-03-07 13:06:54.197|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 23083 message(s) delivered
7|2018-03-07 13:06:54.213|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 2176+180 msgs
7|2018-03-07 13:06:54.213|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 6, rtt 234.00ms)
7|2018-03-07 13:06:54.213|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 9605 message(s) delivered
7|2018-03-07 13:06:54.213|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 7, rtt 140.00ms)
7|2018-03-07 13:06:54.213|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 5953 message(s) delivered
7|2018-03-07 13:06:54.228|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 1075+2356 msgs
7|2018-03-07 13:06:54.259|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 8, rtt 62.00ms)
7|2018-03-07 13:06:54.259|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 14848 message(s) delivered
7|2018-03-07 13:06:54.275|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 1973+3431 msgs
7|2018-03-07 13:06:54.291|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 14+5404 msgs
7|2018-03-07 13:06:54.369|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 5418 message(s) (227556 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:54.369|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.384|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 227609 bytes @ 0, CorrId 9)
7|2018-03-07 13:06:54.431|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 3583+0 msgs
7|2018-03-07 13:06:54.463|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 9, rtt 31.00ms)
7|2018-03-07 13:06:54.525|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 5418 message(s) delivered
7|2018-03-07 13:06:54.541|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 4690+3583 msgs
7|2018-03-07 13:06:54.650|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 8273 message(s) (352803 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:54.713|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.744|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 352856 bytes @ 0, CorrId 10)
7|2018-03-07 13:06:54.744|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.744|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 10, rtt 0.00ms)
7|2018-03-07 13:06:54.744|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 8273 message(s) delivered
7|2018-03-07 13:06:54.744|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.947|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 15680+0 msgs
7|2018-03-07 13:06:54.963|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 15680 message(s) (674240 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:54.963|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:54.963|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 674293 bytes @ 0, CorrId 11)
7|2018-03-07 13:06:54.963|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 436+0 msgs
7|2018-03-07 13:06:55.025|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 11, rtt 63.00ms)
7|2018-03-07 13:06:55.025|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 15680 message(s) delivered
7|2018-03-07 13:06:55.072|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 14418+436 msgs
7|2018-03-07 13:06:55.088|rdkafka#producer-1|PRODUCE| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: Produce MessageSet with 14854 message(s) (638722 bytes, ApiVersion 2, MsgVersion 1)
7|2018-03-07 13:06:55.088|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:55.103|rdkafka#producer-1|SEND| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Sent ProduceRequest (v2, 638775 bytes @ 0, CorrId 12)
7|2018-03-07 13:06:55.103|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs
7|2018-03-07 13:06:55.103|rdkafka#producer-1|RECV| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: Received ProduceResponse (v2, 44 bytes, CorrId 12, rtt 0.00ms)
7|2018-03-07 13:06:55.103|rdkafka#producer-1|MSGSET| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0]: MessageSet with 14854 message(s) delivered
7|2018-03-07 13:06:55.103|rdkafka#producer-1|TOPPAR| [thrd:10.27.190.127:9092/5]: 10.27.190.127:9092/5: metrics4 [0] 0+0 msgs

Checklist

Please provide the following information:

• Confluent.Kafka nuget version: 0.11.3

• Apache Kafka version: 0.10.2

• Client configuration:
  {"acks", "all" },
  {"batch.num.messages", 50000 },
  {"linger.ms", 100 },
  {"socket.blocking.max.ms", 150 },
  {"socket.send.buffer.bytes", 5000000},
  {"socket.receive.buffer.bytes", 5000000},
  {"debug", "all" },

• Operating system: Windows server 2016

• Provide logs (with "debug" : "..." as necessary in configuration)

• Provide broker log excerpts

• Critical issue

[ah-]

Try setting produce.offset.report to true.

[mhowlett]

produce.offset.report is set to true by default by the dotnet client if not configured. I've not encountered this before.. @edenhill do you have any ideas?

[edenhill]

This looks identical to produce.offset.report=false, wasn't there a problem with default_topic_conf fallthru with some .NET version?

[mhowlett]

maybe try a pre-release version (0.11.3-ci-303 is the latest on nuget) in which the problem @edenhill is referring to has been resolved.

[koushikchitta]

Sure, will check and will provide update in a day

[koushikchitta]

No luck with latest pre-release version too.

tried these combinations
confluent.kafka.0.11.3-ci-303 + librdkafka.redist.0.11.4-rc1b
confluent.kafka.0.11.3-ci-303 + librdkafka.redist.0.11.3

[koushikchitta]

Ah works with "produce.offset.report", "true" .
@mhowlett can you pls confirm if this config is set to true by default? Until 0.11.0 I didn't use this config for offsets.

[mhowlett]

The final thing done in the producer constructor before setting config values is check to see if produce.offset.report has been configured, if not, set it to true. Also, we have many integration tests that check this (which don't fail). Unsure what's going on here...

https://github.com/confluentinc/confluent-kafka-dotnet/blob/master/src/Confluent.Kafka/Producer.cs#L277

confluent-kafka-dotnet/src/Confluent.Kafka/Producer.cs

Line 467 in 9812452

if (modifiedConfig.FirstOrDefault(prop => prop.Key == "produce.offset.report").Value == null)

[mackayj]

I can confim that adding the { "produce.offset.report", true } fixed the offset reporting for us. We were sending 10 messages in a for loop for testing, and only the last item would correctly report its offset value. All others would give the invalid -1001 error.

using (var producer = new Producer<string, string>(config, keySerializer, valueSerializer))
	{
		var tasks = new List<Task<Message<string, string>>>();

		for (var i = 0; i < 10; i++)
		{
			var result = producer.ProduceAsync("Testing", $"key-{i}", $"Testing #{i}-{DateTime.Now.ToLongTimeString()}");//.Result;
														
			result.ContinueWith(res =>
			{
				Console.WriteLine(
					$"Partition: {res.Result.Partition}, Offset: {res.Result.Offset}, {res.Result.Key} {res.Result.Value}");
			});
		}
		producer.Flush(TimeSpan.FromSeconds(10));
	}

[mhowlett]

Just had a look into this. It appears as though it was fixed before 0.11.4 was release (but not in 0.11.4-RC2). The 1.0-experimental nuget packages should also be fine. There are corresponding integration tests.

please re-open if the issue persists.