DOCSP-15782 whats new (#114)

* added What's New page

Author: kyuan-mongodb

source/whats-new.txt

@@ -2,4 +2,205 @@
 What's New
 ==========
 
-abc
+.. default-domain:: mongodb
+
+.. contents:: On this page
+   :local:
+   :backlinks: none
+   :depth: 1
+   :class: singlecol
+
+Learn what's new in a particular version:
+
+* :ref:`Version 1.6 <kafka-connector-whats-new-1.6>`
+* :ref:`Version 1.5 <kafka-connector-whats-new-1.5>`
+* :ref:`Version 1.4 <kafka-connector-whats-new-1.4>`
+* :ref:`Version 1.3 <kafka-connector-whats-new-1.3>`
+* :ref:`Version 1.2 <kafka-connector-whats-new-1.2>`
+* :ref:`Version 1.1 <kafka-connector-whats-new-1.1>`
+* :ref:`Version 1.0 <kafka-connector-whats-new-1.0>`
+
+.. _kafka-connector-whats-new-1.6:
+
+What's New in 1.6
+-----------------
+
+- Added support for Versioned API to force the server to run operations with behavior compatible with the specified API version
+- Added error handling properties that can override the Connect framework's error handling behavior
+- Added ``mongo-kafka-connect-<version>-confluent.jar`` which contains the connector and all dependencies needed to run it on the Confluent Platform
+
+Sink Connector
+~~~~~~~~~~~~~~
+
+- Added support for automatic time-series collection creation in MongoDB 5.0 to efficiently store sequences of measurements over a period of time
+- Improved the error logging for bulk write exceptions
+
+Source Connector
+~~~~~~~~~~~~~~~~
+
+- No new changes, additions or improvements
+
+Bug Fixes
+~~~~~~~~~
+
+- Corrected the behavior of ``LazyBsonDocument#clone`` to respond to any changes made once unwrapped
+- Fixed the timestamp integer overflow in the Source Connector
+- Updated to enable recovery when calling the ``getMore()`` method in the Source Connector
+- Updated to enable recovery from broken change stream due to event sizes that are greater than 16MB in the Source Connector
+
+.. _kafka-connector-whats-new-1.5:
+
+What's New in 1.5
+-----------------
+
+- Updated the MongoDB Java Driver to version 4.2
+
+Sink Connector
+~~~~~~~~~~~~~~
+
+- Added the ``DeleteOneBusinessKeyStrategy`` write strategy to remove records from a topic
+- Added support for handling errant records that cause problems when processing them
+- Added support for Qlik Replicate Change Data Capture (CDC) to process event streams
+
+Source Connector
+~~~~~~~~~~~~~~~~
+
+- Replaced ``BsonDocument`` with ``RawBsonDocument``
+- Improved the ``copy.existing`` namespace handling
+- Improved the error messages for invalid pipeline operators
+- Improved the efficiency of heartbeats by making them tombstone messages
+
+Bug Fixes
+~~~~~~~~~
+
+- Corrected the inferred schema naming conventions 
+- Updated to ensure that schemas can be backwards compatible
+- Fixed the Sink validation issue with ``topics.regex`` 
+- Fixed the Sink NPE issue when using with Confluent Connect 6.1.0
+- Updated to ensure that the change stream cursor closes so it only reports errors that exist
+- Changed to include or exclude the ``_id`` field for a projection only if it's explicitly added
+
+.. _kafka-connector-whats-new-1.4:
+
+What's New in 1.4
+-----------------
+
+- Updated the MongoDB Java Driver to version 4.1
+
+Sink Connector
+~~~~~~~~~~~~~~
+
+- Added support for Change Data Capture (CDC) based on MongoDB change stream events 
+- Added the ``NamespaceMapper`` interface to allow for dynamic namespace mapping
+
+Source Connector
+~~~~~~~~~~~~~~~~
+
+- Added the ``TopicMapper`` interface to allow topic mapping
+
+Bug Fixes
+~~~~~~~~~
+
+- Changed the top-level inferred schema to be mandatory
+- Fixed a validation issue and synthetic configuration property in the Sink Connector
+- Corrected general exception logging 
+- Updated to clone the ``LazyBsonDocument`` instead of the unwrapped ``BsonDocument``
+
+.. _kafka-connector-whats-new-1.3:
+
+What's New in 1.3
+-----------------
+
+- Added automated integration testing for the latest Kafka Connector and Confluent Platform versions to ensure compatibility
+
+Sink Connector
+~~~~~~~~~~~~~~
+
+- Added support for records that contain ``Bson`` byte types
+- Added support for the ``errors.tolerance`` property
+- Changed ``max.num.retries`` default to ``1``
+- Improved the error messages for business key errors
+- Improved the error handling for ``List`` and JSON array configuration options
+- Updated to use the dot notation for filters in key update strategies
+
+Source Connector
+~~~~~~~~~~~~~~~~
+
+- Added support to output a key or value as a ``Bson`` byte type
+- Added support for schema and custom Avro schema definitions
+- Added support for dead letter queue and the ``errors.tolerance`` property
+- Added configurations for the following formatters: ``DefaultJson``, ``ExtendedJson``, ``SimplifiedJson``
+- Added configuration for ``copy.existing.pipeline`` to allow you to use indexes during the copying process
+- Added configuration for ``copy.existing.namespace.regex`` to allow you to copy the filtering of namespaces
+- Added configuration for ``offset.partition.name`` to allow for custom partitioning naming strategies
+- Updated to validate that the ``fullDocument`` field is a document
+- Updated to sanitize the connection string in the offset partition map to improve maintenance of the ``connection.uri``, ``database`` and ``collection`` parameters
+- Updated to disable publishing a source record without a topic name
+
+Bug Fixes
+~~~~~~~~~
+
+- Stopped MongoDB 3.6 from copying existing issues when the collection doesn't exist in the Source Connector
+
+.. _kafka-connector-whats-new-1.2:
+
+What's New in 1.2
+-----------------
+
+Sink Connector
+~~~~~~~~~~~~~~
+
+.. important::
+
+   We deprecated the following post processors:
+   ``BlacklistKeyProjector``, ``BlacklistValueProjector``,
+   ``WhitelistKeyProjector`` and ``WhitelistValueProjector``. 
+   
+   If you are using one of these post processors, use the
+   ``BlockListKeyProjector``, ``BlockListValueProjector``,
+   ``AllowListKeyProjector`` and ``AllowListValueProjector`` instead for
+   future compatibility. 
+
+- Added configurations for the following properties: ``document.id.strategy.overwrite.existing``, ``UuidStrategy`` output types, ``document.id.strategy.partial.value.projection.type``, ``document.id.strategy.partial.value.projection.list``, ``document.id.strategy.partial.key.projection.type``, ``document.id.strategy.partial.key.projection.list``, ``UuidProvidedInKeyStrategy``, and ``UuidProvidedInValueStrategy``
+- Added the ``UpdateOneBusinessKeyTimestampStrategy`` post processor
+- Added built-in support for parallelism and scalable data copying by assigning topic partitions to tasks
+
+Source Connector
+~~~~~~~~~~~~~~~~
+
+- Improved the error messaging for missing resume tokens
+
+Bug Fixes
+~~~~~~~~~
+
+- Removed failures with the ``MongoCopyDataManager`` when the source database does not exist
+- Fixed the copying the existing resumability error in the Source Connector
+
+.. _kafka-connector-whats-new-1.1:
+
+What's New in 1.1
+-----------------
+
+Sink Connector
+~~~~~~~~~~~~~~
+
+- Added support for the ``topics.regex`` property
+- Updated to ignore unused source record key or value fields
+- Added validation for the connection using ``MongoSìnkConnector.validate``
+
+Source Connector
+~~~~~~~~~~~~~~~~
+
+- Added validation for the connection using ``MongoSourceConnector.validate``
+
+Bug Fixes
+~~~~~~~~~
+
+- Removed the ``"Unrecognized field: startAfter"`` error for resuming a change stream in the Source Connector
+
+.. _kafka-connector-whats-new-1.0:
+
+What's New in 1.0
+-----------------
+
+The initial GA release.