[Feature Request] Support Coordinated Commits in Delta Kernel

[EstherBear]

Feature request

Which Delta project/connector is this regarding?

• Spark
• Standalone
• Flink
• Kernel
• Other (fill in here)

Overview

Support both coordinated commits read and write in Delta Kernel.

Motivation

Today Delta Spark supports coordinated commits. Delta Kernel should also support it to align with Delta Spark.

Project Plan

ID	Task description	PRs	Status	Author
1	Add monotonic inCommitTimestamp	#3218, #3269, #3276, #3282, #3283, prototype	DONE	@EstherBear
2	Improve inCommitTimestamp read #3321		TODO	@EstherBear
3	Prototypes of coordinated commits support in kernel	#3333, #3355	DONE	@EstherBear
4	Add coordinated commits interfaces and table properties	#3370	DONE	@EstherBear
5	Add default coordinated commits handler implementation	#3396	DONE	@EstherBear
6	Add parsing support for coordinated commits Map type table properties	#3400	DONE	@EstherBear
7	Add InMemoryCommitCoordinator for testing	#3377	DONE	@EstherBear
8	Update the Kernel read with coordinated commits support	#3381	DONE	@EstherBear
9	Update the Kernel write with coordinated commits support	#3390	In Progress	@EstherBear
10	Update the Kernel checkpoint with coordinated commits support	#3476	In Progress	@EstherBear
11	Update the coordinated commits to support downgrade in Kernel	#3477	In Progress	@EstherBear
12	Reuse CoordinatedCommitBuilder interface in Storage Module		TODO	@EstherBear
13	Remove CoordinatedCommitsUtils from Storage test package #3420		TODO	@EstherBear
14	Make snapshot hint optimization to work with coordinated commits #3437		TODO	@EstherBear
15	Other PRs	#3502, #3503	In Progress	@EstherBear
16	Update Kernel getChanges and getVersionBeforeOrAtTimestamp and getVersionAtOrAfterTimestamp		TODO

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

• Yes. I can contribute this feature independently.
• Yes. I would be willing to contribute this feature with guidance from the Delta Lake community.
• No. I cannot contribute this feature at this time.