Long stream of error messages related to is_deleted and _version columns when running the mysql docker compose used for example usage

[Selfeer]

When running this docker compose https://github.com/Altinity/clickhouse-sink-connector/blob/develop/sink-connector-lightweight/docker/docker-compose-mysql.yml, using the build from #612 we see a long stream of error messages appear:

[subkanthi]

Fixed:

2024-06-23 08:36:04.637 ERROR - ********** ERROR: Database(chtest), Table(sbtest1), ClickHouse column new1 not present in source ************
2024-06-23 08:36:04.637 ERROR - ********** ERROR: Database(chtest), Table(sbtest1), Setting column new1 to NULL might fail for non-nullable columns ************
2024-06-23 08:36:04.637 ERROR - ******* ERROR inserting Batch Database(sbtest), Table(sbtest1) *****************

[byte09]

I have a same problem in Postgre for example:

2024-08-07 07:37:33.826 INFO - getTableEngineUsingSystemTables ResultSetcom.clickhouse.jdbc.ClickHouseResultSet@37807356
2024-08-07 07:37:33.836 INFO - * INSERT QUERY for Database(metrika) *: insert into products(PRODUCT_ID,NAME,DESCRIPTION,PRICE) select PRODUCT_ID,NAME,DESCRIPTION,PRICE from input('PRODUCT_ID UInt64,NAME String,DESCRIPTION String,PRICE UInt64')
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), ClickHouse column NAME not present in source **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), Setting column NAME to NULL might fail for non-nullable columns **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), ClickHouse column DESCRIPTION not present in source **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), Setting column DESCRIPTION to NULL might fail for non-nullable columns **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), ClickHouse column PRICE not present in source **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), Setting column PRICE to NULL might fail for non-nullable columns **********
2024-08-07 07:37:33.842 ERROR - ***** ERROR inserting Batch Database(db_paperless), Table(products) ***************
java.sql.SQLException: Cannot set null to non-nullable column #2 [NAME String]
at com.clickhouse.jdbc.SqlExceptionUtils.clientError(SqlExceptionUtils.java:73) ~[app.jar:?]

can you help me?

[subkanthi]

What is the docker tag you are using?

l I have a same problem in Postgre for example:

2024-08-07 07:37:33.826 INFO - getTableEngineUsingSystemTables ResultSetcom.clickhouse.jdbc.ClickHouseResultSet@37807356
2024-08-07 07:37:33.836 INFO - * INSERT QUERY for Database(metrika) *: insert into products(PRODUCT_ID,NAME,DESCRIPTION,PRICE) select PRODUCT_ID,NAME,DESCRIPTION,PRICE from input('PRODUCT_ID UInt64,NAME String,DESCRIPTION String,PRICE UInt64')
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), ClickHouse column NAME not present in source **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), Setting column NAME to NULL might fail for non-nullable columns **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), ClickHouse column DESCRIPTION not present in source **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), Setting column DESCRIPTION to NULL might fail for non-nullable columns **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), ClickHouse column PRICE not present in source **********
2024-08-07 07:37:33.841 ERROR - ******** ERROR: Database(metrika), Table(products), Setting column PRICE to NULL might fail for non-nullable columns **********
2024-08-07 07:37:33.842 ERROR - ***** ERROR inserting Batch Database(db_paperless), Table(products) ***************
java.sql.SQLException: Cannot set null to non-nullable column #2 [NAME String]
at com.clickhouse.jdbc.SqlExceptionUtils.clientError(SqlExceptionUtils.java:73) ~[app.jar:?]

can you help me?

Hi

[byte09]

Sorry, I made a bad table in the system and everything broke down.