Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Copy REL CSV according to the data types defined in schema #1704

Closed
mewim opened this issue Jun 21, 2023 · 1 comment
Closed

Copy REL CSV according to the data types defined in schema #1704

mewim opened this issue Jun 21, 2023 · 1 comment
Assignees
@ray6080
Labels
bug Something isn't working

Comments

@mewim
Copy link
Member

mewim commented Jun 21, 2023

Currently the rep csv copier uses Arrow to auto-detect column types. This causes a problem when the there is an all-digit string column in the csv file as it will be detected as an INT column. We should configure the Arrow csv reader with the types defined in the schema.
@ray6080 ray6080 added the bug Something isn't working label Jun 27, 2023
@ray6080
Copy link
Contributor

ray6080 commented Jun 27, 2023

Fixed in #1723 .

@ray6080 ray6080 closed this as completed Jun 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ray6080 ray6080

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ray6080 @mewim