You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The CSV file can get very huge. So, depending on the size of your CSV file, we might want to consider streaming the file instead of reading the entire content into memory.
The text was updated successfully, but these errors were encountered:
Processing them sequentially might lead to performance bottlenecks. Parallelizing the processing of multiple rows simultaneously can significantly improve overall performance. I once came across promise.all() for a project doing parallel reading. we can add that.
gitdagray
changed the title
CSV file reading
Stream CSV file reading & SQL file writing
Dec 22, 2023
The CSV file can get very huge. So, depending on the size of your CSV file, we might want to consider streaming the file instead of reading the entire content into memory.
The text was updated successfully, but these errors were encountered: