McKnight22
|
605f3270e5
|
feat: implement compressed CSV/JSON export functionality (#7162)
* feat: implement compressed CSV/JSON export functionality
- Add CompressedWriter for real-time compression during CSV/JSON export
- Support GZIP, BZIP2, XZ, ZSTD compression formats
- Remove LazyBufferedWriter dependency for simplified architecture
- Implement Encoder -> Compressor -> FileWriter data flow
- Add tests for compressed CSV/JSON export
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
* feat: implement compressed CSV/JSON export functionality
- refactor and extend compressed_writer tests
- add coverage for Bzip2 and Xz compression
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
* feat: implement compressed CSV/JSON export functionality
- Switch to threshold-based chunked flushing
- Avoid unnecessary writes on empty buffers
- Replace direct write_all() calls with the new helper for consistency
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
* feat: implement compressed CSV/JSON import (COPY FROM) functionality
- Add support for reading compressed CSV and JSON in COPY FROM
- Support GZIP, BZIP2, XZ, ZSTD compression formats
- Add tests for compressed CSV/JSON import
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
* feat: implement compressed CSV/JSON export/import functionality
- Fix review comments
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
* feat: implement compressed CSV/JSON export/import functionality
- Move temp_dir out of the loop
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
* feat: implement compressed CSV/JSON export/import functionality
- Fix unreasonable locking logic
Co-authored-by: jeremyhi <jiachun_feng@proton.me>
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
---------
Signed-off-by: McKnight22 <tao.wang.22@outlook.com>
Co-authored-by: jeremyhi <jiachun_feng@proton.me>
|
2025-11-18 02:55:58 +00:00 |
|