Niwaka
a8012147ab
feat: support push down IN filter ( #5129 )
...
* feat: support push down IN filter
* chore: move tests to prune.sql
2024-12-11 13:46:23 +00:00
Lei, HUANG
7dd0e3ab37
fix: Panic in UNION ALL queries ( #4796 )
...
* fix/union_all_panic:
Improve MetricCollector by incrementing level and fix underflow issue; add tests for UNION ALL queries
* chore: remove useless documentation
* fix/union_all_panic: Add order by clause to UNION ALL select queries in tests
2024-10-11 08:23:01 +00:00
Yingwen
f02410c39b
fix: disable field pruning in last non null mode ( #4740 )
...
* fix: don't prune fields in last non null mode
* test: add sqlness test for field pruning
* test: add flush
* refine implementation
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-09-20 00:35:37 +00:00
Yingwen
3e17c09e45
feat: skip caching uncompressed pages if they are large ( #4705 )
...
* feat: cache each uncompressed page
* chore: remove unused function
* chore: log
* chore: log
* chore: row group pages cache kv
* feat: also support row group level cache
* chore: fix range count
* feat: don't cache compressed page for row group cache
* feat: use function to get part
* chore: log whether scan is from compaction
* chore: avoid get column
* feat: add timer metrics
* chore: Revert "feat: add timer metrics"
This reverts commit 4618f57fa2ba13b1e1a8dec83afd01c00ae4c867.
* feat: don't cache individual uncompressed page
* feat: append in row group level under append mode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* chore: fetch pages cost
* perf: yield
* Update src/mito2/src/sst/parquet/row_group.rs
* refactor: cache key
* feat: print file num and row groups num in explain
* test: update sqlness test
* chore: Update src/mito2/src/sst/parquet/page_reader.rs
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-09-10 11:52:16 +00:00
Ruihang Xia
8ca35a4a1a
fix: use number of partitions as parallilism in region scanner ( #4669 )
...
* fix: use number of partitions as parallilism in region scanner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Lei HUANG <mrsatangel@gmail.com >
* order by ts
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* debug pring time range
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Lei HUANG <mrsatangel@gmail.com >
2024-09-03 13:42:38 +00:00
Lei, HUANG
37dcf34bb9
fix(mito): avoid caching empty batches in row group ( #4652 )
...
* fix: avoid caching empty batches in row group
* fix: clippy
* Update tests/cases/standalone/common/select/last_value.sql
* fix: sqlness
2024-09-02 02:43:00 +00:00
Ruihang Xia
8de11a0e34
perf: set simple filter on primary key columns to exact filter ( #4564 )
...
* perf: set simple filter on primary key columns to exact filter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix typo
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-08-19 09:07:35 +00:00
Yingwen
20d9c0a345
fix: scan hint checks order asc ( #4365 )
...
* fix: order by asc check
* feat: print selector in explain
* test: move last_value opt test to standalone
* test: sqlness remove space
* test: update regex for datetime
* test: fix partitioning
* chore: update comment
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-07-15 07:49:14 +00:00
Ruihang Xia
16075ada67
feat: impl optimizer rule to handle last_value case ( #4357 )
...
* feat: impl optimizer rule to handle last_value case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename file
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Update src/query/src/optimizer/scan_hint.rs
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
* split methods
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Jeremyhi <jiachun_feng@proton.me >
2024-07-12 14:36:23 +00:00
Ruihang Xia
23bb9d92cb
feat: handle parentheses with unary ops ( #4290 )
...
* feat: handle parentheses with unary ops
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add comment
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add sqlness test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* check tokens before convert to RPN
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add test cases to sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-07-09 04:08:36 +00:00
WU Jingdi
34635558d2
fix: support tailing commas in SQL ( #2913 )
...
* fix: support tailing commas in SQL
* fix: broken ci
2023-12-12 11:56:23 +00:00
Ruihang Xia
56fc77e573
fix: add missing error display message ( #2791 )
...
* fix: add missing error display message
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-11-23 02:59:49 +00:00
dennis zhuang
f387a09535
fix: refactor and fix to_unixtime ( #2695 )
...
* fix: refactor and fix to_unixtime
* fix: sqlness tests
* feat: supports date type
* fix: test
* feat: supports datetime type
* refactor: convert_to_seconds
2023-11-06 11:00:14 +00:00
Lei, HUANG
97897aaf9b
fix: predicate shall use real schema to create physical exprs ( #2642 )
...
* fix: prune predicate show use real schema to create physical exprs
* refactor: remove redundant results
* fix: unit tests
* test: add more sqlness cases
* test: add more sqlness cases
* fix: sqlness orderby
* chore: update log
* fix: cache physical expr in memtable iter
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-10-24 03:41:25 +00:00
WU Jingdi
46e106bcc3
feat: allow nest range expr in Range Query ( #2557 )
...
* feat: eable range expr nest
* fix: change range expr rewrite format
* chore: organize range query tests
* chore: change range expr name(e.g. MAX(v) RANGE 5s FILL 6)
* chore: add range query test
* chore: fix code advice
* chore: fix ca
2023-10-18 07:03:26 +00:00
Niwaka
04dbd835a1
feat: support greatest function ( #2490 )
...
* feat: support greatest function
* feat: make greatest take date_type as input
* fix: move sqlness test into common/function/time.sql
* fix: avoid using unwarp
* fix: use downcast
* refactor: simplify arrow cast
2023-09-28 10:25:09 +00:00
JeremyHi
52ac093110
fix: drop table 0 rows affected ( #2515 )
2023-09-28 06:21:18 +00:00
Yingwen
c6e95ffe63
fix(mito): compaction scheduler schedules more tasks than expected ( #2466 )
...
* test: test on_compaction_finished
* fix: avoid submit same region to compact
* feat: persist and recover compaction time window
* test: fix test
* test: sort like result
2023-09-22 06:13:12 +00:00
Ruihang Xia
802229de87
fix: type cast bugs found by sqlness ( #2438 )
...
* update valid results
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* accomplish datatype
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* cast null
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix unit tests
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-09-19 08:20:41 +00:00
Zou Wei
b8c50d00aa
feat: sqlness test for interval type ( #2265 )
...
* feat: add integration-test for interval type.
* chore: add two cases.
* chore: cr
* chore: Field to Column
2023-09-04 14:30:48 +08:00
JeremyHi
c02ac36ce8
feat: avoid confusion in desc table ( #2272 )
...
feat: Field to Column to aviod confusion in DESC TABLE
2023-08-28 11:50:33 +00:00
JeremyHi
de1daec680
feat: upgrade desc table output ( #2256 )
2023-08-25 06:52:22 +00:00
WU Jingdi
15912afd96
fix: the inconsistent order of input/output in range select ( #2229 )
...
* fix: the inconsistent order of input/output in range select
* chore: apply CR
2023-08-25 04:12:59 +00:00
WU Jingdi
b411769de6
feat: Implement a basical range select query ( #2138 )
...
* feat: Implement a basical range select query
* chore: support any timestamp type & CR fix
2023-08-22 03:07:14 +00:00
Eugene Tolbakov
1492700acc
fix(timestamp): add trim for the input date string ( #2078 )
...
* fix(timestamp): add trim for the input date string
* fix(timestamp): add analyzer rule to trim strings before conversion
* fix: adjust according to CR
2023-08-03 23:33:47 +00:00
Zou Wei
7727508485
feat: impl interval type ( #1952 )
...
* feat: impl interval type in common time
* feat: impl datatype, vectors, value for interval
pick 0c1d9f297 feat: impl interval type in common time
pick d528c647f feat: impl datatype, vectors, value for interval
pick 1e12dd5c7 comments update
pick 74103e36c add license header
* comments update
* add license header
* cargo clippy
* refactor interval type
* add unit test and case to dummy.sql
* cargo clippy
* chore: add doc comments
* chore: cargo fmt
* feat: add formats, refactor comparison
* add docs comments
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
* chore: cr comment
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2023-07-31 03:54:39 +00:00
Ruihang Xia
b1ccc7ef5d
fix: prevent filter pushdown in distributed planner ( #1806 )
...
* fix: prevent filter pushdown in distributed planner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix metadata
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-06-21 16:25:50 +08:00
Eugene Tolbakov
51a4d660b7
feat(to_unixtime): add timestamp types as arguments ( #1632 )
...
* feat(to_unixtime): add timestamp types as arguments
* feat(to_unixtime): change the return type
* feat(to_unixtime): address code review issues
* feat(to_unixtime): fix fmt issue
2023-06-12 17:21:49 +08:00
Ruihang Xia
a6e41cdd7b
chore: bump arrow, parquet, datafusion and tonic ( #1386 )
...
* bump arrow, parquet, datafusion, tonic and greptime-proto
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add analyzer and fix test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix clippy warnings
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2023-04-15 00:03:15 +08:00
Ruihang Xia
b5e5f8e555
chore(deps): bump arrow and parquet to 36.0.0, and datafusion to the latest ( #1282 )
...
* chore: update arrow, parquet to 36.0 and datafusion
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update deps
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* Apply suggestions from code review
Co-authored-by: LFC <bayinamine@gmail.com >
* update sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: LFC <bayinamine@gmail.com >
2023-03-30 16:24:10 +08:00
Eugene Tolbakov
5397a9bbe6
feat(to_unixtime): add initial implementation ( #1186 )
...
* feat(to_unixtime): add initial implementation
* feat(to_unixtime): use Timestamp for conversion
* feat(to_unixtime): implement conversion to Result<VectorRef>
* feat(to_unixtime): make unit test pass
* feat(to_unixtime): preserve None for invalid timestamps
* feat(to_unixtime): address code review suggestions
* feat(to_unixtime): add an sqlness test
* feat(to_unixtime): adjust the assertion for the sqlness test
* Update tests/cases/standalone/common/select/dummy.sql
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2023-03-21 12:41:07 +00:00
LFC
11d45e2918
refactor: upgrade DataFusion, Arrow and Sqlparser ( #1074 )
...
* refactor: upgrade DataFusion, Arrow and Sqlparser
* fix: resolve PR comments
2023-02-27 22:20:08 +08:00
LFC
9ad6c45913
test: Sqlness tests for distribute mode ( #979 )
...
* test: Sqlness tests for distribute mode
* ci
* fix: resolve PR comments
* fix: resolve PR comments
2023-02-14 10:24:09 +08:00