Yingwen
0939dc1d32
test: run sqlness for flat format ( #7178 )
...
* test: support flat format in sqlness
Signed-off-by: evenyag <realevenyag@gmail.com >
* test: replace region stats test result with NUM
Signed-off-by: evenyag <realevenyag@gmail.com >
* ci: add flat format to sqlness ci
Signed-off-by: evenyag <realevenyag@gmail.com >
---------
Signed-off-by: evenyag <realevenyag@gmail.com >
2025-11-05 11:23:12 +00:00
Weny Xu
40e9ce90a7
refactor: restructure sqlness to support multiple envs and extract common utils ( #7066 )
...
* refactor: restructure sqlness to support multiple envs and extract common utils
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore(ci): update sqlness cmd
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: add comments
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: error fmt
Signed-off-by: WenyXu <wenymedia@gmail.com >
* fix: only reconnect mysql and pg client
Signed-off-by: WenyXu <wenymedia@gmail.com >
* chore: apply suggestions
Signed-off-by: WenyXu <wenymedia@gmail.com >
---------
Signed-off-by: WenyXu <wenymedia@gmail.com >
2025-10-11 06:34:17 +00:00
LFC
979c8be51b
feat: able to pass external service for sqlness test ( #7032 )
...
feat: able to pass external service instead of creating inside for sqlness test
Signed-off-by: luofucong <luofc@foxmail.com >
2025-10-09 07:02:19 +00:00
fys
c4a7cc0adb
chore: improve create trigger display ( #7027 )
...
* chore: improve create_trigger_statement display
* improve display of create trigger
* add components for frontend
* Revert "add components for frontend"
This reverts commit 8d71540a72 .
2025-09-29 02:22:43 +00:00
Ning Sun
964dc254aa
feat: upgraded pg_catalog support ( #6918 )
...
* refactor: add datafusion-postgres dependency
* refactor: move and include pg_catalog udfs
* chore: update upstream
* feat: register table function pg_get_keywords
* feat: bridge CatalogInfo for our CatalogManager
Signed-off-by: Ning Sun <sunning@greptime.com >
* feat: convert pg_catalog table to our system table
* feat: bridge system catalog with datafusion-postgres
Signed-off-by: Ning Sun <sunning@greptime.com >
* feat: add more udfs
* feat: add compatibility rewriter to postgres handler
* fix: various fix
* fmt: fix
* fix: use functions from pg_catalog library
* fmt
* fix: sqlness runner
Signed-off-by: Ning Sun <sunning@greptime.com >
* test: adopt arrow 56.0 to 56.1 memory size change
* fix: add additional udfs
* chore: format
* refactor: return None when creating system table failed
Signed-off-by: Ning Sun <sunning@greptime.com >
* chore: provide safety comments about expect usage
---------
Signed-off-by: Ning Sun <sunning@greptime.com >
2025-09-25 04:05:34 +00:00
Cason Kervis
c431b036ec
fix(path): fix program lookup failure on Windows CI ( #6946 )
...
* fix(path): fix program lookup failure on Windows CI
Signed-off-by: Cason Kervis <cscnk52@outlook.com >
* fix(path): fix program exec name
Signed-off-by: Cason Kervis <cscnk52@outlook.com >
* fix(path): using absolute path
Signed-off-by: Cason Kervis <cscnk52@outlook.com >
* style: using fmt
Signed-off-by: Cason Kervis <cscnk52@outlook.com >
---------
Signed-off-by: Cason Kervis <cscnk52@outlook.com >
2025-09-10 13:38:54 +00:00
Ruihang Xia
c9377e7c5a
build: bump rust edition to 2024 ( #6920 )
...
* bump edition
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* gen keyword
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* lifetime and env var
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* one more gen fix
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* lifetime of temporaries in tail expressions
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* format again
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clippy nested if
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clippy let and return
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-09-08 02:37:18 +00:00
liyang
e595885dc6
chore: use greptime dockerhub image ( #6865 )
...
Signed-off-by: liyang <daviderli614@gmail.com >
2025-09-01 11:07:26 +00:00
liyang
7bc669e991
chore: update bitnami config ( #6847 )
...
* chore: update bitnami config
Signed-off-by: liyang <daviderli614@gmail.com >
* update postgresql chart version
Signed-off-by: liyang <daviderli614@gmail.com >
* fix ci
Signed-off-by: liyang <daviderli614@gmail.com >
* refactor: add pull-test-deps-images.sh to pull images one by one to avoid rate limit
Signed-off-by: zyy17 <zyylsxm@gmail.com >
---------
Signed-off-by: liyang <daviderli614@gmail.com >
Signed-off-by: zyy17 <zyylsxm@gmail.com >
Co-authored-by: zyy17 <zyylsxm@gmail.com >
2025-08-29 02:45:14 +00:00
discord9
d774996e89
chore: make internal grpc optional ( #6789 )
...
* chore: make internal grpc optional
Signed-off-by: discord9 <discord9@163.com >
* revert sqlness runner too
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
2025-08-22 04:22:49 +00:00
discord9
eaceae4c91
feat: frontend internal grpc port ( #6784 )
...
* feat: frontend internal grpc port
Signed-off-by: discord9 <discord9@163.com >
* fix: grpc server naming
Signed-off-by: discord9 <discord9@163.com >
* test: sqlness test fix
Signed-off-by: discord9 <discord9@163.com >
* fix: internal not use process manager
Signed-off-by: discord9 <discord9@163.com >
* test: test integration port alloc
Signed-off-by: discord9 <discord9@163.com >
* feat: skip auth for internal grpc
Signed-off-by: discord9 <discord9@163.com >
* test: is distributed
Signed-off-by: discord9 <discord9@163.com >
* what:
Signed-off-by: discord9 <discord9@163.com >
---------
Signed-off-by: discord9 <discord9@163.com >
Co-authored-by: Ning Sun <sunning@greptime.com >
2025-08-22 02:46:35 +00:00
yihong
b51bafe9d5
fix: only start one instance one regrex sqlness test ( #6570 )
...
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-07-23 03:14:06 +00:00
discord9
a0900f5b90
feat(flow): use batching mode&fix sqlness ( #5903 )
...
* feat: use flow batching engine
broken: try using logical plan
fix: use dummy catalog for logical plan
fix: insert plan exec&sqlness grpc addr
feat: use frontend instance in flownode in standalone
feat: flow type in metasrv&fix: flush flow out of sync& column name alias
tests: sqlness update
tests: sqlness flow rebuild udpate
chore: per review
refactor: keep chnl mgr
refactor: use catalog mgr for get table
tests: use valid sql
fix: add more check
refactor: put flow type determine to frontend
* chore: update proto
* chore: update proto to main branch
* fix: add locks for create/drop flow&docs: update docs
* feat: flush_flow flush all ranges now
* test: add align time window test
* docs: explain `nodeid` use in check task
* refactor: AddAutoColumnRewriter check for Projection
* refactor: per review
* fix: query without time window also clean dirty time window
* chore: better logging
* chore: add comments per review
* refactor: per review
* chore: per review
* chore: per review rename args
* refactor: per review partially
* chore: update docs
* chore: use better error variant
* chore: better error variant
* refactor: rename FlowWorkerManager to FlowStreamingEngine
* rename again
* refactor: per review
* chore: rebase after #5963 merged
* refactor: rename all flow_worker_manager occurs
* docs: rm resolved TODO
2025-04-23 15:12:16 +00:00
fys
7b48ef1e97
chore: remove patch.crates-io for rustls ( #5832 )
...
* chore: remove patch.crates-io for rustls
* enable default-rustls-ring feature for mysql_sync
* fix: build error
* add comment
* update comment
2025-04-07 07:51:50 +00:00
Yohan Wal
1dc4a196bf
feat: add mysql election logic ( #5694 )
...
* feat: add mysql election
* feat: add mysql election
* chore: fix deps
* chore: fix deps
* fix: duplicate container
* fix: duplicate setup for sqlness
* fix: call once
* fix: do not use NOWAIT for mysql 5.7
* chore: apply comments
* fix: no parallel sqlness for mysql
* chore: comments and minor revert
* chore: apply comments
* chore: apply comments
* chore: add to table name
* ci: use 2 metasrv to detect election bugs
* refactor: better election logic
* chore: apply comments
* chore: apply comments
* feat: version check before startup
2025-03-19 11:31:18 +00:00
yihong
16fddd97a7
chore: revert commit update flate2 version ( #5706 )" ( #5715 )
...
Revert "chore: update flate2 version (#5706 )"
This reverts commit a5df3954f3 .
2025-03-17 12:16:26 +00:00
yihong
a5df3954f3
chore: update flate2 version ( #5706 )
...
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-03-14 02:15:27 +00:00
yihong
408dd55a2f
fix: flaky test in sqlness by fix random port ( #5657 )
...
* fix: flaky test in sqlness by fix random port
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* fix: typo
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
* fix: panic insead of forever loop
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
---------
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-03-07 00:41:22 +00:00
Ruihang Xia
1c04ace4b0
feat: skip printing full config content in sqlness ( #5618 )
...
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-03-03 09:43:55 +00:00
Ruihang Xia
d7b6718be0
feat: run sqlness in parallel ( #5499 )
...
* define server mode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* bump sqlness
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* all good
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* clean up
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* refactor: Move config generation logic from Env to ServerMode
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* finalize
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* change license header
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename variables
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* override parallelism
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* rename more variables
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2025-02-21 07:05:19 +00:00
yihong
aa8f119bbb
chore: format all toml files ( #5529 )
...
fix: format some cargo files
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-02-18 12:09:01 +00:00
jeremyhi
29218b5fe7
refactor!: unify the option names across all components part2 ( #5476 )
...
* refactor: part2, replace old options in doc yaml
* chore: remove deprecated options
* chore: update config.md
* fix: ut
2025-02-07 13:06:50 +00:00
yihong
80790daae0
fix: better sqlness show, replace the unwarp with better show message ( #5400 )
...
Signed-off-by: yihong0618 <zouzou0208@gmail.com >
2025-01-20 04:59:39 +00:00
discord9
317fe9eaa5
feat: flow's http server ( #5372 )
...
* feat: flow's http server
* feat: add cli options for http addr
* test: sqlness runner http addr
* feat: metrics
* chore: also shutdown http server
2025-01-16 07:25:30 +00:00
Weny Xu
7f307a4cac
feat: auto detecting local IP to use as hostname ( #5314 )
...
* feat: auto detecting hostname
* chore: update config.md
* chore: bring back hostname
* chore: apply suggestions from CR
* chore: use const
* chore: apply suggesions from CR
* fix: fix sqlness
2025-01-08 12:06:31 +00:00
discord9
0ee41339aa
feat(flow): flow refill state (Part 1) ( #5295 )
...
* feat(flow): (Part 1) refill utils
* chore: after rebase fix
* chore: more rebase
* rm refill.rs to reduce pr size
* chore: simpler args
* refactor: per review
* docs: more explain for instant requests
* refactor: per review
2025-01-08 06:45:56 +00:00
Weny Xu
3d9df822ad
refactor: refactor PgStore ( #5309 )
...
* refactor: refactor PgStore
* fix: election use bytea and txn use Serializable to avoid read unrepeatable (#4 )
* fix: election use bytea as well
* fix: use Serializable to avoid read unrepeatable
* chore: remove unused error
* ci: enable pg kvbackend and sqlness
* ci: switch on pg_kvbackend feature
* fix: fix sqlness runner
* chore: add pg_kvbackend feature gate
* build(ci): add feature gate
* fix: add retry for `PgStore` txn
* fix: correct `SET_IDLE_SESSION_TIMEOUT`
---------
Co-authored-by: Yohan Wal <1035325592@qq.com >
Co-authored-by: CookiePieWw <profsyb@gmail.com >
2025-01-07 07:27:58 +00:00
discord9
421088a868
test: sqlness upgrade compatibility tests ( #5126 )
...
* feat: simple version switch
* chore: remove debug print
* chore: add common folder
* tests: add drop table
* feat: pull versioned binary
* chore: don't use native-tls
* chore: rm outdated docs
* chore: new line
* fix: save old bin dir
* fix: switch version restart all node
* feat: use etcd
* fix: wait for election
* fix: normal sqlness
* refactor: hashmap for bin dir
* test: past 3 major version compat crate table
* refactor: allow using without setup etcd
2024-12-17 07:00:02 +00:00
Ning Sun
bcadce3988
chore: remove openssl deps ( #5079 )
...
* chore: remove openssl deps
* ci: add ci task to check blacklisted dependencies
2024-12-02 07:12:15 +00:00
Ning Sun
4dea4cac47
refactor: change sqlness ports to avoid conflict with local instance ( #4794 )
2024-10-08 07:33:24 +00:00
JohnsonLee
47a3277d12
feat: customize channel information for sqlness tests ( #4729 )
...
* feat: add pg and mysql server_address options
* feat: start pg and mysql server(standalone)
* feat: start pg and mysql in distribute
* feat: finally get there, specify postgres sqlness
* feat: support mysql sqlness
* fix: license
* fix: remove unused import
* fix: toml
* fix: clippy
* refactor: BeginProtocolInterceptorFactory to ProtocolInterceptorFactory
* fix: sqlness pg connect
* fix: clippy
* Apply suggestions from code review
Co-authored-by: Yingwen <realevenyag@gmail.com >
* fix: rustfmt
* fix: reconnect pg and mysql when restart
* test: add mysql related sqlness
* fix: wait for start while restarting
* fix: clippy
* fix: cargo lock conflict
fix: Cargo.lock conflict
* fix: usage of '@@tx_isolation' in sqlness
* fix: typos
* feat: retry with backoff when create client
* fix: use millisecond rather than microseconds in backoff
---------
Co-authored-by: Yingwen <realevenyag@gmail.com >
2024-10-04 09:26:57 +00:00
Lei, HUANG
0a82b12d08
fix(sqlness): sqlness isolation ( #4780 )
...
* fix: isolate logs
* fix: copy cases
* fix: clippy
2024-09-29 05:54:01 +00:00
Lanqing Yang
93be81c041
feat: implement postgres kvbackend ( #4421 )
2024-08-14 22:49:32 +00:00
discord9
1ddf19d886
feat: flownode use Inserter to write to database ( #4323 )
...
* feat: use `Inserter` as Frontend
* fix: enable procedure in flownode
* docs: remove `frontend_addr` opts
* chore: rm fe addr in test runner
* refactor: int test also use inserter invoker
* feat: flow shutdown&refactor: remove `Frontendinvoker`
* refactor: rename `RemoteFrontendInvoker` to `FrontendInvoker`
* refactor: per review
* refactor: remove a layer of box
* fix: standalone use `node_manager`
* fix: remove a `Arc` cycle
2024-07-09 10:44:22 +00:00
Ruihang Xia
96861137b2
fix(ci): remove sqlness state in success ( #4313 )
...
* fix(ci): remove sqlness state in success
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix regex
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: dennis zhuang <killme2008@gmail.com >
2024-07-08 12:32:36 +00:00
discord9
09fff24ac4
feat: make flow distributed work&tests ( #4256 )
...
feat: flownode frontend client&test
feat: Frontend Client
feat: set frontend invoker for flownode
feat: set frontend invoker for flownode
chore: test script
WIP: test flow distributed
feat: hard coded demo
docs: flownode example toml
feat: add flownode support in runner
docs: comments for node
chore: after rebase
docs: add a todo
tests: move flow tests to common
fix: flownode sqlness dist test
chore: per review
docs: make
fix: make doc
2024-07-05 14:46:44 +00:00
discord9
967b2cada6
feat!: remove alias metasrv-addr ( #4239 )
2024-07-03 06:53:43 +00:00
discord9
517917453d
fix(flow): fix call df func bug&sqlness test ( #4165 )
...
* tests: flow sqlness tests
* tests: WIP df func test
* fix: use schema before expand for transform expr
* tests: some basic flow tests
* tests: unit test
* chore: dep use rev not patch
* fix: wired sqlness error?
* refactor: per review
* fix: temp sqlness bug
* fix: use fixed sqlness
* fix: impl drop as async shutdown
* refactor: per bot's review
* tests: drop worker handler both sync/async
* docs: add rationale for test
* refactor: per review
* chore: fmt
2024-06-24 07:52:45 +00:00
dennis zhuang
aafb468547
fix: set local or session time_zone not work ( #4064 )
...
* fix: set local or session time_zone not work
* chore: supports PostgreSQL-specific setting time zone
2024-05-29 00:06:13 +00:00
tison
9dd6e033a7
refactor: move Database to client crate behind testing feature ( #4059 )
...
* refactor: move Database to client crate behind testing feature
Signed-off-by: tison <wander4096@gmail.com >
* partial move
Signed-off-by: tison <wander4096@gmail.com >
* catch up more
Signed-off-by: tison <wander4096@gmail.com >
* fix imports
Signed-off-by: tison <wander4096@gmail.com >
* finish
Signed-off-by: tison <wander4096@gmail.com >
* tidy
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
2024-05-28 03:21:43 +00:00
dimbtp
3b89b9ddd8
refactor: move database client to test ( #3820 )
...
* remove `Database` in `cli export`
* move `Database` to tests-integration
* fix clippy
* move `DatabaseClient` along with `Database`
* `cli export` now use http api
* add TODO for `tests-integration` dependencies
* cleanup code
* 'cli export' test use http api
* remove unsed dependencies in cmd crate
* apply review comments and clean code
* remove unused methods
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-05-01 05:55:13 +00:00
Ruihang Xia
d0b2a11f2b
feat: add preserve arg to sqlness runner ( #3724 )
...
* feat: add preserve arg to sqlness runner
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* replace tempdir with tempfile
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-04-22 09:21:37 +00:00
Ruihang Xia
0c5f4801b7
build: update toolchain to nightly-2024-04-18 ( #3740 )
...
* chore: update toolchain to nightly-2024-04-17
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix test clippy
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix ut
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update fuzz test
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update to nightly-2024-04-18
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* add document
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update CI
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* avoid unnecessary allow clippy attrs
Signed-off-by: tison <wander4096@gmail.com >
* help the compiler find the clone is unnecessary and make clippy happy
Signed-off-by: tison <wander4096@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Signed-off-by: tison <wander4096@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-19 05:42:34 +00:00
dimbtp
dd18d8c97b
build(deps): remove some unused dependencies ( #3582 )
...
* build(deps): remove some unused dependencies
* add `arc-swap` dependency back
2024-03-26 12:48:28 +00:00
Ruihang Xia
992c7ec71b
feat: update physical table's schema on creating logical table ( #3570 )
...
* feat: update physical table's schema on creating logical table
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* remove debug code
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* tweak ut const
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* update sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* invalid physical table cache
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
2024-03-25 03:19:30 +00:00
shuiyisong
0bb949787c
refactor: introduce new Output with OutputMeta ( #3466 )
...
* refactor: introduce new output struct
* chore: add helper function
* chore: update comment
* chore: update commit
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
* chore: rename according to cr
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-03-11 02:24:09 +00:00
SteveLauC
e9a2b0a9ee
chore: use workspace-wide lints ( #3352 )
...
* chore: use workspace-wide lints
* respond to review
2024-02-22 01:01:10 +00:00
LFC
eded08897d
test: add data compatibility test ( #3109 )
...
* test: data files compatibility test
* rework compatibility test
* revert unneeded changes
* revert unneeded changes
* debug CI
* Update .github/workflows/develop.yml
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
---------
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
2024-02-20 07:44:04 +00:00
shuiyisong
bf5e1905cd
refactor: bring metrics to http output ( #3247 )
...
* refactor: bring metrics to http output
* chore: remove unwrap
* chore: make walk plan accumulate
* chore: change field name and comment
* chore: add metrics to http resp header
* chore: move PrometheusJsonResponse to a separate file and impl IntoResponse
* chore: put metrics in prometheus resp header too
2024-02-20 03:25:18 +00:00
LFC
50d16d6330
ci: build GreptimeDB binary for later use ( #3244 )
...
* ci: build GreptimeDB binaries for later use
* debug CI
* try larger runner host
* Revert "try larger runner host"
This reverts commit 03c18c0f51 .
* fix: resolve PR comments
* revert some unrelated action yamls
* fix CI
* use artifact upload v4 for faster upload and download speed
2024-01-31 03:02:27 +00:00