rust/greptimedb
1
0
Fork 0
mirror of https://github.com/GreptimeTeam/greptimedb.git synced 2026-08-26 07:58:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
498 Commits 169 Branches 269 Tags
replace-arrow2
Commit Graph

498 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Lei, HUANG a8630cdb38 fix: clippy errors 2022-12-15 18:12:05 +08:00
Ruihang Xia 0f3dcc1b38 fix: Fix All The Tests! (#752) 
* fix: Fix several tests compile errors

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix: some compile errors in tests

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix: compile errors in frontend tests

* fix: compile errors in frontend tests

* test: Fix tests in api and common-query

* test: Fix test in sql crate

* fix: resolve substrait error

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* chore: add more test

* test: Fix tests in servers

* fix instance_test

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* test: Fix tests in tests-integration

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Co-authored-by: Lei, HUANG <mrsatangel@gmail.com>
Co-authored-by: evenyag <realevenyag@gmail.com>
 2022-12-15 17:47:14 +08:00
evenyag 7c696dae08 Merge branch 'develop' into replace-arrow2 2022-12-15 15:29:35 +08:00
LFC 61d8bc2ea1 refactor(frontend): minor changes around FrontendInstance constructor (#748) 
* refactor: minor changes in some testing codes

Co-authored-by: luofucong <luofucong@greptime.com>
 2022-12-15 14:34:40 +08:00
Yingwen 142dee41d6 fix: Fix compiler errors in script crate (#749) 
* fix: Fix compiler errors in state.rs

* fix: fix compiler errors in state

* feat: upgrade sqlparser to 0.26

* fix: fix datafusion engine compiler errors

* fix: Fix some tests in query crate

* fix: Fix all warnings in tests

* feat: Remove `Type` from timestamp's type name

* fix: fix query tests

Now datafusion already supports median, so this commit also remove the
median function

* style: Fix clippy

* feat: Remove RecordBatch::pretty_print

* chore: Address CR comments

* feat: Add column_by_name to RecordBatch

* feat: modify select_from_rb

* feat: Fix some compiler errors in vector.rs

* feat: Fix more compiler errors in vector.rs

* fix: fix table.rs

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix: Fix compiler errors in coprocessor

* fix: Fix some compiler errors

* fix: Fix compiler errors in script

* chore: Remove unused imports and format code

* test: disable interval tests

* test: Fix test_compile_execute test

* style: Fix clippy

* feat: Support interval

* feat: Add RecordBatch::columns and fix clippy

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Co-authored-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-15 14:20:35 +08:00
Ruihang Xia e3785fca70 docs: change logo in readme automatically based on github theme (#743) 
* docs: adaptive logo on theme

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* switch logos

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* aligh center

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* adjust stylet

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* use new logo image

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-14 19:32:51 +08:00
Lei, HUANG ce6d1cb7d1 fix: frontend compile errors (#747) 
fix: fix compile errors in frontend
 2022-12-14 18:30:16 +08:00
Yingwen dbb3034ecb fix: Fix compiler errors in query crate (#746) 
* fix: Fix compiler errors in state.rs

* fix: fix compiler errors in state

* feat: upgrade sqlparser to 0.26

* fix: fix datafusion engine compiler errors

* fix: Fix some tests in query crate

* fix: Fix all warnings in tests

* feat: Remove `Type` from timestamp's type name

* fix: fix query tests

Now datafusion already supports median, so this commit also remove the
median function

* style: Fix clippy

* feat: Remove RecordBatch::pretty_print

* chore: Address CR comments

* Update src/query/src/query_engine/state.rs

Co-authored-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-14 17:42:07 +08:00
shuiyisong fda9e80cbf feat: impl static_user_provider (#739) 
* feat: add MemUserProvider and impl auth

* feat: impl user_provider option in fe and standalone mode

* chore: add file impl for mem provider

* chore: remove mem opts

* chore: minor change

* chore: refac pg server to use user_provider as indicator for using pwd auth

* chore: fix test

* chore: extract common code

* chore: add unit test

* chore: rebase develop

* chore: add user provider to http server

* chore: minor rename

* chore: change to ref when convert to anymap

* chore: fix according to clippy

* chore: remove clone on startcommand

* chore: fix cr issue

* chore: update tempdir use

* chore: change TryFrom to normal func while parsing anymap

* chore: minor change

* chore: remove to_lowercase
 2022-12-14 16:38:29 +08:00
Lei, HUANG 756c068166 feat: logstore compaction (#740) 
* feat: add benchmark for wal

* add bin

* feat: impl wal compaction

* chore: This reverts commit ef9f2326

* chore: This reverts commit 9142ec0e

* fix: remove empty files

* fix: failing tests

* fix: CR comments

* fix: Mark log as stable after writer applies manifest

* fix: some cr comments and namings

* chore: rename all stable_xxx to obsolete_xxx

* chore: error message
 2022-12-14 16:15:29 +08:00
Lei, HUANG 652d59a643 fix: remove unwrap 2022-12-13 17:51:14 +08:00
Lei, HUANG fa971c6513 fix: errors in optimzer 2022-12-13 17:44:37 +08:00
evenyag 36c929e1a7 fix: Fix imports in optimizer.rs 2022-12-13 17:27:44 +08:00
dennis zhuang 6a4e2e5975 feat: promql create and skeleton (#720) 
* feat: adds promql crate

* feat: adds promql-parser dependency and rfc doc

* fix: dependencies order in servers crate

* fix: forgot error.rs

* fix: comment

* fix: license header

* fix: remove docs/rfc/20221207_promql.md
 2022-12-13 17:08:22 +08:00
Ruihang Xia a712382fba Merge pull request #745 
* fix nyc-taxi and util

* Merge branch 'replace-arrow2' into fix-others

* fix substrait

* fix warnings and error in test
 2022-12-13 16:59:28 +08:00
Yingwen 4b644aa482 fix: Fix compiler errors in catalog and mito crates (#742) 
* fix: Fix compiler errors in mito

* fix: Fix compiler errors in catalog crate

* style: Fix clippy

* chore: Fix use
 2022-12-13 15:53:55 +08:00
Lei, HUANG 9ad6ddb26e fix: remove useless metaclient field from datanode Instance (#744) 2022-12-13 14:26:26 +08:00
Lei, HUANG 4defde055c feat: upgrade storage crate to arrow and parquet offcial impl (#738) 
* fix: compile erros

* fix: parquet reader and writer

* fix: parquet reader and writer

* fix: WriteBatch IPC encode/decode

* fix: clippy errors in storage subcrate

* chore: remove suspicious unwrap

* fix: some cr comments

* fix: CR comments

* fix: CR comments
 2022-12-13 11:58:50 +08:00
fys c5661ee362 feat: support http basic authentication (#733) 
* feat: support http auth

* add some unit test and log

* fix

* cr

* remove unused #[derive(Clone)]
 2022-12-13 10:44:33 +08:00
zyy17 9b093463cc feat: add Makefile to aggregate the commands that developers always use (#736) 
* feat: add Makefile to aggregate the commands that developers always use

* refactor: add 'clean' and 'unit-test' target

* refactor: add sqlness-test target and modify some decriptions format

Signed-off-by: zyy17 <zyylsxm@gmail.com>
 2022-12-12 13:03:49 +08:00
zyy17 61e0f1a11c refactor: add tls option in frontend cli options (#735) 
* refactor: add tls option in frontend cli options

* fix: add 'Eq' trait for fixing clippy error

* fix: remove redundant clone

Signed-off-by: zyy17 <zyylsxm@gmail.com>
 2022-12-12 10:02:17 +08:00
Ruihang Xia 95b2d8654f fix: pre-cast to avoid tremendous match arms (#734) 
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-09 17:20:03 +08:00
Ning Sun 249ebc6937 feat: update pgwire and refactor pg auth handler (#732) v0.1.0-alpha-20221212-weekly 2022-12-09 17:01:55 +08:00
Ruihang Xia 42fdc7251a fix: Fix common grpc expr (#730) 
* fix compile errors

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* rename fn names

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix styles

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix wranings in common-time

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-09 14:24:04 +08:00
elijah c1b8981f61 refactor(mito): change the table path to schema/table_id (#728) 
refactor: change the table path to `schema/table_id`
 2022-12-09 12:59:16 +08:00
Jiachun Feng 949cd3e3af feat: move_value & delete_route (#707) 
* feat: move_value & delete_route

* chore: minor refactor

* chore: refactor unit test of metaclient

* chore: map to kv

* Update src/meta-srv/src/service/router.rs

Co-authored-by: Yingwen <realevenyag@gmail.com>

* Update src/meta-srv/src/service/router.rs

Co-authored-by: Yingwen <realevenyag@gmail.com>

* chore: by code review

Co-authored-by: Yingwen <realevenyag@gmail.com>
 2022-12-09 11:07:48 +08:00
SSebo b26982c5d7 feat: support timestamp new syntax (#697) 
* feat: support timestamp new syntax

* fix: not null at end of new time stamp index syntax

* chore: simplify code
 2022-12-09 10:52:14 +08:00
Ruihang Xia d0892bf0b7 fix: Fix compile error in server subcrate (#727) 
* fix: Fix compile error in server subcrate

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* remove unused type alias

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* explicitly panic

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* Update src/storage/src/sst/parquet.rs

Co-authored-by: Yingwen <realevenyag@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
Co-authored-by: Yingwen <realevenyag@gmail.com>
 2022-12-08 20:27:53 +08:00
Ruihang Xia fff530cb50 fix common record batch 
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-08 17:58:53 +08:00
Yingwen b936d8b18a fix: Fix common::grpc compiler errors (#722) 
* fix: Fix common::grpc compiler errors

This commit refactors RecordBatch and holds vectors in the RecordBatch
struct, so we don't need to cast the array to vector when doing
serialization or iterating the batch.

Now we use the vector API instead of the arrow API in grpc crate.

* chore: Address CR comments
 2022-12-08 17:51:20 +08:00
Lei, HUANG 1bde1ba399 fix: row group pruning (#725) 
* fix: row group pruning

* chore: use macro to simplify stats implemetation

* fxi: CR comments

* fix: row group metadata length mismatch

* fix: simplify code
 2022-12-08 17:44:04 +08:00
Ruihang Xia 3687bc7346 fix: Fix tests and clippy for common-function subcrate (#726) 
* further fixing

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix all compile errors in common function

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix tests

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix clippy

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* revert test changes

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-08 17:01:54 +08:00
fys 4fdf26810c feat: support auth in frontend (#688) 
* feat: add UserProvider trait

* chore: minor fix

* support pg mysql

* refactor and add some logs

* chore: add license

Co-authored-by: shuiyisong <xixing.sys@gmail.com>
 2022-12-08 11:51:52 +08:00
Ruihang Xia 587bdc9800 fix: fix other compile error in common-function (#719) 
* further fixing

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix all compile errors in common function

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-08 11:38:07 +08:00
dennis zhuang 7f59758e69 feat: bump opendal version to 0.22 (#721) 
* feat: bump opendal version to 0.22

* fix: LoggingLayer
 2022-12-08 11:19:21 +08:00
Yingwen 58c26def6b fix: fix argmin/percentile/clip/interp/scipy_stats_norm_pdf errors (#718) 
fix: fix argmin/percentile/clip/interp/scipy_stats_norm_pdf compiler errors
 2022-12-07 19:55:07 +08:00
Ruihang Xia 6f3baf96b0 fix: fix compile error for mean/polyval/pow/interp ops (#717) 
* fix: fix compile error for mean/polyval/pow/interp ops

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* simplify type bounds

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-07 16:38:43 +08:00
Yingwen a898f846d1 fix: Fix compiler errors in argmax/rate/median/norm_cdf (#716) 
* fix: Fix compiler errors in argmax/rate/median/norm_cdf

* chore: Address CR comments
 2022-12-07 15:28:27 +08:00
Ruihang Xia a562199455 Revert "fix: fix compile error for mean/polyval/pow/interp ops" 
This reverts commit fb0b4eb826.
 2022-12-07 15:13:58 +08:00
Ruihang Xia fb0b4eb826 fix: fix compile error for mean/polyval/pow/interp ops 
Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-07 15:12:28 +08:00
Zheming Li a521ab5041 fix: set default value when fail to get git info instead of panic (#696) 
fix: set default value when fail to git info instead of panic
 2022-12-07 13:16:27 +08:00
LFC 833216d317 refactor: directly invoke Datanode methods in standalone mode (part 1) (#694) 
* refactor: directly invoke Datanode methods in standalone mode

* test: add more unit tests

* fix: get rid of `println` in testing codes

* fix: resolve PR comments

* fix: resolve PR comments

Co-authored-by: luofucong <luofucong@greptime.com>
 2022-12-07 11:37:59 +08:00
Yingwen 2ba99259e1 feat: Implements diff accumulator using WrapperType (#715) 
* feat: Remove usage of opaque error from common::recordbatch

* feat: Remove opaque error from common::query

* feat: Fix diff compiler errors

Now common_function just use common_query's Error and Result. Adds
a LargestType associated type to LogicalPrimitiveType to get the largest
type a logical primitive type can cast to.

* feat: Remove LargestType from NativeType trait

* chore: Update comments

* feat: Restrict Scalar::RefType of WrapperType to itself

Add trait bound `for<'a> Scalar<RefType<'a> = Self>` to WrapperType

* chore: Address CR comments

* chore: Format codes
 2022-12-07 11:13:24 +08:00
Ruihang Xia 551cde23b1 Merge branch 'dev' into replace-arrow2 2022-12-07 10:50:27 +08:00
Ruihang Xia 90c832b33d refactor: drop support of physical plan query interface (#714) 
* refactor: drop support of physical plan query interface

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* refactor: collapse server/grpc sub-module

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* refactor: remove unused errors

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-06 19:23:32 +08:00
LFC 8959dbcef8 feat: Substrait logical plan (#704) 
* feat: use Substrait logical plan to query data from Datanode in Frontend in distributed mode

* fix: resolve PR comments

* fix: resolve PR comments

* fix: resolve PR comments

Co-authored-by: luofucong <luofucong@greptime.com>
 2022-12-06 19:21:57 +08:00
Yingwen 653906d4fa fix: Fix common::query compiler errors (#713) 
* feat: Move conversion to ScalarValue to value.rs

* fix: Fix common::query compiler errors

This commit also make InnerError pub(crate)
 2022-12-06 16:45:54 +08:00
Ruihang Xia 829ff491c4 fix: common-query subcrate (#712) 
* fix: record batch adapter

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

* fix error enum

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>

Signed-off-by: Ruihang Xia <waynestxia@gmail.com>
 2022-12-06 16:32:52 +08:00
Yingwen b32438e78c feat: Fix some compiler errors in common::query (#710) 
* feat: Fix some compiler errors in common::query

* feat: test_collect use vectors api
 2022-12-06 15:32:12 +08:00
Lei, HUANG 0ccb8b4302 chore: delete datatypes based on arrow2 2022-12-06 15:01:57 +08:00