discord9
8f6462c0b0
feat: parse expire when
2024-05-10 14:52:22 +08:00
discord9
46d0b3cd64
fix: table name trying best to get full name
2024-05-10 14:52:22 +08:00
discord9
a17a7f4e47
feat: working poc demo...ish
2024-05-10 14:52:22 +08:00
discord9
50335dd53c
write back seems didn't work
2024-05-10 14:52:22 +08:00
discord9
abaf881f06
refactor: tableName as array
2024-05-10 14:52:22 +08:00
discord9
e1a8215394
tests(WIP): get demo working
2024-05-10 14:52:22 +08:00
discord9
d7942a1a00
fix: make worker handle async
2024-05-10 14:52:22 +08:00
discord9
a6727e2e8d
refactor: use table name for sink table
2024-05-10 14:52:22 +08:00
discord9
d5bdbedcd6
refactor: rwlock for frontend invoker&async lock
2024-05-10 14:51:44 +08:00
discord9
878737f781
feat: integrate flow to standalone(untested)
2024-05-10 14:51:44 +08:00
discord9
d88cff6f51
feat: impl Flownode for FlowNodeManager
2024-05-10 14:51:44 +08:00
discord9
e7801abd0c
feat(WIP): simple parser
2024-05-10 14:51:44 +08:00
discord9
d7a132a02f
chore: remove some TODO done
2024-05-10 14:51:44 +08:00
discord9
a3417f50cf
refactor: rename some task to flow
2024-05-10 14:51:44 +08:00
discord9
099f414f63
chore: rename some task to flow
2024-05-10 14:51:44 +08:00
discord9
c22185abce
refactor: make worker sync only and separate thread&test
2024-05-10 14:51:44 +08:00
discord9
e33afa53f4
feat: grpc trait&Server trait
2024-05-10 14:51:44 +08:00
discord9
7eaf471808
feat(WIP): main loop
2024-05-10 14:51:44 +08:00
discord9
acba753500
chore: remove unused
2024-05-10 14:51:44 +08:00
discord9
5736373820
feat impl grpc server
2024-05-10 14:51:44 +08:00
discord9
74dee25688
feat: new() for FlowNodeManager
2024-05-10 14:51:44 +08:00
discord9
edcbc89c38
feat: gen write back req
2024-05-10 14:51:44 +08:00
discord9
e88a40b58b
refactor: use seperate Worker
2024-05-10 14:51:44 +08:00
discord9
c7647759be
feat(WIP): FlowWorker: !Send
2024-05-10 14:51:44 +08:00
discord9
d8a191a2db
refactor: FlowNodeContext
2024-05-10 14:51:44 +08:00
discord9
ea40691c71
chore: some unfinished tests
2024-05-10 14:51:44 +08:00
discord9
640674b9bc
feat: get table schema
2024-05-10 14:51:44 +08:00
discord9
3fb3fb18c2
tests: add one for Send
2024-05-10 14:51:44 +08:00
discord9
1067d3453d
feat: dataflow adapter
2024-05-10 14:51:44 +08:00
discord9
57e3912aca
feat(WIP): FlowNodeManager
2024-05-10 14:51:44 +08:00
discord9
ebcfb0f1d7
feat: now types of errors
2024-05-10 14:51:44 +08:00
discord9
6442c96847
feat: render src/sink
2024-05-10 14:51:44 +08:00
discord9
b19febc97c
feat: sql_to_flow_plan
2024-05-10 14:51:44 +08:00
discord9
8240a1ace1
feat: find all used collection
2024-05-10 14:51:44 +08:00
discord9
2d0f493040
feat(flow): render reduce ( #3769 )
...
* feat: render reduce
* fix: distinct input dedup&change per review
* chore: typos
* fix: eval_distinct_core&per review
* chore: typos
* docs: more comment on accums internal
* chore: per review
* chore: rebase to main
2024-04-25 09:35:12 +00:00
Zhenchi
659d34a170
refactor(flow): refine comments and code ( #3785 )
...
* refactor(flow): refine comments and code
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* doc: description of the properties of removed keys
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: `get`'s fast path for cur val
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: discord9 <discord9@163.com >
2024-04-24 07:09:53 +00:00
discord9
d4b814f698
refactor(flow): split render.rs and other minor changes ( #3750 )
...
* refactor: split render.rs
* chore: per review
* chore: per review
* chore: docs explain `apply_updates` behavior
* chore: per review
2024-04-22 09:48:09 +00:00
LFC
314f2704d4
build(deps): update datafusion to latest and arrow to 51.0 ( #3661 )
...
* chore: update datafusion
* update sqlness case of time.sql
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: adjust range query partition
* fix: hisogram incorrect result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: ignore filter pushdown temporarily
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: update limit sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: histogram with wrong distribution
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: update negative ordinal sqlness case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: bump df to cd7a00b
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve conflicts
* ignore test_range_filter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix promql exec panic
* fix "select count(*)" exec error
* re-enable the "test_range_filter" test since the filter push down seems not necessary to be removed
* fix: range query schema error
* update sqlness results
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve conflicts
* update datafusion, again
* fix pyo3 compile error, and update some sqlness results
* update decimal sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: promql literal
* fix udaf tests
* fix filter pushdown sqlness tests
* fix?: test_cast
* fix: rspy test fail due to datafusion `sin` signature change
* rebase main to see if there are any failed tests
* debug ci
* debug ci
* debug ci
* enforce input partition
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* debug ci
* fix ci
* fix ci
* debug ci
* debug ci
* debug ci
* fix sqlness
* feat: do not return error while creating a filter
* chore: remove array from error
* chore: replace todo with unimplemented
* Update src/flow/clippy.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: WUJingdi <taylor-lagrange@qq.com >
Co-authored-by: discord9 <discord9@163.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-18 12:07:18 +00:00
discord9
db329f6c80
feat(flow): transform substrait SELECT&WHERE&GROUP BY to Flow Plan ( #3690 )
...
* feat: transofrm substrait SELECT&WHERE&GROUP BY to Flow Plan
* chore: reexport from common/substrait
* feat: use datafusion Aggr Func to map to Flow aggr func
* chore: remove unwrap&split literal
* refactor: split transform.rs into smaller files
* feat: apply optimize for variadic fn
* refactor: split unit test
* chore: per review
2024-04-12 07:38:42 +00:00
discord9
c00c1d95ee
chore(flow): more comments&lint ( #3680 )
...
* chore: more comments&lint
* chore: per review
* chore: remove abundant dep
2024-04-10 03:31:22 +00:00
discord9
ea9367f371
refactor(flow): func spec api&use Error not EvalError in mfp ( #3657 )
...
* refactor: func's specialization& use Error not EvalError
* docs: some pub item
* chore: typo
* docs: add comments for every pub item
* chore: per review
* chore: per reveiw&derive Copy
* chore: per review&test for binary fn spec
* docs: comment explain how binary func spec works
* chore: minor style change
* fix: Error not EvalError
2024-04-09 02:32:02 +00:00
discord9
28fd0dc276
feat(flow): render map&related tests ( #3581 )
...
* feat: render map&related tests
* chore: license header
* chore: update Cargo.lock&remove unused
* refactor: rename ComputeState to DataflowState
* chore: use org fork
* chore: fix typos
* chore: per review
* chore: more explain to use `VecDeque` in err collector
* chore: typos
* chore: more comment on `Plan::Let`
* chore: typos
* refactor mfp rendering
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: update `now` in closure
* feat: use insert_local
* chore: remove unused
* chore: per review
* chore: fmt comment
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2024-04-08 11:36:07 +00:00
dimbtp
dd18d8c97b
build(deps): remove some unused dependencies ( #3582 )
...
* build(deps): remove some unused dependencies
* add `arc-swap` dependency back
2024-03-26 12:48:28 +00:00
discord9
9f020aa414
fix(flow): Arrange get range with batch unaligned ( #3552 )
...
* fix: Arrange get range with batch unaligned
* chore: per review
* refactor: sort at apply_updates
2024-03-22 04:08:37 +00:00
discord9
2c115bc22a
feat(flow): shared in-memory state for dataflow operator ( #3508 )
...
* feat: Arrangement shared state
* feat: arrange&tests
* docs: detailed&tests for get
* chore: license
* refactor: opt out ts expr&tests: internal ts
* docs: remove some TODOs
* feat: use smallvec size of 2
* refactor: per review
* chore: per review
* chore: per review
* chore: remove reduant clone
* feat: return max expire time&docs: more explain cur expire config
2024-03-19 10:03:05 +00:00
discord9
58bd065c6b
feat(flow): plan def ( #3490 )
...
* feat: plan def
* chore: add license
* docs: remove TODO done
* chore: add derive Ord
2024-03-12 10:59:07 +00:00
discord9
7639c227ca
feat(flow): accumlator for aggr func ( #3396 )
...
* feat: Accumlator trait
* feat: add `OrdValue` accum&use enum_dispatch
* test: more accum test
* feat: eval aggr funcs
* chore: refactor test&fmt clippy
* refactor: less verbose
* test: more tests
* refactor: better err handling&use OrdValue for Count
* refactor: ignore null&more tests for error handle
* refactor: OrdValue accum
* chore: extract null check
* refactor: def&use fn signature
* chore: use extra cond with match guard
* chore: per review
2024-03-12 02:09:27 +00:00
gcmutator
21ff3620be
chore: remove repetitive words ( #3469 )
...
remove repetitive words
Signed-off-by: gcmutator <329964069@qq.com >
2024-03-09 04:18:47 +00:00
discord9
dbb1ce1a9b
feat(flow): impl for MapFilterProject ( #3359 )
...
* feat: mfp impls
* fix: after rebase
* test: temporal filter mfp
* refactor: more comments&test
* test: permute
* fix: check input len when eval
* refactor: err handle&docs: more explain graph
* docs: better flowchart map,filter,project
* refactor: visit_* falliable
* chore: better temp lint allow
* fix: permute partially
* chore: remove duplicated checks
* docs: more explain&tests for clarity
* refactor: use ensure! instead
2024-02-27 08:13:55 +00:00
SteveLauC
e9a2b0a9ee
chore: use workspace-wide lints ( #3352 )
...
* chore: use workspace-wide lints
* respond to review
2024-02-22 01:01:10 +00:00
