discord9
2d0f493040
feat(flow): render reduce ( #3769 )
...
* feat: render reduce
* fix: distinct input dedup&change per review
* chore: typos
* fix: eval_distinct_core&per review
* chore: typos
* docs: more comment on accums internal
* chore: per review
* chore: rebase to main
2024-04-25 09:35:12 +00:00
Zhenchi
659d34a170
refactor(flow): refine comments and code ( #3785 )
...
* refactor(flow): refine comments and code
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* doc: description of the properties of removed keys
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: `get`'s fast path for cur val
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: discord9 <discord9@163.com >
2024-04-24 07:09:53 +00:00
discord9
d4b814f698
refactor(flow): split render.rs and other minor changes ( #3750 )
...
* refactor: split render.rs
* chore: per review
* chore: per review
* chore: docs explain `apply_updates` behavior
* chore: per review
2024-04-22 09:48:09 +00:00
LFC
314f2704d4
build(deps): update datafusion to latest and arrow to 51.0 ( #3661 )
...
* chore: update datafusion
* update sqlness case of time.sql
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: adjust range query partition
* fix: hisogram incorrect result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: ignore filter pushdown temporarily
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: update limit sqlness result
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: histogram with wrong distribution
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: update negative ordinal sqlness case
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* feat: bump df to cd7a00b
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve conflicts
* ignore test_range_filter
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix promql exec panic
* fix "select count(*)" exec error
* re-enable the "test_range_filter" test since the filter push down seems not necessary to be removed
* fix: range query schema error
* update sqlness results
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* resolve conflicts
* update datafusion, again
* fix pyo3 compile error, and update some sqlness results
* update decimal sqlness cases
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* fix: promql literal
* fix udaf tests
* fix filter pushdown sqlness tests
* fix?: test_cast
* fix: rspy test fail due to datafusion `sin` signature change
* rebase main to see if there are any failed tests
* debug ci
* debug ci
* debug ci
* enforce input partition
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
* debug ci
* fix ci
* fix ci
* debug ci
* debug ci
* debug ci
* fix sqlness
* feat: do not return error while creating a filter
* chore: remove array from error
* chore: replace todo with unimplemented
* Update src/flow/clippy.toml
Co-authored-by: Yingwen <realevenyag@gmail.com >
---------
Signed-off-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: Ruihang Xia <waynestxia@gmail.com >
Co-authored-by: WUJingdi <taylor-lagrange@qq.com >
Co-authored-by: discord9 <discord9@163.com >
Co-authored-by: evenyag <realevenyag@gmail.com >
Co-authored-by: tison <wander4096@gmail.com >
2024-04-18 12:07:18 +00:00
discord9
db329f6c80
feat(flow): transform substrait SELECT&WHERE&GROUP BY to Flow Plan ( #3690 )
...
* feat: transofrm substrait SELECT&WHERE&GROUP BY to Flow Plan
* chore: reexport from common/substrait
* feat: use datafusion Aggr Func to map to Flow aggr func
* chore: remove unwrap&split literal
* refactor: split transform.rs into smaller files
* feat: apply optimize for variadic fn
* refactor: split unit test
* chore: per review
2024-04-12 07:38:42 +00:00
discord9
c00c1d95ee
chore(flow): more comments&lint ( #3680 )
...
* chore: more comments&lint
* chore: per review
* chore: remove abundant dep
2024-04-10 03:31:22 +00:00
discord9
ea9367f371
refactor(flow): func spec api&use Error not EvalError in mfp ( #3657 )
...
* refactor: func's specialization& use Error not EvalError
* docs: some pub item
* chore: typo
* docs: add comments for every pub item
* chore: per review
* chore: per reveiw&derive Copy
* chore: per review&test for binary fn spec
* docs: comment explain how binary func spec works
* chore: minor style change
* fix: Error not EvalError
2024-04-09 02:32:02 +00:00
discord9
28fd0dc276
feat(flow): render map&related tests ( #3581 )
...
* feat: render map&related tests
* chore: license header
* chore: update Cargo.lock&remove unused
* refactor: rename ComputeState to DataflowState
* chore: use org fork
* chore: fix typos
* chore: per review
* chore: more explain to use `VecDeque` in err collector
* chore: typos
* chore: more comment on `Plan::Let`
* chore: typos
* refactor mfp rendering
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
* fix: update `now` in closure
* feat: use insert_local
* chore: remove unused
* chore: per review
* chore: fmt comment
---------
Signed-off-by: Zhenchi <zhongzc_arch@outlook.com >
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com >
2024-04-08 11:36:07 +00:00
dimbtp
dd18d8c97b
build(deps): remove some unused dependencies ( #3582 )
...
* build(deps): remove some unused dependencies
* add `arc-swap` dependency back
2024-03-26 12:48:28 +00:00
discord9
9f020aa414
fix(flow): Arrange get range with batch unaligned ( #3552 )
...
* fix: Arrange get range with batch unaligned
* chore: per review
* refactor: sort at apply_updates
2024-03-22 04:08:37 +00:00
discord9
2c115bc22a
feat(flow): shared in-memory state for dataflow operator ( #3508 )
...
* feat: Arrangement shared state
* feat: arrange&tests
* docs: detailed&tests for get
* chore: license
* refactor: opt out ts expr&tests: internal ts
* docs: remove some TODOs
* feat: use smallvec size of 2
* refactor: per review
* chore: per review
* chore: per review
* chore: remove reduant clone
* feat: return max expire time&docs: more explain cur expire config
2024-03-19 10:03:05 +00:00
discord9
58bd065c6b
feat(flow): plan def ( #3490 )
...
* feat: plan def
* chore: add license
* docs: remove TODO done
* chore: add derive Ord
2024-03-12 10:59:07 +00:00
discord9
7639c227ca
feat(flow): accumlator for aggr func ( #3396 )
...
* feat: Accumlator trait
* feat: add `OrdValue` accum&use enum_dispatch
* test: more accum test
* feat: eval aggr funcs
* chore: refactor test&fmt clippy
* refactor: less verbose
* test: more tests
* refactor: better err handling&use OrdValue for Count
* refactor: ignore null&more tests for error handle
* refactor: OrdValue accum
* chore: extract null check
* refactor: def&use fn signature
* chore: use extra cond with match guard
* chore: per review
2024-03-12 02:09:27 +00:00
gcmutator
21ff3620be
chore: remove repetitive words ( #3469 )
...
remove repetitive words
Signed-off-by: gcmutator <329964069@qq.com >
2024-03-09 04:18:47 +00:00
discord9
dbb1ce1a9b
feat(flow): impl for MapFilterProject ( #3359 )
...
* feat: mfp impls
* fix: after rebase
* test: temporal filter mfp
* refactor: more comments&test
* test: permute
* fix: check input len when eval
* refactor: err handle&docs: more explain graph
* docs: better flowchart map,filter,project
* refactor: visit_* falliable
* chore: better temp lint allow
* fix: permute partially
* chore: remove duplicated checks
* docs: more explain&tests for clarity
* refactor: use ensure! instead
2024-02-27 08:13:55 +00:00
SteveLauC
e9a2b0a9ee
chore: use workspace-wide lints ( #3352 )
...
* chore: use workspace-wide lints
* respond to review
2024-02-22 01:01:10 +00:00
discord9
860b1e9d9e
feat(flow): impl ScalarExpr&Scalar Function ( #3283 )
...
* feat: impl for ScalarExpr
* feat: plain functions
* refactor: simpler trait bound&tests
* chore: remove unused imports
* chore: fmt
* refactor: early ret on first error
* refactor: remove abunant match arm
* chore: per review
* doc: `support` fn
* chore: per review more
* chore: more per review
* fix: extract_bound
* chore: per review
* refactor: reduce nest
2024-02-21 12:53:16 +00:00
discord9
c62c67cf18
feat: Basic Definitions for Expression&Functions for Dataflow ( #3267 )
...
* added expression&func
* fix: EvalError derive&imports
* chore: add header
* feat: variadic func
* chore: minor adjust
* feat: accum
* feat: use accum for eval func
* feat: montonic min/max as accumulative
* feat: support min/max Date&DateTime
* chore: fix compile error&add test(WIP)
* test: sum, count, min, max
* feat: remove trait impl for EvalError
* chore: remove all impl retain only type definitions
* refactor: nest datatypes errors
* fix: remove `.build()`
* fix: not derive Clone
* docs: add comment for types
* feat: more func&remove `CurrentDatabase`
2024-02-05 07:49:34 +00:00
discord9
0a9361a63c
feat: basic types for Dataflow Framework ( #3186 )
...
* feat: basic types for Dataflow Framework
* docs: license header
* chore: add name in todo, remove deprecated code
* chore: typo
* test: linear&repr unit test
* refactor: avoid mod.rs
* feat: Relation Type
* feat: unmat funcs
* feat: simple temporal filter(sliding window)
* refactor: impl Snafu for EvalError
* feat: cast as type
* feat: temporal filter
* feat: time index in RelationType
* refactor: move EvalError to expr
* refactor: error handling for func
* chore: fmt&comment
* make EvalError pub again
* refactor: move ScalarExpr to scalar.rs
* refactor: remove mod.rs for relation
* chore: slim down PR size
* chore: license header
* chore: per review
* chore: more fix per review
* chore: even more fix per review
* chore: fmt
* chore: fmt
* feat: impl From/Into ProtoRow instead
* chore: use cast not cast_with_opt&`Key` struct
* chore: new_unchecked
* feat: `Key::subset_of` method
* chore: toml in order
2024-01-30 07:48:22 +00:00
