Ning Sun 480b05c590 feat: pipeline dispatcher part 2: execution (#5409) ...

* fmt: correct format

* test: add negative tests

* feat: Add pipeline dispatching and execution output handling

* refactor: Enhance ingest function to correctly process original data values

custom table names during pipeline execution while optimizing the management of
transformed rows and multiple dispatched pipelines

* refactor: call greptime_identity with intermediate values

* fix: typo

* test: port tests to refactored apis

* refactor: adapt dryrun api call

* refactor: move pipeline execution code to a separated module

* refactor: update otlp pipeline execution path

* fmt: format imports

* fix: compilation

* fix: resolve residual issues

* refactor: address review comments

* chore: use btreemap as pipeline intermediate status trait modify

* refactor: update dispatcher to accept BTreeMap

* refactor: update identity pipeline

* refactor: use new input for pipeline

* chore: wip

* refactor: use updated prepare api

* refactor: improve error and header name

* feat: port flatten to new api

* chore: update pipeline api

* chore: fix transform and some pipeline test

* refactor: reimplement cmcd

* refactor: update csv processor

* fmt: update format

* chore: fix regex and dissect processor

* chore: fix test

* test: add integration test for http pipeline

* refactor: improve regex pipeline

* refactor: improve required field check

* refactor: rename table_part to table_suffix

* fix: resolve merge issue

---------

Co-authored-by: paomian <xpaomian@gmail.com>

2025-02-08 09:01:54 +00:00

..

grpc.rs

feat: support add if not exists in the gRPC alter kind (#5273)

2025-01-03 07:23:17 +00:00

http.rs

feat: pipeline dispatcher part 2: execution (#5409)

2025-02-08 09:01:54 +00:00

main.rs

feat!: enable read cache and write cache when using remote object stores (#5093)

2024-12-10 04:03:44 +00:00

region_migration.rs

fix: table resolving logic related to pg_catalog (#4580)

2024-09-09 00:47:59 +00:00

sql.rs

feat: add cursor statements (#5094)

2024-12-06 09:32:22 +00:00