Commit Graph
89 Commits
Author SHA1 Message Date
Hengfei Yang 0f5a31d0df fix: cache file for alert querier (#6573)
We already checked `ConsistentHash` on the source node, so we don't need
check again, just cache the file send to the node.
2025-04-18 19:51:04 +08:00
Hengfei Yang 595490ea33 ci: update rust to nightly-2025-03-02 (#6145) 2025-03-02 17:27:10 +08:00
Hengfei Yang 3be0d3eda3 ci: add more debug tools (#5601) 2025-01-07 12:09:48 +08:00
Hengfei Yang d6487eb9fe ci: update rust version (#5143) 2024-11-25 19:20:07 +08:00
Hengfei Yang df0a4a79ae feat: refactor merge file on compactor (#4971) 2024-11-07 17:30:10 +08:00
Hengfei Yang f78d013e54 ci: add docker build for Pi (#4964) 2024-11-01 22:14:49 +08:00
Ashish KolheandHengfei Yang 335357f943 fix: updated cached enrichment table (#4176)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced asynchronous functions for managing enrichment tables:
`notify_update`, `delete`, and `watch`.
- Added a notification mechanism to improve updates in the enrichment
data handling process.
- Enhanced deletion process for enrichment tables, reinforcing data
integrity.
- Introduced a new configuration option for maximum enrichment table
size to enhance user configurability.

- **Bug Fixes**
- Improved readability and debuggability in the monitoring process for
enrichment tables.

- **Chores**
- Updated the base image in the Dockerfile to a newer Debian version for
improved security and compatibility.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-08-11 15:14:05 +05:30
Juan Calderon-Perez 3f6e48c199 chore: Bump PR debian image (#4108) 2024-08-02 15:23:48 +08:00
Juan Calderon-Perez 29b7ca1347 chore: Bump Node.js to v18.20.4 (#4107) 2024-08-02 15:23:14 +08:00
Hengfei Yang 03f1b192c2 feat: ugprade rust to 2024-07-07 (#3922) 2024-07-08 20:56:56 +08:00
Ankur Srivastava 5f329a461b fix: ci change as -> AS in Dockerfiles (#3856)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **Chores**
- Updated Dockerfiles to use consistent casing for `AS` keyword in
`FROM` statements.
- Aligned base images and staging names across various build
architectures to use the latest `bookworm` releases.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-06-29 20:01:16 +02:00
Ankur Srivastava 0fecf9f49e ci: pin the bookworm-slim image (#3835) 2024-06-26 18:36:47 +05:30
Hengfei Yang 611f2e1c29 perf: improve ingestion (#3678) 2024-06-12 22:01:03 +08:00
Hengfei Yang d84726e5db refactor: merge parquet files interface (#3547)
Prepare for vertical partition compact, change the interface first.
2024-05-20 15:31:25 +08:00
138ac5d8fe fix: report cache and alert manager should install chrome (#3348)
Co-authored-by: Ankur Srivastava <best.ankur@gmail.com>
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2024-04-26 09:24:32 +08:00
Hengfei Yang 7e457c3538 ci: add tokio-console build (#3264) 2024-04-17 15:20:38 +08:00
Hengfei Yang 72966bdb4a ci: Profiling CPU for OpenObserve (#3183) 2024-04-06 22:53:50 +08:00
Hengfei Yang e33ae00ea1 feat: merge dev into main (#3016) 2024-03-17 22:38:07 +08:00
Hengfei Yang d745dace45 feat: search queue (#2640) 2024-02-02 18:31:51 +08:00
Hengfei Yang c057bf40f3 ci: update prod docker images (#2490) 2024-01-16 20:39:36 +08:00
Ankur Srivastava 3b386ca8ad feat: support building and publishing to registry via actions (#2405) 2024-01-08 11:24:42 +08:00
Hengfei Yang f4c3423129 perf: improve ingester with memory (#2382) 2024-01-07 23:52:43 +08:00
Hengfei Yang bb927db797 chore: delete migrate-file-list-from-dynamo (#2361) 2024-01-03 11:32:46 +08:00
Hengfei Yang a4bae1a584 feat: Implement memtable + wal (#2261) 2023-12-28 07:40:22 +08:00
Juan Calderon-Perez d475fc3cd1 chore: Bump Debian to 12 (Bookworm) (#2299) 2023-12-24 16:21:00 +08:00
Hengfei Yang 10bfe2c867 ci: update rust version (#2301) 2023-12-24 14:23:46 +08:00
Juan Calderon-Perez 0555c2f50f chore: Bump Node.js to v18.19.0 (#2278) 2023-12-22 23:33:09 +08:00
Juan Calderon-Perez cabee9c560 chore: Bump buildx to v0.12.0 (#2279) 2023-12-22 13:45:06 +08:00
Prabhat Sharma 9654427ec3 fix: add psql for debugging (#2194)
Adding psql to debug container for debugging
2023-12-15 10:15:06 +08:00
Juan Calderon-Perez 50d001464f fix: Install command for sccache (#2064) 2023-11-28 12:39:36 +08:00
Hengfei Yang f4a0a75921 feat: implement bloom filter (#1625) 2023-11-17 12:21:33 +08:00
Hengfei Yang 76fb283191 ci: upgrade rust to nightly-2023-10-24 (#1804) 2023-10-30 02:04:43 -05:00
Hengfei Yang 29a3109de3 ci: fix inner data dir permission (#1522) 2023-09-16 13:23:42 +08:00
Hengfei Yang 0739f4a9ae ci: create inner data dir (#1519) 2023-09-15 18:32:24 +08:00
Hengfei Yang 1b202e7202 fix: optimize migration (#1462) 2023-09-06 22:06:50 +08:00
Hengfei Yang 5a3173c689 feat: implement sqlite for metadata (#1449) 2023-09-04 11:00:28 +08:00
Hengfei Yang 8b74b952f7 feat: new file list (#1376) 2023-08-25 09:49:30 +08:00
Hengfei Yang 7c95c24c9d fix: ci for docker build (#1413) 2023-08-22 18:59:35 +08:00
Hengfei Yang b3189f246c perf: optimize parquet write params (#1323)
- [x] optimize parquet write params
- [x] add schedule fetch latest file_list to local cache
- [x] optimize CI for release mode
- [x] deadlock by usage report
2023-08-04 11:28:33 +05:30
Hengfei Yang 4028b89953 fix: list offset of multiple compactor (#1075) 2023-06-30 17:04:44 +08:00
Hengfei Yang 6e948632b4 feat: multiple compactors (#1066) 2023-06-30 14:00:19 +08:00
Hengfei Yang 4fb16a863f ci: add debug image for production version (#1036) 2023-06-26 18:23:59 +08:00
Hengfei Yang 86578fa987 fix: #978 extra underscore in ingesting records containing array (#986) 2023-06-19 14:10:12 +08:00
Hengfei Yang 3c855155fb fix: docker build simd version (#900) 2023-06-05 22:15:38 +08:00
Hengfei Yang fc08ffd745 ci: enable mimalloc for ARM (#884) 2023-06-03 22:46:07 +08:00
Hengfei Yang 50e901bf2a ci: add docker hub (#870)
Push docker images to ECR & Docker hub
2023-06-02 18:59:31 +08:00
Prabhat SharmaandHengfei Yang 462b0d34be docs: rename cloud (#857)
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2023-05-31 14:28:51 +08:00
Hengfei Yang 4903f41b4e ci: enable mimalloc for linux amd64 (#854) 2023-05-31 11:58:36 +08:00
Hengfei Yang 53e1a23921 feat: rename zincobserve to openobserve (#848) 2023-05-31 11:29:10 +08:00
Prabhat Sharmaandhengfeiyang 8afbc3a917 ci: constrain git hash to 7 characters forcefully (#827)
constrain git hash to 7 characters forcefully. This should avoid the
issue of arm build getting 8 characters hash and causing manifest issue
and build failure

---------

Co-authored-by: hengfeiyang <hengfei.yang@gmail.com>
2023-05-28 12:52:27 +05:30