Commit Graph
661 Commits
Author SHA1 Message Date
Hengfei Yang f4c3423129 perf: improve ingester with memory (#2382) 2024-01-07 23:52:43 +08:00
bokuweb 54912e92ea refactor: Remove unnecessary methods (#2406)
refactor: Remove unnecessary methods
2024-01-07 12:34:30 +08:00
Ashish Kolhe 460d51e995 fix: telemetry changes (#2404) 2024-01-06 18:29:59 +05:30
bokuweb 59eee77da2 refactor: use impl From for datafusion error (#2403)
refactor: datafusion error. we might use `impl From` for error
conversion.
2024-01-06 18:09:38 +08:00
Ankur Srivastava 64c6e3848d fix: RSS reduction due to lazily loading ua-parser (#2400)
UserAgent parser is currently used exclusively in RUM related
middleware. Loading it lazily when RUM data is ingested results in
significant RSS reduction at the startup of O2.
2024-01-05 13:21:21 +01:00
Ashish Kolhe 52c02feeac chore: dex integration changes (#2360) 2024-01-05 13:04:02 +05:30
Ankur Srivastava dd6b7ebf10 fix: use geo-location country-iso also in the data (#2389)
This also contains a small fix for mmdb initialization. Ensure the
initialization happens only first time or when file is updated
2024-01-04 16:07:36 +01:00
Hengfei Yang bb927db797 chore: delete migrate-file-list-from-dynamo (#2361) 2024-01-03 11:32:46 +08:00
Hengfei Yang e0a1ef7a26 fix: keeping optimize search (#2321) 2024-01-03 09:45:47 +08:00
Ashish Kolhe 726f997670 fix: build failure fixes (#2343) 2024-01-01 21:15:06 +05:30
94ca726e55 fix: dynamic filters (#2323)
- Use dynamic filters as a checkbox compared to part of variables
- In the Dashboard's general settings, will get an option to show
dynamic filters apart from set variables

---------

Co-authored-by: Kirtan Thakkar <kirtan@kiara.tech>
Co-authored-by: ktx-abhay <abhay.padamani@kiara.tech>
2024-01-01 17:35:43 +05:30
ktx-abhay ca83d6ddc2 feat: decimal point option in config panel (#2327)
![image](https://github.com/openobserve/openobserve/assets/141122205/379213fc-70ac-4348-8ccd-ffa3f8f21946)

- configure decimal point using config panel.
- default value will be 2.
- #2178
2024-01-01 13:25:01 +05:30
Hengfei Yang a4bae1a584 feat: Implement memtable + wal (#2261) 2023-12-28 07:40:22 +08:00
Ashish Kolhe ed99055b48 fix: organisation check for jwt auth flow (#2320) 2023-12-27 18:39:16 +05:30
Ashish Kolhe d59b89f14b fix: vrl functions on query (#2315) 2023-12-26 18:42:56 +05:30
Prabhat Sharma d9065d68e3 fix: add human friendly geoip URL (#2309) 2023-12-26 17:33:43 +08:00
Ashish Kolhe 197637bef8 feat: maxmind asn db as vrl enrichment table (#2308)
- [x] download maxmind asn db for 02 use
- [x] add maxmind asn db as enrichment table for vrl
- [x] fix search issue when no vrl query is present
2023-12-25 22:35:25 +05:30
Ashish Kolhe ad52d80a1e fix: vrl function for query execution (#2306)
vrl functions during query make query execution very slow, which makes
function unusable, the PR aims to fix this by:

- [x] applying functions on query results rather than complete data set
and then applying query filters

This will result in values for derived field values not being returned
for _values api
2023-12-25 16:34:54 +05:30
Hengfei Yang c17ddab3db feat: add API for alert preview (#2303) 2023-12-24 23:10:26 +08:00
Hengfei Yang 10bfe2c867 ci: update rust version (#2301) 2023-12-24 14:23:46 +08:00
Ashish Kolhe 3cc141d778 fix: user api checks (#2294)
- [x] Check role during User Creation
- [x] Added checks during User Deletion/removal from org
2023-12-23 22:48:59 +05:30
Ashish Kolhe 582f728b4b fix: parse ldap dn changes (#2283) 2023-12-22 18:05:17 +05:30
Ashish Kolhe 122d5d52c4 feat: dex integration (#2277) 2023-12-22 09:05:46 +05:30
Ankur Srivastava 01ba091210 feat: control redirection of a user to ingestions (#2273)
Control redirection of a user to ingestions page in case no data This is
an extension to #2173, just that user can now control this behavior.

```
ZO_RESTRICTED_ROUTES_ON_EMPTY_DATA=false cargo run
curl -s -u user:pass -k http://localhost:5080/config | jq .restricted_routes_on_empty_data
```
2023-12-21 12:32:34 +01:00
Hengfei Yang 9adfb47f3d feat: impl alert row template (#2244) 2023-12-19 12:55:59 +08:00
Hengfei Yang ab4dafcd8f fix: Fixed some small issues (#2241)
Fixed some small issues

- [x] #2174
- [x] #2234
2023-12-18 10:00:53 -08:00
4ac1dcb53c feat: support structured logging (#2230)
The idea behind this PR is to generate logs in a structured-json
format, such that we can use automated tooling to parse and debug
O2 logs as well.

If logs are to be written and analysed in files, one can enable:
`ZO_LOG_FILE_DIR=/tmp/openobserve`
The output file will be of format -
`/tmp/openobserve/o2.log.2023-12-18-10`
and it will be rotated daily.

And add a new environment `ZO_LOG_JSON_FORMAT=false`, set to `true` to
enable json format.

---------

Co-authored-by: Ankur Srivastava <ankur@grover.com>
Co-authored-by: hengfeiyang <hengfei.yang@gmail.com>
2023-12-18 17:49:48 +01:00
Ankur SrivastavaandAnkur Srivastava d93db9d84f fix: parsing of o2tags + ootags (#2228)
We renamed `oo` prefix in RUM related data to `o2`, but tags werent
being parsed properly.
This PR fixes it

Co-authored-by: Ankur Srivastava <ankur@grover.com>
2023-12-18 14:41:59 +01:00
Hengfei Yang 27c8d2420f chore: update datafusion to 34 (#2222) 2023-12-18 10:49:08 +08:00
baerwangandHengfei Yang 7b32681617 feat: cli import or export data (#2071)
feat #2056

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2023-12-16 12:45:09 +08:00
Hengfei Yang 90dcd0d90e fix: #2201 (#2207) 2023-12-15 18:29:53 +08:00
Hengfei Yang b210fb0146 fix: add keyword search for values API (#2191) 2023-12-14 17:03:38 +08:00
Hengfei Yang 8d9d38f60d fix: add empty name check (#2184)
fixed #2171
2023-12-14 11:23:58 +08:00
Juan Calderon-PerezandHengfei Yang 4a63ea9d7b fix: Use generic response for bad requests (#2176)
The response from a bad "User Update" request should be generic and not
indicate if an account already exists.

Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
2023-12-13 19:28:03 +05:30
Bhargav d3a5f7b126 fix: billing changes (#2146) 2023-12-13 12:12:12 +05:30
Hengfei Yang 6b47e7660e fix: compaction issues (#2172) 2023-12-13 09:33:47 +08:00
Hengfei Yang 48c555a076 fix: #2147 (#2163) 2023-12-12 15:35:13 +08:00
ktx-abhayandktx-keshavi 7921208ae6 feat: gauge chart in dashboard for sql and promql queries (#1902)
Gauge chart for SQL and promql query

![image](https://github.com/openobserve/openobserve/assets/141122205/2008f62e-c58f-43cb-900c-e76319218eeb)

![image](https://github.com/openobserve/openobserve/assets/141122205/028f9b4f-6dc3-4d6c-ac28-1916f016fe70)


Support for setting the minimum and maximum values of the Gauge Chart
per query in the configuration panel.

![image](https://github.com/openobserve/openobserve/assets/141122205/d2b39da6-4e00-4901-bf41-87760ab70311)

---------

Co-authored-by: ktx-keshavi <keshavi.bhalani@kiara.tech>
2023-12-11 17:55:36 +05:30
Hengfei Yang 64b3f9a2c6 fix: traces with upto (#2157) 2023-12-11 17:39:07 +08:00
Hengfei Yang 3f56710605 feat: apply stream level bloom filter settings (#2153)
fix #1659
2023-12-11 11:11:38 +08:00
Ashish Kolhe 6d9afc71de feat: ldap integration - enterprise (#2145) 2023-12-08 14:34:05 +05:30
Hengfei Yang 60a0511d2b feat: add aggregation support for alert (#2148)
impl #2142 backend
2023-12-08 12:58:24 +08:00
ktx-abhay 929aee67d6 feat: specify interval for histogram aggregation function (#2090)
- #2021
2023-12-07 19:49:24 +05:30
Hengfei Yang 1b0b8c2bf5 chore: update format (#2144)
fixed #2102
2023-12-07 10:10:45 +05:30
Hengfei Yang 15c734cb16 feat: add bloomfilter for setting API (#2143)
impl #1659 add setting api for bloom filter
2023-12-07 11:37:09 +08:00
ktx-abhayandktx-keshavi 235ce796dc feat: built in support for top N results (#1994)
- #1052

---------

Co-authored-by: ktx-keshavi <keshavi.bhalani@kiara.tech>
2023-12-06 17:25:30 +05:30
Hengfei Yang d3b6fd0084 fix: optimise alert message (#2139) 2023-12-06 12:29:39 +08:00
Ashish Kolhe c3db0b13ef chore: arrow streams for traces (#2133) 2023-12-05 19:22:15 +05:30
Ashish Kolhe e97f26befb chore: optimisations to arrow flow (#2122)
- [x] Remove clones
2023-12-04 12:45:48 +05:30
Ankur Srivastava dda1670b1c fix: download mmdb files and initialize the client (#2116)
This PR fixes the scenario when, the client wont be initialized if the
file wasnt downloaded.
for e.g. if someone restarted the server and the mmdb file was already
present the client will not be initialized.
2023-12-02 20:15:28 -08:00