This PR includes changes
1. introduced icons for histogram , sql mode, quickmode and moved search
history , download logs , search scheduled jobs options into menu that
will be there at right end
2. this will make the UI to accommodate upto 1200px with datetime as
relative , 1350 when it is absolute
3. introducing icons saved space of ~200px in total for both sides
implemented alerts folders in the UI
1. search across folders
2. alert listing page moved condition and description column to the
expand so whenever user clicks on any row it will show respective
condition and description if there
3. provided fixed width for columns so that all columns are in view port
visibility expect name column as it can be varied depending upon name
given by user
4. search across all folders implemented in this PR only
Import alert add ons
1 additional things done to import alert as well like introducing the
folders in import page
---------
Co-authored-by: omkark06 <omkar@zinclabs.io>
Co-authored-by: Subhradeep Chakraborty <chakrabortysubhradeep556@gmail.com>
Uses mpsc channels to process pulled scheduled jobs so that it does not
block the entire alert manager to pull other jobs when there is
capacity. Makes use of semaphores so that we pull the same number of
jobs as the number of available workers.
### The new design is -
- We spawn the same number of worker threads as the configured max concurreny env.
- After pulling jobs, it sends to each worker through the mpsc channel
- Each worker processes the received trigger
- After the scheduler interval, the puller job checks how many workers are still available i.e. how many workers are done with processing triggers.
- It only pulls the same number of jobs from db as the number of available workers at that particular time.
The cycle continues.
So, the scheduler pulls at max the "max concurrency" number of jobs at a time depending on the availability of worker threads.
Makes the following fixes to these routes:
- `ListAlerts`
- adds `enabled` to the response body
- adds `name_substring` to the request body
- `MoveAlerts`
- changes the method type to `PATCH` since this is a non-idempotent
update
- changing to `PATCH` coincidentally happens to fix a routing issue
where requests to `MoveAlerts` were being routed to the `UpdateAlerts`
handler
- `EnableAlert`
- changes the method type to `PATCH` since this is a non-idempotent
update
- `TriggerAlert`
- changes the method type to `PATCH` since this is a non-idempotent
update
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
## Release Notes
- **New Features**
- Introduced search job scheduling functionality.
- Added ability to create, list, cancel, retry, and delete scheduled
searches.
- Enhanced user interface for managing scheduled search jobs, including
a new component for displaying scheduled jobs.
- Implemented conditional rendering for search history and search
scheduler components.
- Added new methods for handling scheduled searches within the service
layer.
- **Improvements**
- Refined search bar interface with new scheduling options.
- Updated pagination handling for job-related data.
- Enhanced overall functionality related to job management and
pagination.
- Improved loading indicators and user experience during data retrieval.
- **Bug Fixes**
- Corrected conditional rendering of search history components.
- Optimized job data retrieval and pagination logic.
- Simplified sorting logic within the search history component.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
1. this PR introduces new design for query node
2. dynamic stream name for destination node instead of create new stream
it allows user to input any non existing stream name as destination and
at the time of ingestion it will be created dynamically
3. Fixes issues of #5886
---------
Co-authored-by: Taiming Liu <liutaiming3@gmail.com>
This PR adds a `source_node` field to the `triggers` stream to indicate
which alert manager processed the particular trigger. This is the name
of the node.
---------
Co-authored-by: hengfei yang <hengfei.yang@gmail.com>
**Tests covered**
- Ingest 79k fields with 100 user defined schema
- Reset stream selection while reloading home page and navigating to
logs
- Selecting stream and checking schema and values
- Go to streams page and enable store original data
- Go to stresstest stream via stream explorer
- Check if results are visible
- #5844
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
Based on the comprehensive summary of changes, here are the updated
release notes:
- **New Features**
- Added timed annotations functionality for dashboards.
- Introduced ability to create, edit, and delete annotations on panels.
- Implemented annotation management across frontend and backend systems.
- **Improvements**
- Enhanced chart rendering to support annotation visualization.
- Added new API endpoints for annotation operations.
- Improved dashboard interaction with annotation mode.
- **Backend Changes**
- Created new database migrations for timed annotations and timed
annotation panels.
- Added database entities and relationships for annotations.
- Implemented service-level logic for annotation management.
- **Frontend Changes**
- Added new components for annotation management, including
`AddAnnotation`.
- Integrated annotation services and composables.
- Updated chart rendering to display annotations and improved panel
interactivity.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Co-authored-by: ktx-vaidehi <vaidehi.akhani@kiara.tech>
Co-authored-by: Kirtan Thakkar <kirtan@kiara.tech>
Co-authored-by: Shyam Panjiyar <shyam@openobserve.ai>
Co-authored-by: ktx-vaidehi <134508096+ktx-vaidehi@users.noreply.github.com>
Co-authored-by: Huaijin <haohuaijin@gmail.com>
Co-authored-by: Neha P <144308844+neha00290@users.noreply.github.com>
Co-authored-by: Subhra264 <chakrabortysubhradeep556@gmail.com>
Co-authored-by: Hengfei Yang <hengfei.yang@gmail.com>
Co-authored-by: Bhargav <BJP232004@GMAIL.COM>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Enhanced UI testing for logs search functionality
- Added test steps to validate search query execution
- Implemented checks to ensure no error messages appear during search
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
The `Text` column type in seaorm `Model` structure might sometimes
create confusions if column is created using the `get_text_type()`
function which creates `longtext` field for mysql and `text` for other
dbs. If the db column type is `longtext` or `mediumtext` but seaorm
column type is `Text`, it may cause errors
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Database Schema Updates**
- Removed explicit column type annotations for various text fields
across multiple database tables.
- Updated nullability constraints for description and error message
fields, making some fields non-optional.
- Implemented KSUID (K-sortable unique identifier) for primary keys in
folders, dashboards, and alerts tables.
- **Migration Changes**
- Adjusted ORM model definitions for folders, dashboards, alerts, and
meta tables.
- Enhanced consistency in database schema handling.
- Added error handling for unsupported downgrades in migration scripts.
- **UI Testing Enhancements**
- Improved error reporting in the LogsPage class for better clarity on
query application failures.
- Minor formatting adjustments made for improved code readability.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Tests**
- Added new Playwright test suite for pipeline management.
- Implemented comprehensive UI interaction tests.
- Included tests for pipeline creation, deletion, and log management.
- Enhanced test coverage with parallel test execution.
- Expanded integration tests with additional scenarios for pipeline
interactions.
- Introduced a new test file for improved CI integration.
- **New Features**
- Added functionality for managing remote destinations within the
pipeline.
- Introduced new methods for creating and deleting remote destinations.
- **Bug Fixes**
- Improved the logic for selecting the current date in the logs page to
ensure accurate date selection.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
- **Bug Fixes**
- Enhanced error logging for short URL database operations, providing
better visibility into failures when adding short URLs.
- Refined date selection logic in the logs page to ensure distinct
interaction with date elements.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Shyam Panjiyar
Omkar Kesarkhane
Taiming Liu
ktx-kirtanandSubhra264
Patrick Sullivan
Neha P
dependabot[bot]
Abhay PadamaniandKirtan Thakkar
