Files
windmill/frontend/src/lib/components
centdix 3199f9fffd feat(ai agent): allow multiple images input for ai agent + code cleaning (#6591)
* add in frontend

* draft openai handling

* upload to s3

* simpler output

* return s3 directly if any

* low quality

* implement for gemini

* handle imagen model

* handle image input

* cleaning

* remove base64 from output

* cleaning

* fix timeout

* handle openrouter

* remove log

* allow image input when creating image

* cleaning

* increase stack size

* inline everything

* revert stack size

* refactor: move AI executor types to separate module

- Created ai module structure with types.rs
- Moved all type definitions from ai_executor.rs to ai/types.rs
- No functional changes, just code organization

* refactor: add QueryBuilder trait and provider detection utilities

- Created QueryBuilder trait for abstracting provider-specific logic
- Added helper functions for provider detection (is_anthropic_provider)
- Implemented placeholder QueryBuilder for all providers
- Updated OpenAIRequest to use slices instead of Vec references
- All providers now have QueryBuilder implementations (using default for now)

* feat: implement OpenAI query builder with image support foundation

- Created proper OpenAI query builder implementation
- Added image_handler module for S3 upload/download utilities
- Separated text and image request building logic
- Added prepare_messages_for_api to handle S3Object conversion
- Foundation laid for supporting tools with image output

* refactor(ai): complete AI executor refactoring with query builder pattern

- Created modular structure under ai/ module
- Moved all types to ai/types.rs
- Created QueryBuilder trait for provider abstraction
- Implemented OpenAI query builder with image+tools support
- Added unified agent runner supporting both text and image outputs with tools
- Refactored run_agent to delegate to new unified implementation
- Added image handler utilities for S3 operations
- Improved code organization and maintainability

* cleaning

* feat(ai): implement remaining provider query builders

- Added Anthropic query builder with proper message conversion
- Added Google AI query builder with Gemini API support
- Added OpenRouter query builder delegating to OpenAI for compatibility
- Added missing Anthropic and Gemini types to types.rs
- Fixed type references and compilation errors
- All providers now support the unified query builder interface

* fixes

* fixes

* mime type + cleaning

* image to images

* handle mutlitple images

* fix

* remove agent_runner file

* clean query builder logic

* cleaning

* cleaning

* hide structured_output based on output type

* fix

* user images and not nested

* better descriptions
2025-09-17 16:55:54 +00:00
..
2025-09-13 10:30:52 +00:00
2025-09-11 07:57:01 +00:00
2025-09-17 12:15:33 +00:00
2025-09-09 21:04:23 +00:00
2025-09-11 07:57:01 +00:00
2025-09-11 16:12:36 +00:00
2025-09-11 16:12:36 +00:00
2025-09-11 16:12:36 +00:00
2025-09-12 13:24:08 +00:00
2025-09-17 11:00:39 +00:00
2025-09-09 21:04:23 +00:00
2025-09-17 12:15:33 +00:00
2025-09-11 16:12:36 +00:00
2025-07-29 19:28:54 +00:00
2025-08-20 22:40:57 +00:00
2025-06-13 08:47:27 +02:00
nit
2025-05-21 12:06:22 +02:00
2025-09-13 10:52:27 +00:00
2025-08-14 11:30:10 +00:00
2025-06-28 21:46:49 +00:00
2025-09-11 16:12:36 +00:00
2025-09-11 16:12:36 +00:00
2025-04-03 11:48:59 +00:00
2025-06-28 20:13:55 +02:00
2025-08-10 23:24:36 +00:00
2025-07-19 06:59:49 +00:00
2025-08-07 17:52:47 +00:00
2025-09-11 06:58:39 +00:00
2025-09-11 01:07:39 +00:00
2025-09-11 16:12:36 +00:00
2025-09-11 16:12:36 +00:00
nit
2025-09-11 16:16:24 +00:00
2025-06-30 00:07:35 +00:00
2025-09-01 10:53:56 +00:00
2025-07-17 22:15:01 +00:00
2025-07-29 19:28:54 +00:00
2025-07-08 06:47:08 +00:00
2025-09-09 21:04:23 +00:00
2025-07-29 19:28:54 +00:00
2025-06-28 20:13:55 +02:00
2025-05-07 13:36:38 +02:00
2025-09-09 21:04:23 +00:00
2025-05-28 01:21:22 +02:00
2025-07-22 07:52:39 +00:00