Ruben Fiszel
157e4d8e53
improve bun dedicated worker to use nodejs
2024-05-01 02:10:58 +02:00
Ruben Fiszel
2c8f2668c2
migrate bun dedicated worker to readline
2024-05-01 00:38:16 +02:00
Ruben Fiszel
b7c54a9eec
print lines for dedicated worker in debug mode
2024-04-30 23:48:21 +02:00
Ruben Fiszel
b5db06d742
add base_internal_url to dedicated python workers
2024-04-30 22:48:40 +02:00
Ruben Fiszel
c6e1fa8dc4
add stderr to debug log of dedicated workers
2024-04-30 21:10:05 +02:00
Ruben Fiszel
1cac7bf239
more logs for dedicated workers
2024-04-30 17:19:34 +02:00
Ruben Fiszel
2cb1595cae
fix(python): supports folders starting with numbers for execution
2024-04-30 11:23:48 +02:00
Ruben Fiszel
4c3567cbf1
fix: fix console logs in REST scripts
2024-04-30 10:46:20 +02:00
HugoCasa
3feaf90273
feat: add resource and variable picker for rest scripts ( #3628 )
...
* feat: add resource and variable picker for rest scripts
* feat: add reserved variables to rest scripts
2024-04-29 12:13:21 +02:00
Ruben Fiszel
89aec0d7c7
feat(cli): split inline sscripts for apps like for flows
2024-04-28 14:55:33 +02:00
Ruben Fiszel
75730d410d
rm go bin if cloud hosted
2024-04-26 13:42:24 +02:00
Ruben Fiszel
e2798ef7a3
rm go bin if cloud hosted
2024-04-26 13:40:52 +02:00
HugoCasa
e8905b2734
feat: pg add json support ( #3620 )
2024-04-26 13:28:15 +02:00
Ruben Fiszel
bbc8bece4c
fix backend tests
2024-04-26 13:27:24 +02:00
Ruben Fiszel
1ee928dd9e
small fixes
2024-04-26 11:38:44 +02:00
Ruben Fiszel
e27d2c0d35
feat: add distributed global cache for go
2024-04-26 11:31:21 +02:00
HugoCasa
efe8b1a339
feat: add support for readonly application intent in mssql ( #3591 )
2024-04-23 14:08:51 +02:00
Ruben Fiszel
5f4188890e
fix: improve re-scheduled for estimation in concurrency limits
2024-04-21 12:41:30 +02:00
Ruben Fiszel
8cb1e4846c
increase pg size limit for cloud
2024-04-21 10:20:50 +02:00
wendrul
c3325c2cbf
Instrument logs ( #3566 )
...
* Add spans to show worker_name and job_id
Always show worker_name and job_id when relevant, by creating spans that
live as long as the worker and the job.
* Remove redundant worker names from fn run_worker
Remove the now redundant worker_name tracing, as the information now
lives at the span level
* Use span when spawning new thread
* Instrument more pertinent functions
Move spans to more pertinent functions. Remove more redundant info, and
change worker_name to just worker
* Change tracing subscriber to log path:line_no
Change from logging target (module name usually) to file path and line
number
2024-04-18 01:11:14 +02:00
Ruben Fiszel
da3ded6196
fix: measure memory usage on postgres scripts
2024-04-18 01:05:16 +02:00
Ruben Fiszel
cb6efb08a2
feat: show more for logs on s3 directly possible from browser log viewer
2024-04-17 21:42:46 +02:00
HugoCasa
c23fdc1585
fix: add mysql decimal support ( #3557 )
2024-04-15 14:26:17 +02:00
Ruben Fiszel
a1d2c59fce
feat: flow concurrency limits support custom concurrency key
2024-04-09 22:03:39 +02:00
Ruben Fiszel
6ad1b37844
fix: improve performance of for-loops with parralelism
2024-04-09 19:47:50 +02:00
Ruben Fiszel
05998e91a1
fix: improve performance of for-loops with parralelism
2024-04-09 19:41:56 +02:00
Ruben Fiszel
65b280c84b
prevent parallelism from timing out lock monitor
2024-04-09 18:50:19 +02:00
Ruben Fiszel
424a5e344e
fix: improve deadlocks for parallel branches with parallelism constraints
2024-04-09 11:52:40 +02:00
Ruben Fiszel
34fd745b2f
more error messages
2024-04-09 10:27:14 +02:00
Ruben Fiszel
ce18be6431
fix: improve deadlocks for parallel branches with parallelism constraints
2024-04-09 01:38:55 +02:00
Ruben Fiszel
10d739537d
fix: parallel flow with parallelism constraint could deadlock
2024-04-06 13:25:34 +02:00
Ruben Fiszel
ab89792187
nit global cache python improvements
2024-04-04 22:07:14 +02:00
Ruben Fiszel
1402c72212
fix: improve global cache deps
2024-04-04 21:33:44 +02:00
Ruben Fiszel
a67f093184
fix: improve chars splitting for logs with utf-8 chars
2024-04-04 13:38:19 +02:00
Ruben Fiszel
d5c1a5707b
fix: fix char excess size module for logs truncation
2024-04-04 03:25:11 +02:00
Ruben Fiszel
de66141362
add checksum log to s3 piptar pull
2024-04-02 20:55:31 +02:00
Ruben Fiszel
288b9c8ce4
feat: while loop as new flow primitive
2024-04-02 17:38:11 +02:00
Ruben Fiszel
e66d4b6708
continue on error option for steps
2024-04-02 10:32:47 +02:00
Ruben Fiszel
a913e23c35
fix: improve git sync for script renames
2024-03-26 18:21:58 +01:00
Ruben Fiszel
6b842b3c53
feat: add set_flow_user_states and get_flow_user_states api and sdk support
2024-03-26 17:31:17 +01:00
Ruben Fiszel
32de1ddfef
improve vacuum queue
2024-03-24 17:40:21 +01:00
Ruben Fiszel
ddfc7f14ec
improve vacuum queue
2024-03-24 17:28:15 +01:00
Ruben Fiszel
d63f5ee26e
fix: add support for azure storage on distributed cache/logs
2024-03-23 18:42:38 +01:00
Ruben Fiszel
3279996fd2
feat(frontend): fetch logs just-in-time only when necessary
2024-03-23 15:57:23 +01:00
HugoCasa
6b719fecea
feat: add workspace environment vars (custom contextual vars) ( #3455 )
...
* feat: custom contextual variables
* chore: sqlx prepare
* fix: main merge
2024-03-23 11:40:55 +01:00
Ruben Fiszel
2339060de1
nit newline
2024-03-23 11:33:10 +01:00
Ruben Fiszel
7714221f3e
feat: large log disk and distributed storage compaction
2024-03-23 10:55:29 +01:00
HugoCasa and Ruben Fiszel
c2d18a6d6f
feat keep sql columns ordering ( #3444 )
...
* feat: keep pg columns ordering
* feat: pass column order through flow status
* feat: sql ordering for all sql langs
* fix: sqlx build on mac + rename to _metadata
* Update JobPreview.svelte
* Update +page.svelte
* Update +page.svelte
* Update LogPanel.svelte
* Update +page.svelte
* Update LogPanel.svelte
* Update JobPreview.svelte
* fix: build
---------
Co-authored-by: Ruben Fiszel <ruben@windmill.dev >
2024-03-22 10:34:32 +01:00
Ruben Fiszel
f8d3ba12af
generalize cache object store
2024-03-21 08:50:10 +01:00
Ruben Fiszel
a012ea0768
fix compile on non ee
2024-03-20 16:55:06 +01:00
Ruben Fiszel
HugoCasa
wendrul
