Commit Graph
1616 Commits
Author SHA1 Message Date
Ruben Fiszel f0b939cd3a add barrier when num workers > 1 2023-04-19 17:00:03 +02:00
Ruben Fiszel 26c7e9e8c3 add barrier when num workers > 1 2023-04-19 12:46:25 +02:00
Ruben Fiszel fb0983bcb3 feat(ee): sync cache in background 2023-04-19 01:15:41 +02:00
Ruben Fiszel 89d0bea9fa feat(ee): sync cache in background 2023-04-19 00:55:51 +02:00
Ruben Fiszel 4934dc454f only cache on first worker 2023-04-18 21:23:29 +02:00
Ruben Fiszel 5e2ca89137 log how much time took each command child 2023-04-18 08:55:26 +02:00
Ruben Fiszel 66c532affc improve bash output buffering 2023-04-18 01:42:28 +02:00
Ruben Fiszel 732d61f190 performance: process completed job in background (#1396)
* compile

* improve
2023-04-15 11:06:51 +02:00
Ruben Fiszel 556dbce239 feat(backend): install python scripts on save 2023-04-13 22:57:53 +02:00
Ruben Fiszel c2b66fef4f do a test run on first iteration 2023-04-13 21:54:42 +02:00
Ruben Fiszel be41e45130 split worker.rs into more files 2023-04-13 17:44:47 +02:00
Ruben Fiszel 94098c23e0 fix refreshOn 2023-04-13 09:22:52 +02:00
Ruben Fiszel 90ce302f2d fix(backend): deno uses --no-check 2023-04-13 00:22:46 +02:00
Ruben Fiszel 4dc1773dc7 fix(backend): do not fail on schedule not existing anymore 2023-04-12 20:06:50 +02:00
Ruben Fiszel 53c4c744c4 exclude deno/gen/file from global cache 2023-04-12 19:18:48 +02:00
Ruben Fiszel e8611ba8c1 add GOPRIVATE and NETRC for private modules 2023-04-11 19:55:38 +02:00
Ruben Fiszel c4366b9ef4 fix relative url deno loading2 2023-04-11 15:57:59 +02:00
Ruben Fiszel df8236a03f fix(backend): nested deno relative imports 2023-04-11 15:16:55 +02:00
Kai JellinghausandRuben Fiszel 63102b036c feat(backend): Redis based queue (#1324)
* Merge?

* Fix V8 breaking change

* WIP

* WIP

* Cleanup

* Move to git reference

* Fix Merge conflict

* update

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-04-11 12:24:13 +02:00
Ruben Fiszel 66d2ae813a fix tests + scheduled_for uses now instead of system time 2023-04-11 11:48:14 +02:00
Ruben Fiszel 613cd64003 improve metrics 2023-04-10 11:58:44 +02:00
Ruben Fiszel 621bb282af improve metrics 2023-04-10 11:53:32 +02:00
Ruben Fiszel 415be7c70f perf: parallelize more operations for deno jobs 2023-04-10 10:55:56 +02:00
Ruben Fiszel b7b26dc9c7 improve token lock 2023-04-10 08:00:41 +02:00
Ruben Fiszel 6ab4f30026 fetch token in the background 2023-04-10 01:16:15 +02:00
Ruben Fiszel a23a14f9f2 make create_token_for_owner not a transaction anymore 2023-04-09 21:47:05 +02:00
Ruben Fiszel bbb6a15da7 only register prometheus metrics if they are enabled 2023-04-09 15:39:25 +02:00
Ruben Fiszel ff22759a43 deno optimization v0 2023-04-09 14:10:56 +02:00
Ruben Fiszel 36e338c461 feat(backend): extend cached resolution for go 2023-04-09 10:58:45 +02:00
Ruben Fiszel 130ddbbf85 feat(python): cache dependency resolution 2023-04-08 23:25:46 +02:00
Ruben Fiszel a59cdeff11 show status code when possible 2023-04-08 20:09:27 +02:00
Ruben Fiszel 917e0f7549 reduce verbosity of cache sync 2023-04-08 15:55:09 +02:00
Ruben Fiszel 1b15de87a3 reduce verbosity of cache sync 2023-04-08 15:48:07 +02:00
Ruben Fiszel 198dd9e8ff remove deno nsjail in favor of deno sandboxing 2023-04-08 15:25:10 +02:00
Ruben Fiszel 0a06e89ff0 add GOPATH to go mod tidy 2023-04-07 00:49:57 +02:00
Ruben Fiszel 796632abb5 fix(frontend): make croninput a builder rather than a tab 2023-04-06 23:57:42 +02:00
Ruben Fiszel 8864593eed set schema on script template change 2023-04-06 23:28:03 +02:00
Ruben Fiszel 48046f631b fix(backend): inline script app python fix 2023-04-05 18:26:27 +02:00
Oliver VealandRuben Fiszel 0b444ce395 feat: improved cron/schedule editor (#1362)
* basic cron schedule editing ui

* schedules run in a user-specified timezone

* fix other uses of CronInput component

* use now() from database to schedule next job

* offset -> IANA timezone conversion on db migration

* sqlx ci

---------

Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com>
2023-04-05 16:37:24 +02:00
Ruben Fiszel b81868e025 do no keep tar around and move it from the tmp folder 2023-04-05 15:02:37 +02:00
Ruben Fiszel b64c9f6569 feat(backend): add /ready endpoint for workers 2023-04-05 10:34:25 +02:00
Ruben Fiszel ca8e6c0da8 initialize cache if from tar 2023-04-04 16:31:47 +02:00
Ruben Fiszel 970f8ea6da fix polar handling 2023-04-04 14:25:27 +02:00
Ruben Fiszel c08d8c4d9d kill the background bucket sync if necessary 2023-04-04 11:33:07 +02:00
Ruben Fiszel 13cfef1a05 only sync after the cache has been initialized 2023-04-04 11:03:25 +02:00
Ruben Fiszel 13c1fc3f0a create the first dirs properly 2023-04-04 09:29:08 +02:00
Ruben Fiszel 873af06911 first sync of the cache is at least after the first sync duration 2023-04-04 09:06:19 +02:00
Ruben Fiszel 43a7b7b4b9 log the entirecache.tar length 2023-04-04 08:32:20 +02:00
Ruben Fiszel 6e2d99ead3 only copy cache from bucket in background the first time 2023-04-04 08:24:02 +02:00
Ruben Fiszel 0bec54edfd feat: do cache bucket syncing in background + check tar before pushing it (#1360)
* all

* improve tar caching
2023-04-04 01:34:11 +02:00