de9abd129d
feat(backend): add EXIT_AFTER_NO_JOB_FOR_SECS for ephemeral workers
2023-04-28 00:09:48 +02:00
4387db275f
fix run_wait_result polling + make it configurable
2023-04-27 07:35:53 +02:00
0b7bad3816
feat(backend): add JOB_RETENTION_SECS to delete completed jobs completed after expiration period
2023-04-26 19:34:54 +02:00
4a34e83b56
minor worker tags nit
2023-04-26 01:54:09 +02:00
670ba51d9b
feat(backend): workers are instantly ready and sync with global cache in background
2023-04-21 09:45:25 +02:00
369dd0dac6
feat(backend): global cache refactor for pip using tar for each dependency ( #1443 )
...
* cache refactor
* exclude tar from being synced to bucket
* run
* update
* update
2023-04-20 20:05:12 +02:00
62d196ecec
add barrier when num workers > 1
2023-04-19 17:00:03 +02:00
29848ae466
add barrier when num workers > 1
2023-04-19 12:46:25 +02:00
0e77e37fbd
feat(ee): sync cache in background
2023-04-19 00:55:51 +02:00
34f48aa1e3
split worker.rs into more files
2023-04-13 17:44:47 +02:00
3932e5dfb9
add GOPRIVATE and NETRC for private modules
2023-04-11 19:55:38 +02:00
d45e6c94ab
feat(backend): Redis based queue ( #1324 )
...
* Merge?
* Fix V8 breaking change
* WIP
* WIP
* Cleanup
* Move to git reference
* Fix Merge conflict
* update
---------
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2023-04-11 12:24:13 +02:00
f2d3c8208b
feat(backend): add instance events webhook
2023-04-11 01:45:56 +02:00
3097510550
only register prometheus metrics if they are enabled
2023-04-09 15:39:25 +02:00
94eecea02b
feat(backend): add /ready endpoint for workers
2023-04-05 10:34:25 +02:00
3e5ff8682a
feat: do cache bucket syncing in background + check tar before pushing it ( #1360 )
...
* all
* improve tar caching
2023-04-04 01:34:11 +02:00
00b70d9aaa
feat(backend): increase timeout for premium workspace
2023-03-26 18:56:40 +02:00
47a7f7163a
feat(backend): introduce RESTART_ZOMBIE_JOBS and ZOMBIE_JOB_TIMEOUT
2023-03-23 12:47:49 +01:00
944795f6ee
feat(deno): add support for custom npm repo ( #1291 )
...
* feat(deno): add support for custom npm repo
* feat(deno): add support for custom npm repo
* feat(deno): fix comment being on wrong line
* feat(deno): review feedback
2023-03-14 22:23:44 +01:00
580388ce19
Add support for binding server listener to a specific IP address ( #1253 )
2023-03-02 08:01:50 +01:00
05f568fb8c
display startup info in all cases
2023-02-28 17:52:47 +01:00
c0b87cc7d7
send a webhook on new user + lazy static refactor ( #1203 )
...
* supercharge
* supercharge
* progress
* progress
* display config
* display config
* display config
* display config
* fix extensions
* fix build
* disable nsjail = false for test
2023-02-15 10:59:50 +01:00
3f318b4ac4
add license key check
2023-01-15 12:06:37 +01:00
cd7bc33b6a
re-enable picking groups
2022-12-20 07:18:10 +01:00
876e140626
change the default number of connections to 3 for workers
2022-12-19 18:59:46 +01:00
4daf5c18fa
usage tracker v3
2022-12-12 01:11:44 +01:00
8a4282ef6a
disable nsjail by default
2022-11-25 16:31:15 +01:00
8846ca5856
feat: supercache extended to all version
2022-11-18 20:17:23 +01:00
bd09884955
feat(backend): sync cache features on all workers [enterprise] ( #907 )
...
* Periodic Job
* Add write lock & bash execution
* Use env for bash script
* Enterprise Feature
* Only time based
* Cleanup
* Move code
* Use rclone sync
* WIP
* Use buildarg
* Remove unecessary deps
* 10 Minute Intervals
* Revert testing change
* Manually pull rclone
* fix rclone
* Initial sync
* Update worker.rs
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2022-11-18 17:20:39 +01:00
0034129a30
restructure the entire backend layout using workspaces ( #815 )
2022-10-29 11:58:06 +02:00
8475e31740
UX flow improvements + fix collecting results for loops in frontend + fix Identity behavior in backend
2022-10-27 18:50:32 +02:00
188171126c
fix export to tarball
2022-10-27 00:43:51 +02:00
0199007d46
improve python parsing of imports
2022-10-27 00:19:17 +02:00
9a67607b20
feat: payload capture of json to initialize flow input ( #655 )
...
* capture table and some endpoints for json pastebin
* only retain user's most recent captures
* merge conflict
* sqlx data
* fix migration
Co-authored-by: sqwishy <somebody@froghat.ca >
2022-10-25 00:54:53 +02:00
40bfc486c7
add resume_id to job_resume + add identity module
2022-10-24 14:48:28 +02:00
0f4ffd29dd
fix get_suspended_job_flow module finding
2022-10-24 10:37:21 +02:00
e7d000a6d7
fix get_suspended_job_flow
2022-10-24 10:18:23 +02:00
17d9f38d30
fix(deno-client): add approver
2022-10-24 02:24:44 +02:00
a0b2c9e77d
feat: add approver to approval step
2022-10-24 01:50:39 +02:00
884edd7715
fix: improve approval flow with approval page
2022-10-22 13:55:12 +02:00
90c7b0c89d
fix send tx for kill
2022-10-22 00:34:36 +02:00
e0b86e958f
feat(backend): propagate cancel instantly to all flow jobs if any
2022-10-21 22:00:52 +02:00
8f40d3b117
fix import script from hub
2022-10-21 19:38:33 +02:00
ac84b76909
fix(backend): avoid mem leak on interval #786
2022-10-21 12:15:03 +02:00
8ec33c5e16
feat: support running and publishing go, python scripts to the hub ( #779 )
2022-10-20 20:16:08 +02:00
3fb5ec08b0
Add more tracing ( #773 )
2022-10-20 07:40:58 +02:00
55d3f38b8b
More Metrics ( #735 )
...
* Expose Worker Tokio Metrics
* Add metrics tracking the job queue
This can be used to (approximate) the queue length
This can be used to (approximate) the running jobs
* Remove testing code
* Rename metrics to exclude TOTAL_
* Sleep in worker metrics loop
* Add jobs_executed
* Add zombie job metrics
* Add uptime metric
* Fix metric naming
* Remove poll stats
* unify worker execution metrics
* Rename jobs_* metrics
* Rename metrics to match exposed name
* Remove leftover import
* Rename variables to match further
* Fix Merge error
Co-authored-by: Ruben Fiszel <ruben@rubenfiszel.com >
2022-10-19 10:15:42 +02:00
2350a39335
remove erronous pull created_by
2022-10-19 04:10:41 +02:00
c03c3afcb4
make get job more reliable
2022-10-19 03:54:41 +02:00
f4ff43ec49
nits
2022-10-19 03:41:56 +02:00
Ruben Fiszel
Kai Jellinghaus
Ryan Rich
Ryan Rich