Commit Graph

255 Commits

Author SHA1 Message Date
Ruben Fiszel 1849cd8398 remove unecessary comment in worker 2022-08-21 12:10:03 +02:00
Ruben Fiszel 34e69bfe5d remove unecessary transaction in worker 2022-08-21 12:08:15 +02:00
Ruben Fiszel 1a552d1517 optimize python parsing + adding tests 2022-08-21 10:53:41 +02:00
Ruben Fiszel c0e9cd0564 fix: cancel a flow now does the expected behavior 2022-08-20 19:23:43 +02:00
Ruben Fiszel 0cd814cfec fix(backend): clear_schedule only clear non running jobs 2022-08-20 19:14:16 +02:00
Ruben Fiszel 77a685144d fix(backend): started_at info for completed_job is no more completed_at 2022-08-20 17:06:13 +02:00
Ruben Fiszel d99d4aaa92 optimize for python code having no imports 2022-08-20 16:21:04 +02:00
Ruben Fiszel e38cec3b17 fix collection on forloops + increase number of tests 2022-08-20 16:08:11 +02:00
Ruben Fiszel 00572668f1 feat: rely on PG time rather than worker time 2022-08-20 15:16:08 +02:00
sqwishy 32d067f8c0 feat(backend): failure_module (#452)
* run failure_module

- renames FlowModule.input_transform to input_transforms
- parse_deno_signature prints source on failure instead of debug
  representation of AST

* s/should_continue_job/should_continue_flow
2022-08-19 20:18:07 +02:00
sqwishy bae85732ff fix(backend): fixes forloop with 257 items only iterates once (#446)
usize as u8 will mask out the higher bits, so 0x100 as u8 is 0x00, 0x101
is 0x01 and only iterates once, etc....

refactors push_next_flow_job a bit
2022-08-19 17:14:46 +02:00
Ruben Fiszel 8c04558c4e pass BASE_INTERNAL_URL to the python process 2022-08-19 07:09:50 +02:00
Ruben Fiszel ea6f3c037c pass BASE_INTERNAL_URL to the deno process 2022-08-19 07:02:10 +02:00
Ruben Fiszel 9f02ca8dec fix export to tarball 2022-08-19 00:55:38 +02:00
Ruben Fiszel c2f616da0d use ts extension for private imports 2022-08-18 22:18:57 +02:00
Ruben Fiszel a5343fa959 feat: private imports 2022-08-18 21:49:24 +02:00
Ruben Fiszel 451bddf015 fix behavior of disable nsjail and disable nuser 2022-08-18 17:22:16 +02:00
Ruben Fiszel ae90c1cfed fix forloop empty no step afterward 2022-08-18 00:01:04 +02:00
Ruben Fiszel 561e13e51e fix: handle 0 length for-loops in the backend (#440)
* wip

* TODO

* my fix works I think
2022-08-17 15:56:49 +02:00
Ruben Fiszel 99594ff968 remove zendesk 2022-08-16 23:45:58 +02:00
Ruben Fiszel e606118943 fix(backend): collecting result when for loop is not the last step #422
* wip: step after forloop results

Adding a failing test so I don't forget out about it.

In the last step, `items` is `4`, the last item in iteration, rather
than the collected list.  My guess is this is because the results aren't
collected unless the flow quits early or the forloop module is the last
module so that `last_step` is true.

* test

Co-authored-by: sqwishy <somebody@froghat.ca>
2022-08-16 23:03:55 +02:00
Ruben Fiszel 824e91bbc7 pass path as env variable 2022-08-15 13:51:16 +02:00
Ruben Fiszel 064ae59338 make executable paths configurable 2022-08-15 13:32:51 +02:00
Ruben Fiszel 1275f5f7fb fix: set secure only for https 2022-08-15 10:40:01 +02:00
Ruben Fiszel 92d1a3a441 remove hardcoded paths when nsjail is disabled 2022-08-15 10:08:40 +02:00
Ruben Fiszel 1b377f8f02 set local authorization -> set role 2022-08-14 23:33:09 +02:00
Ruben Fiszel 1c40f01e5d feat: db users: admin -> windmill_admin, app -> windmill_user (#404)
* feat: db users: admin -> windmill_admin, app -> windmill_user

* clean up

* backend tests

* backend tests

* backend tests

* lock roles in first migration

* check if user is superuser too

* add init-db

* add init-db
2022-08-14 18:20:27 +02:00
Ruben Fiszel c8dca072dd remove println 2022-08-13 21:20:50 +02:00
Ruben Fiszel 845de82062 feat: add literal object type support (#401) 2022-08-13 21:18:54 +02:00
Ruben Fiszel 0384727a56 feat: support union type will null | undefined (#400) 2022-08-13 19:35:52 +02:00
Ruben Fiszel e68ea1b8fc feat: support union types (#398) 2022-08-13 17:25:16 +02:00
Ruben Fiszel cb43802c69 full backend ci tests
* attempt ci in container

* attempt ci in container

* psql

* psql

* psql

* psql

* privileged

* cache
2022-08-12 11:21:19 +02:00
sqwishy 91bc88b574 make initialize_tracing sync and infallable (#395)
also remove tiny bit of raceyness from worker tests, there's a bit of
sync around Once but it's short so it should be fine
2022-08-12 10:44:41 +02:00
sqwishy 08d1a35009 pass broadcast::Receiver instead of Sender (#396)
I think this was just added a couple months ago.  If all Senders drop
the Receivers close.  This change helps avoid creating Senders that you
never send on that are just held in scope and prevent the channel from
closing.
2022-08-12 10:43:06 +02:00
sqwishy 65e275556d remove unused mutex parameter for run_worker (#394) 2022-08-12 10:42:46 +02:00
Ruben Fiszel 359d3899a2 fix schedule bug 2022-08-12 04:03:39 +02:00
Ruben Fiszel 9e371fcff0 disable nsjail for test 2022-08-12 03:31:50 +02:00
Ruben Fiszel 42c20c4527 fix test_eval_timeout 2022-08-12 02:05:59 +02:00
sqwishy b462a5a733 backend tests for python job and deno flow (#389) 2022-08-12 01:50:31 +02:00
Ruben Fiszel 464a594e37 update backend + 404 on non found assets 2022-08-11 21:00:53 +02:00
sqwishy 881cea41dd ping hub.windmill.dev/getip for external ip without using only reqwest (#384) 2022-08-11 01:01:24 +02:00
sqwishy 56e082b17c correct query param number in delete_token (#380) 2022-08-09 17:57:03 +02:00
Ruben Fiszel 7dfce17e1d fix replacement 2022-08-09 15:57:56 +02:00
Ruben Fiszel 0bd882c4fb fix replacement 2022-08-09 15:48:28 +02:00
Ruben Fiszel 42cb8e9afe psycopg2 => binary 2022-08-09 15:17:01 +02:00
sqwishy 6b2ff5a87f DATABASE_CONNECTIONS sets Pool max_connections (#376)
If unspecified, defaults to the current value of 100
2022-08-09 09:47:48 +02:00
Ruben Fiszel 785d3ea4e7 raise limit to 200000 chars 2022-08-08 13:57:39 +02:00
Ruben Fiszel a613b45f8b surface better the transform_json_value step errors 2022-08-08 11:54:01 +02:00
Ruben Fiszel cdf2d2f7df increase limit to 900s over the last 1200s 2022-08-07 14:39:57 +02:00
Ruben Fiszel 8153718166 do rate limit based on as_permissioned_as 2022-08-07 14:04:17 +02:00