Commit Graph

717 Commits

Author SHA1 Message Date
sqwishy 655a55777d backend tests for python job and deno flow (#389) 2022-08-12 01:50:31 +02:00
Ruben Fiszel 5a7168b372 update backend + 404 on non found assets 2022-08-11 21:00:53 +02:00
sqwishy 1b48c2c1cf ping hub.windmill.dev/getip for external ip without using only reqwest (#384) 2022-08-11 01:01:24 +02:00
sqwishy bc3c69c554 correct query param number in delete_token (#380) 2022-08-09 17:57:03 +02:00
Ruben Fiszel 887ba750f9 fix replacement 2022-08-09 15:57:56 +02:00
Ruben Fiszel 0d9d24bb1b fix replacement 2022-08-09 15:48:28 +02:00
Ruben Fiszel fc0a83ee6d psycopg2 => binary 2022-08-09 15:17:01 +02:00
sqwishy 2926fc54f4 DATABASE_CONNECTIONS sets Pool max_connections (#376)
If unspecified, defaults to the current value of 100
2022-08-09 09:47:48 +02:00
Ruben Fiszel 0a9332187f raise limit to 200000 chars 2022-08-08 13:57:39 +02:00
Ruben Fiszel 85c1559c9f surface better the transform_json_value step errors 2022-08-08 11:54:01 +02:00
Ruben Fiszel 53b19b871c increase limit to 900s over the last 1200s 2022-08-07 14:39:57 +02:00
Ruben Fiszel 373d8085a7 do rate limit based on as_permissioned_as 2022-08-07 14:04:17 +02:00
Ruben Fiszel 69dcdbd00b fix: update logs even if last new log was < 500ms 2022-08-07 13:48:37 +02:00
Ruben Fiszel a831cb1472 rewrite kill wait 2022-08-07 12:55:21 +02:00
Ruben Fiszel 084cc8a2dd prevent log spam abuse 2022-08-07 12:50:28 +02:00
Ruben Fiszel 503b56b3db more logging around command executions 2022-08-07 12:25:45 +02:00
Ruben Fiszel 23a2b3389b more logging around command executions 2022-08-07 12:00:41 +02:00
Ruben Fiszel 20a2b5808c audit logs for all execute case 2022-08-07 11:14:00 +02:00
Ruben Fiszel feeaf5d963 add summary field for modules 2022-08-06 23:37:17 +02:00
Ruben Fiszel dcb5d8deb9 rework input transform for the forloop module 2022-08-06 14:02:39 +02:00
Ruben Fiszel 9f3a191b3b fix(python): not filled field with default <function_call> now call the default function 2022-08-06 12:51:14 +02:00
Ruben Fiszel 837a500a1a display inputs in flow viewer too 2022-08-06 09:30:10 +02:00
Ruben Fiszel 6026e32c98 improve error message for parsing 2022-08-06 08:45:37 +02:00
Ruben Fiszel 323fd30a00 rework default python script 2022-08-05 20:21:13 +02:00
Ruben Fiszel 02fd242bb7 feat: _value, _index => iter.value, iter.index 2022-08-05 20:11:25 +02:00
Ruben Fiszel 5d3cd541c7 fix: do not skip undefined values 2022-08-05 19:53:28 +02:00
Ruben Fiszel 449fb27a53 feat: remove res1 wrapping 2022-08-05 19:47:00 +02:00
Ruben Fiszel cd8db7a015 do not cache html, cache everything else for a long time 2022-08-05 11:00:41 +02:00
Ruben Fiszel 5cc1ae2c05 fix flowstatusviewer and updating to in_progress much sooner 2022-08-05 00:46:10 +02:00
Ruben Fiszel fe81c17d2f fix(backend): generalize oauth clients to take in extra params 2022-08-04 14:32:04 +02:00
Ruben Fiszel 644f8cfe37 fix(backend): handle better some flow edge-cases 2022-08-04 01:50:47 +02:00
Ruben Fiszel cd9bd29931 fix(backend): handle better some flow edge-cases 2022-08-04 01:48:53 +02:00
Ruben Fiszel 089f4a7811 fix(backend): handle better some flow edge-cases 2022-08-04 01:13:12 +02:00
sqwishy 6c71fac136 fix(backend): prometheus histogram for worker job timer (#312)
* prometheus histogram for worker job timer

hosts on :8001

* some new metrics in worker + field

adds start_time_seconds, job_duration_seconds & jobs_failed

* use tokio task_local to count job failures

* METRICS_ADDR environment variable off by default

true defaults to 0.0.0.0:8001 otherwise expects a socket address

* pass metrics as args instead of task local
2022-08-02 22:56:25 +02:00
Ruben Fiszel 5e14b6dfb3 feat: add primitive sql format (#320) 2022-08-02 16:55:20 +02:00
Ruben Fiszel 31904be890 update current job to in progress 2022-07-31 22:47:07 +02:00
Ruben Fiszel d397e6d618 update current job to in progress 2022-07-31 22:41:41 +02:00
Ruben Fiszel c37b9f7106 do not serialize the whole object for job in progress update 2022-07-31 22:31:44 +02:00
Ruben Fiszel a368d2c6d4 order result from forloop bby args _index 2022-07-31 20:41:35 +02:00
Ruben Fiszel 03ed38e9b2 only check for schedule if not a flow step 2022-07-31 20:30:30 +02:00
Ruben Fiszel 7f55e7a498 report flow for whom the fetching error is happening 2022-07-31 20:23:03 +02:00
Ruben Fiszel 4df819554e report flow for whom the fetching error is happening 2022-07-31 19:53:19 +02:00
Ruben Fiszel abcd25dbff error for flow of length 0 2022-07-31 19:15:05 +02:00
Ruben Fiszel 2483072d81 improve error messages 2022-07-31 19:01:46 +02:00
Ruben Fiszel e82e5fff56 transferring copyright from ruben to windmill labs 2022-07-30 14:09:41 +02:00
Ruben Fiszel ae2aa7b8f8 more errors 2022-07-30 01:10:01 +02:00
sqwishy 9a632befdd job duration to ms & added to /api/w/*/users/list (#261)
* add jobs_duration to /api/w/*/users/list

A few improvements on this might be considered.

- Adding the duration to /whoami and /whois
- Optionally fetching duration conditional on a query parameter.
- Using the query parameter value to select how far back to look,
  `created_at > now() - $2 * '1 day'::interval`.

Subquery might not be optimal, but performance is a bit weird to test
right now as I haven't done much with my development database to get it
to resemble a typical (production) database.  And there aren't many
indexes currently either.

And I think my rust rustfmt doesn't run because unstable options in the
rustfmt.toml or something so the formatting might be a bit wonky.

* duration -> duration_ms for completed_job

sqlx reordered keys in sqlx-data.json so the diff is quite noisy. I'm
not sure if I did it wrong or if this tool is obnoxious that way.

* don't double count job duration in flows

* job_duration_ms to Usage duration_ms jobs flows

rustfmt got carried away sorry
2022-07-30 00:02:51 +02:00
Ruben Fiszel 8037e390db cargo fmt II 2022-07-29 21:35:50 +02:00
Ruben Fiszel d4b5a0ea3d cargo fmt 2022-07-29 21:29:59 +02:00
Ruben Fiszel fed1849256 protect against ill-defined state for flows restart 2022-07-29 21:14:56 +02:00