Commit Graph
1341 Commits
Author SHA1 Message Date
Matthew Meszaros d205d8c227 feat: record the defaulted tls_unverified and tls_pin SMTP/IMAP credential fields in the published worker command Avro schema in eventschemas testdata 2026-10-24 12:44:45 +02:00
Matthew Meszaros 88e4370f1f feat: merge main into the mailbox, session and input validation branch, move the resolved MAIL_ALLOW_PRIVATE_HOSTS and MAIL_TLS_INSECURE node env lines into fleetnode.RenderEnv, renumber the mailbox TLS pin migration to 000324, and keep both sides of the configuration reference 2026-10-24 12:20:12 +02:00
Matthew Meszaros 21acf00257 feat: resume a key rotation stage that died part way from its saved intent with per-phase state tokens, deploy all to only the ECS services an install runs, fail updater --check-env while another update holds the lock, keep the running image when adopting a node, judge rollout liveness on the service clock, deny the CI roles changes to their own permissions, and validate the Terraform plan class before acting on it 2026-10-24 09:34:01 +02:00
Matthew Meszaros 9c2cffae58 feat: deploy stable releases to AWS automatically with provenance checks, a migration gate, alarm-watched waves and reverse rollback, move worker and consumer hosts in canary rollouts with host-side health rollback and opt-in env refresh, rotate instance keys inside AWS through a rotator task and the rotate-keys workflow, plan and apply the AWS Terraform from CI with approval for replacements, and add the admin Keys tab and the matching runbooks 2026-10-24 09:10:52 +02:00
Matthew Meszaros 05f9f6a3cd feat: report a Cloud pool link enrollment refused on a revoked link as pool_link_revoked from every enroll path (adopt, managed sign-in, SMTP association and enroll) and say in the Warmbly Cloud guide that the detached-link stop keeps retrying mailboxes it could not stop past its rollout window 2026-10-23 21:19:52 +02:00
Matthew Meszaros 9ef0f04efc feat: stop Cloud warmup sending and receiving once for mailboxes of pool links revoked before revocation stopped them, found through their managed sign-in and adoption records and skipped when a live link holds them, from a backend job that repeats through the rollout and then records completion in admin_settings 2026-10-23 20:47:06 +02:00
Matthew Meszaros 99197f3455 feat: commit Cloud pool link enrollments under the instance lock that revocation holds and refuse an enrollment on a revoked link in the insert itself, so every mailbox of a revoked link is stopped or never enrolled, with race and live tests and the Cloud version that applies the disconnect stop in the docs 2026-10-23 20:00:58 +02:00
Matthew Meszaros 9be5c8a3c3 feat: give API refusals stable codes and actionable messages (attempt_check_unavailable and code_lookup_limited with Retry-After, account and workspace standing codes, session_ended, reset_link_invalid, sessions_not_ended, api_credentials_revoke_unsupported, invitation_expired, image_unreadable and the other image upload codes, own-domain redirects naming the allowed domains, Pipedrive reload guidance, duplicate parameters, structured forms service errors), and show them in the dashboard, admin panel and warmbly CLI 2026-10-23 19:53:03 +02:00
Matthew Meszaros cc1dc2f64c feat: answer refused realtime handshakes with a JSON code and reason, name a reused ws ticket or signed-out session, use the not_a_member slug on org joins, warn at boot when REALTIME_ALLOW_QUERY_CREDENTIALS is on, stop the admin socket reconnecting on admin_mfa_required, not_an_admin and jwt_required with a clear message, and have the seeder, updater, webhook and notification URL checks, instance health, fleet join and log mail transport say which setting applies and what to do 2026-10-23 19:53:03 +02:00
Matthew Meszaros 3532039037 feat: explain each refused mailbox connection in plain words with what to do (a host on a private network address, sign-in offered only unencrypted, no STARTTLS, no supported AUTH mechanism, an unverified or unpinned certificate, a send whose content could not be decrypted) in the connection test, stored mailbox errors and import causes, add an optional reason to API error responses with certificate_untrusted on mailbox_tls_failed for the dashboard's trust option, and treat tls_unverified and tls_pin as post-fixture fields in the Avro envelope test 2026-10-23 19:52:54 +02:00
Matthew Meszaros f60dddb1f3 feat: stop Cloud warmup sending and receiving for every mailbox a revoked pool link enrolled before the link ends, so a detached instance's mailboxes receive no new, reply-back or queued diagnostic mail, with retryable revoke, live recipient-gate tests and Warmbly Cloud docs 2026-10-23 19:51:10 +02:00
Matthew Meszaros fdc611c806 feat: scope the AI switch step's newest-reply lookup (GetBySender) to the campaign's organization instead of the campaign owner's user id, so replies that reach a teammate's mailbox are seen, and drop the unused unibox Incoming service method 2026-10-23 19:08:32 +02:00
Matthew Meszaros 4ba69b9b1a Merge pull request #1032 from 555aaditya/fix/leadsync-columns-past-z
feat: read every column of a Google Sheets lead-sync tab instead of stopping at column Z
2026-10-23 15:48:48 +00:00
Matthew Meszaros e29593501e feat: refuse a manual send in emailsend when the sender's ban scope or the workspace's sending suspension cannot be read, failing closed with a fixed internal error 2026-10-23 16:22:38 +02:00
Matthew Meszaros 03fd30f9bc feat: merge decoded-byte image validation with download-safe serving, own-domain form and domain redirects, TLS-only SMTP AUTH negotiation and pinned per-server certificate opt-outs, with MAIL_TLS_INSECURE honoured on self-hosted and development instances and resolved by the control plane for joining nodes 2026-10-23 16:20:30 +02:00
Matthew Meszaros 573e79ce8e feat: store each SMTP/IMAP server's certificate opt-out and pinned SPKI SHA-256 on email_accounts_smtp_imap (migration 000326, expand-only), carry tls_unverified and tls_pin in ADD_EMAIL, Cloud enrolment and vendor reconnect, keep an opt-out only for a certificate that fails CA verification and pin it to what the connection test saw, keep it across a credential change for the same host, name the presented certificate in a TLS refusal, and add GET /emails/:id/certificates plus session-only check and confirm endpoints that pin the fingerprints the owner confirmed 2026-10-23 16:15:55 +02:00
Matthew Meszaros 4624cc4a74 feat: negotiate mailbox SMTP AUTH by link (LOGIN then PLAIN only over TLS or loopback, CRAM-MD5 last, never a password mechanism in cleartext) for the send path, the connection test and the platform relay, honour MAIL_TLS_INSECURE only under APP_ENV=dev, and trust a mailbox server whose owner opted out of CA verification only on its pinned SPKI SHA-256 via VerifyConnection, reporting TLS_CERTIFICATE_CHANGED or TLS_CERTIFICATE_UNCONFIRMED as retryable connection errors 2026-10-23 16:15:55 +02:00
Matthew Meszaros 94095b9512 feat: merge context-escaped html/template campaign bodies, bounded template execution, uniform fail-closed decryption on the send path and counted legacy plaintext secret reads with instance-mode resealing 2026-10-23 16:08:49 +02:00
Matthew Meszaros 61cf65fde1 feat: count every read of a mailbox credential, webhook signing secret or OAuth app webhook secret still stored in plaintext through internal/observability/legacysecret without logging the value, log reseal seal and write failures by class, and have the consumer reseal job seal plaintext OAuth tokens under CREDENTIALS_ENCRYPTION_KEY when MAILBOX_CREDENTIALS_SEALING=instance 2026-10-23 16:07:57 +02:00
Matthew Meszaros 60cef7bcdc feat: return one uniform decrypt error from the org cipher and the instance encrypter for malformed, short, tampered or foreign-key ciphertext, and answer a send whose subject or body cannot be decrypted or whose workspace key cannot be loaded with EMAIL_FAILED and a fixed reason through failSend, logging only the failure class and never sending 2026-10-23 16:07:55 +02:00
Matthew Meszaros 1a77dbbd2b feat: bound template execution in tmplfuncs by refusing call, capping printf/print/println/html/js/urlquery/join output, metering range steps, limiting variables to 64 and function arguments to 32, adding a context-escaping CompileHTML, and make the integration fallback a single non-rescanning pass under the same output cap 2026-10-23 16:07:43 +02:00
Matthew Meszaros dba87e8d74 feat: merge fail-closed ban and attempt-budget reads, 48-hour invitations and tester passwords with one-click resend, transactional invitation consumption, development-only seeding and redacted log mail links 2026-10-23 16:06:29 +02:00
Matthew Meszaros f2f42792f5 feat: redact link query strings in the log mail transport unless APP_ENV names development, log warmup arrivals by task id rather than token, and name the matched route instead of the URI in tracking request spans, with the installer, boot warnings and self-host docs saying where codes and links can be read 2026-10-23 16:06:00 +02:00
Matthew Meszaros 68c87cb751 feat: merge resolved-peer address checks on every mail dial, strict bounded autoconfig XML, shell-free updater commands and refusal of repeated single-valued query parameters and credential headers 2026-10-23 16:04:08 +02:00
Matthew Meszaros d7bacf6112 feat: check every mailbox SMTP and IMAP dial against its resolved peer address in netbind, refusing loopback, private, link-local, CGNAT, multicast and metadata addresses on hosted production and wherever MAIL_ALLOW_PRIVATE_HOSTS=false, render that resolved policy into each joining node's env, and honour WARMBLY_ALLOW_UNSAFE_WEBHOOK_URLS only on self-hosted or development instances 2026-10-23 16:02:52 +02:00
Matthew Meszaros 0d76f81a3f feat: cap workspace invitations and reviewer tester passwords at 48 hours, quote each invitation's real remaining lifetime in its email, list recently expired invitations behind include_expired on GET /organization/invitations, and add a one-click Resend for expired invitations on the members settings page 2026-10-23 15:57:22 +02:00
Matthew Meszaros 28277cad5c feat: send form redirects and sending-domain root redirects only to the workspace's own domains (mailbox domains, verified tracking hosts and the verified forms domain, via internal/app/owndomain), refusing others with redirect_target_not_own_domain at save, falling back to the success message or no redirect at serve time, releasing Cloud-served ones that no longer qualify, and flagging saved destinations not in use in the dashboard and docs 2026-10-23 15:53:32 +02:00
Matthew Meszaros 123965fb81 feat: merge absolute session expiry, revoke-before-write password changes with optional API credential revocation, bounded Pipedrive tokens, always-Secure broker cookie, body-carried reset sessions and atomic Slack state 2026-10-23 15:52:51 +02:00
Matthew Meszaros 107bd854ca feat: consume Sign in with Slack verification state and held link-code questions with one atomic read-and-delete in Redis (and under the guard mutex without Redis) so each state completes at most one verification 2026-10-23 15:51:13 +02:00
Matthew Meszaros 0c40e53e02 feat: bind each realtime ws ticket to the session that minted it and accept it once while that session is live, require a second-factor session to join admin:platform, confine API key and OAuth sockets to their own workspace with member permissions narrowed to their read scopes, and refuse those credentials in the socket URL unless REALTIME_ALLOW_QUERY_CREDENTIALS=true 2026-10-23 15:48:00 +02:00
Matthew Meszaros a786d26fa3 feat: require every Pipedrive panel and modal token to carry an issued-at within 15 minutes or an expiry within 24 hours and refuse one with neither, and answer the Pipedrive app routes with Referrer-Policy no-referrer and no-store so the signed query token is never passed on 2026-10-23 15:47:31 +02:00
Matthew Meszaros e0a97ef520 feat: end other sessions before a signed-in password change is stored and refuse the change when that fails, add an optional revoke_api_credentials to the change and reset that also revokes the user's OAuth grants and the API keys they created, exchange the emailed reset link for an opaque reset session through POST /auth/reset-password/session so the confirm step carries no token in its URL, and add the sign-out-apps checkbox to the dashboard's change-password dialog 2026-10-23 15:45:51 +02:00
Matthew Meszaros 6bb947d4b9 feat: consume a workspace invitation in the same transaction that grants its membership so a failed consume rolls the membership back, keep expired invitations instead of deleting them on an accept attempt, and revoke the API key a CLI sign-in approval created when the approval cannot be recorded 2026-10-23 15:45:03 +02:00
Matthew Meszaros 3f13636a5b feat: decide uploaded image formats from their decoded bytes through internal/pkg/imagetype for avatars, OAuth logos, form assets, email images and archive-restored public objects, store public objects with inline headers only for PNG/JPEG/GIF/WebP, sign every presigned attachment and node GET URL with forced download disposition and a safe response content type, and rasterize SVG previews to PNG in the dashboard image client 2026-10-23 15:43:42 +02:00
Matthew Meszaros b14e1b1679 feat: refuse sign-in, emailed-code, two-factor, SSO-link and re-authentication checks with a retryable 503 when their attempt budget cannot be charged, and refuse password, passkey and two-factor sign-in and workspace creation when the account's ban or two-factor state cannot be read 2026-10-23 15:41:36 +02:00
Matthew Meszaros 208ed1e344 feat: treat a session's expires_at as an absolute deadline so access tokens and POST /auth/refresh are refused past it, cap rotated access and refresh tokens at the session's expiry, and document the 180-day session lifetime 2026-10-23 15:35:37 +02:00
Matthew Meszaros a642ce50ed feat: connect existing delegated Google and independent app-password Cloud mailboxes while preserving history and adding bulk connection recovery 2026-10-23 15:27:05 +02:00
555aaditya fe6f6a5388 feat: read every column of a Google Sheets lead-sync tab (A:ZZZ, which Sheets trims to the used columns) instead of stopping at column Z, with the first leadsync test covering the A1 ranges 2026-10-23 18:41:17 +05:30
Matthew Meszaros 19c7eb13dc Merge pull request #1030 from warmbly/feat/mailbox-credentials-org-dek
feat: seal mailbox credentials under KMS-protected workspace keys
2026-10-22 17:46:26 +00:00
Matthew Meszaros 219f428208 feat: store each warmup receipt's placement group and host at arrival so rescue outcomes land on the same placement row, leave rescues that never ran unreported instead of failed, and label rescue outcomes as confirmed out of spam with a wrapping summary in the mailbox placement tab 2026-10-22 19:11:28 +02:00
Matthew Meszaros 2f42afa78f feat: report each warmup spam rescue's outcome from the recipient worker into placement history and the mailbox placement tab, rescue only mail that arrived in spam, and follow bounded Graph continuations when resolving warmup messages by Message-ID 2026-10-22 19:11:28 +02:00
Matthew Meszaros b6196f8666 feat: count workspace-sealed mailbox credentials separately in warmblyctl keys status and reseal, scan KeyDomainMailbox columns under the instance key, and report sealed-format values no key opens as unreadable instead of legacy plaintext 2026-10-22 19:11:23 +02:00
Matthew Meszaros 03170c5482 feat: share one cancellation-proof bounded DEK lookup per organization, bound worker token sealing, reseal empty mailbox credential values, refuse an invalid MAILBOX_CREDENTIALS_SEALING in warmblyctl, keep credential exports gated on the instance key and log workspace-key failures in mailbox erasure 2026-10-22 19:11:23 +02:00
Matthew Meszaros 537a622409 feat: seal mailbox SMTP/IMAP logins and OAuth tokens under KMS-protected workspace DEKs behind MAILBOX_CREDENTIALS_SEALING, carry them sealed in ADD_EMAIL and token refreshes, reseal stored credentials in a resumable consumer job, and cache DEKs in process with singleflight in front of Redis and KMS 2026-10-22 19:11:23 +02:00
Matthew Meszaros 3518708a99 feat: add warmblyctl keys status, reseal and generate to count instance-key ciphertext by the key that opens it and move read-key values onto the primary with resumable compare-and-swap writes, and keep sealed-format OAuth values no key opens untouched 2026-10-22 15:24:33 +02:00
Matthew Meszaros fdea749005 feat: preserve encrypted credentials and MFA enrollments across staged key rotation with scoped token grace periods 2026-10-22 12:37:19 +02:00
Matthew Meszaros 0d8a1c5dd9 feat: make the 000320 rollback refuse instead of deleting credentials_reverified history and say sending resumes after a verified reconnect only when no other send safety hold remains 2026-10-21 12:01:29 +02:00
Matthew Meszaros 09e9a299a7 feat: release an authentication send hold when a reconnect passes the provider's login check, recorded as credentials_reverified in migration 000320, expose send_recovery_reason on mailbox status and show the reconnect button under the drawer's health when sending is held for authentication 2026-10-21 12:01:28 +02:00
Matthew Meszaros e62d80fa58 feat: keep spread warmup reply-backs and deferred warmup sends inside short warmup windows and date an overdue next-warmup label in the mailbox list 2026-10-21 10:34:22 +02:00
Matthew Meszaros 494ed2c06f feat: re-place parked warmup and campaign wakeups when mailbox behaviour, warmup hours, timezone, caps, tags, campaign pacing or the workspace timezone change, retire stranded warmup preparations with refunded charges or unsent tokens so they stop blocking mailboxes, spread window-opening reply-backs and deferred sends, and show the next queued warmup send in the mailbox list and drawer 2026-10-21 10:34:22 +02:00