Commit Graph
478 Commits
Author SHA1 Message Date
Matthew Meszaros 9c5a6c3387 Merge pull request #1125 from warmbly/chore/review-kafka-costs
feat: add private AWS NATS operations and a compatible Kafka migration
2026-11-03 06:03:01 +00:00
Matthew Meszaros 999597508c feat: provision private three-zone NATS JetStream and add gated Kafka migration readers with compatible codecs 2026-11-02 15:25:15 +01:00
Matthew Meszaros 9b0b319ee7 feat: enforce issued password format and add scoped private attachment downloads with restricted runtime TLS ciphers 2026-11-02 13:05:45 +01:00
Matthew Meszaros 3abefbeb42 feat: bind each initial-password challenge to the issued password hash so a reissued password voids it, issue a new password only to a tester that is still exempt, keep the whole inline SERVE_TLS_CERT chain in realtime, name BACKEND_INTERNAL_CA_FILE in the forms startup error, and list the tester password and login-code exemption routes as needing a recent confirmation 2026-10-31 14:06:20 +01:00
Matthew Meszaros d8cf1fd9d5 feat: bind every node-only internal call from a credential-authenticated worker to its own assignment (worker id, assigned mailboxes, their organizations, data keys and mailbox or campaign blob keys) via internal/app/nodescope with a 30s per-node cache and indexed point lookups on a miss, keep a moved mailbox in its previous worker's scope for 30 minutes through email_accounts.previous_worker_id and worker_released_at recorded by a trigger (migration 000337), grant an organization to a worker for a credential check, exempt consumers, and document the invariant 2026-10-31 11:38:04 +01:00
Matthew Meszaros 515b2a7d17 feat: bound stored issued-password expiries to 48 hours in migration 000336 before its trigger, and add POST /admin/testers/:id/password (manage_testers, MFA, fresh auth, create_tester accounts only) that issues a fresh 48-hour initial password after signing out sessions and remembered devices, with an audited Issue new password row action on the admin Testers page and docs 2026-10-31 11:36:37 +01:00
Matthew Meszaros c499230823 feat: add opt-in SERVE_TLS listeners to backend, forms, tracking and realtime, pin forms and tracking to the backend certificate with BACKEND_INTERNAL_CA, and stage the AWS runtime onto HTTPS target groups and a TLS internal hop through target_tls (off, serve, both, on) with mocked terraform tests 2026-10-31 11:28:28 +01:00
Matthew Meszaros f400ff3b2b feat: authenticate each fleet node by its own NODE_CREDENTIAL on every node-only internal route (X-Warmbly-Node-Id and X-Warmbly-Node-Credential sent by every worker and consumer client, node id carried in the request context, named in broker access logs and bound to the heartbeat and node env), add NODE_REQUIRE_NODE_CREDENTIAL to refuse the fleet token once every node sends its credential, seed a dev worker credential, and document the rollout 2026-10-31 11:18:51 +01:00
Matthew Meszaros 0a4f70aedc feat: let a workspace confirm its main website with its _warmbly TXT record so sending-domain and form redirects can point there (website_domains, migration 000333, POST /emails/domains/:domain/redirect/website, rechecked every 6 hours), skip the visitor check while a destination is unconfirmed, and redesign the sending domain Redirect tab as a step checklist with the website record inline 2026-10-30 15:07:57 +01:00
Matthew Meszaros 361f43111f feat: synchronize warmup variation with main and assign its reservation migration the next available version 2026-10-30 07:52:18 +01:00
Matthew Meszaros e326406549 feat: isolate unconfirmed campaign sends with portable contact protection and staged automatic recovery 2026-10-30 06:40:48 +01:00
Matthew Meszaros 430663cb7c feat: reuse approved warmup conversations across distinct mailboxes with automatic batch replenishment and varied content 2026-10-30 06:19:37 +01:00
Matthew Meszaros 81d1a95b98 feat: add the admin-offered $90 Partnership plan with server-priced offer checkout, an admin-granted credential-free Cloud warmup mode where a linked instance keeps every mailbox credential and executes Cloud-planned warmup sends and engagement from a sealed per-link command queue, and Cloud verification of instance reports through recipient-bound arrivals, receiver-proven sends, a placement cross-check reporter-trust audit, liveness, expiry and revocation 2026-10-26 17:49:32 +01:00
Matthew Meszaros b7cc259bec feat: merge per-workspace custom host confinement for forms and tracked links, one workspace per forms domain (migration 000327) and the workspace-bound TXT proof for new forms and tracking domain verifications into the tenant-scoped hosts branch 2026-10-26 07:02:08 +01:00
Matthew Meszaros 3e64acf464 feat: serve only a workspace's own forms and tracked links on its custom domain, keep each verified forms domain to one workspace (migration 000325), and require the workspace's _warmbly TXT ownership record beside the CNAME for new forms and tracking domain verifications, with the record shown in the dashboard and API 2026-10-26 07:00:29 +01:00
Matthew Meszaros dec13b1503 feat: merge fresh authentication on member, role, billing, credit, API key and webhook routes, reset tokens in the URL fragment, refused repeated OAuth form parameters and the 48-hour invitation and tester expiry cap into the tenant-scoped hosts branch 2026-10-26 06:56:09 +01:00
Matthew Meszaros 7075361458 feat: print the first-boot claim link to the backend log only under APP_ENV=dev and otherwise log a pointer to warmblyctl setup-link, withhold link fragments as well as query strings from MAIL_TRANSPORT=log output, and correct the boot warnings and self-host docs to say a non-delivering transport never gates a sign-in or signup on an emailed code 2026-10-26 06:53:48 +01:00
Matthew Meszaros 421a5ced5f feat: run the consumer's background mailbox credential reseal under instance sealing too, sealing any OAuth token still stored in plaintext under CREDENTIALS_ENCRYPTION_KEY as the configuration docs describe 2026-10-26 06:31:07 +01:00
Matthew Meszaros 88e4370f1f feat: merge main into the mailbox, session and input validation branch, move the resolved MAIL_ALLOW_PRIVATE_HOSTS and MAIL_TLS_INSECURE node env lines into fleetnode.RenderEnv, renumber the mailbox TLS pin migration to 000324, and keep both sides of the configuration reference 2026-10-24 12:20:12 +02:00
Matthew Meszaros b3d8c5acfd Merge pull request #1045 from warmbly/feat/release-auto-deploy
feat: release auto-deploy to AWS, fleet canary waves, in-AWS key rotation and Terraform CI
2026-10-24 07:53:36 +00:00
Matthew Meszaros 98e4b10141 feat: add an admin Sends > Holds tab and POST /admin/sends/holds/:id/resolve for recording provider-checked outcomes on held mailboxes, count send holds only on switched-on mailboxes past the in-progress window, narrow failed-send monitoring to mailbox failures without a later confirmed send, and show broker lag as a measurement instead of an attention signal 2026-10-24 09:14:02 +02:00
Matthew Meszaros 9c2cffae58 feat: deploy stable releases to AWS automatically with provenance checks, a migration gate, alarm-watched waves and reverse rollback, move worker and consumer hosts in canary rollouts with host-side health rollback and opt-in env refresh, rotate instance keys inside AWS through a rotator task and the rotate-keys workflow, plan and apply the AWS Terraform from CI with approval for replacements, and add the admin Keys tab and the matching runbooks 2026-10-24 09:10:52 +02:00
Matthew Meszaros 9ef0f04efc feat: stop Cloud warmup sending and receiving once for mailboxes of pool links revoked before revocation stopped them, found through their managed sign-in and adoption records and skipped when a live link holds them, from a backend job that repeats through the rollout and then records completion in admin_settings 2026-10-23 20:47:06 +02:00
Matthew Meszaros 9be5c8a3c3 feat: give API refusals stable codes and actionable messages (attempt_check_unavailable and code_lookup_limited with Retry-After, account and workspace standing codes, session_ended, reset_link_invalid, sessions_not_ended, api_credentials_revoke_unsupported, invitation_expired, image_unreadable and the other image upload codes, own-domain redirects naming the allowed domains, Pipedrive reload guidance, duplicate parameters, structured forms service errors), and show them in the dashboard, admin panel and warmbly CLI 2026-10-23 19:53:03 +02:00
Matthew Meszaros cc1dc2f64c feat: answer refused realtime handshakes with a JSON code and reason, name a reused ws ticket or signed-out session, use the not_a_member slug on org joins, warn at boot when REALTIME_ALLOW_QUERY_CREDENTIALS is on, stop the admin socket reconnecting on admin_mfa_required, not_an_admin and jwt_required with a clear message, and have the seeder, updater, webhook and notification URL checks, instance health, fleet join and log mail transport say which setting applies and what to do 2026-10-23 19:53:03 +02:00
Matthew Meszaros 03fd30f9bc feat: merge decoded-byte image validation with download-safe serving, own-domain form and domain redirects, TLS-only SMTP AUTH negotiation and pinned per-server certificate opt-outs, with MAIL_TLS_INSECURE honoured on self-hosted and development instances and resolved by the control plane for joining nodes 2026-10-23 16:20:30 +02:00
Matthew Meszaros dba87e8d74 feat: merge fail-closed ban and attempt-budget reads, 48-hour invitations and tester passwords with one-click resend, transactional invitation consumption, development-only seeding and redacted log mail links 2026-10-23 16:06:29 +02:00
Matthew Meszaros f2f42792f5 feat: redact link query strings in the log mail transport unless APP_ENV names development, log warmup arrivals by task id rather than token, and name the matched route instead of the URI in tracking request spans, with the installer, boot warnings and self-host docs saying where codes and links can be read 2026-10-23 16:06:00 +02:00
Matthew Meszaros 28277cad5c feat: send form redirects and sending-domain root redirects only to the workspace's own domains (mailbox domains, verified tracking hosts and the verified forms domain, via internal/app/owndomain), refusing others with redirect_target_not_own_domain at save, falling back to the success message or no redirect at serve time, releasing Cloud-served ones that no longer qualify, and flagging saved destinations not in use in the dashboard and docs 2026-10-23 15:53:32 +02:00
Matthew Meszaros 31aadd0304 feat: run the dev seeder and the sandbox seed and simulator only when APP_ENV is explicitly dev, development or local, refusing an unset or production APP_ENV before anything is written, and document the guard on the first-run and sandbox pages 2026-10-23 15:46:52 +02:00
Matthew Meszaros e0a97ef520 feat: end other sessions before a signed-in password change is stored and refuse the change when that fails, add an optional revoke_api_credentials to the change and reset that also revokes the user's OAuth grants and the API keys they created, exchange the emailed reset link for an opaque reset session through POST /auth/reset-password/session so the confirm step carries no token in its URL, and add the sign-out-apps checkbox to the dashboard's change-password dialog 2026-10-23 15:45:51 +02:00
Matthew Meszaros a642ce50ed feat: connect existing delegated Google and independent app-password Cloud mailboxes while preserving history and adding bulk connection recovery 2026-10-23 15:27:05 +02:00
Matthew Meszaros b6196f8666 feat: count workspace-sealed mailbox credentials separately in warmblyctl keys status and reseal, scan KeyDomainMailbox columns under the instance key, and report sealed-format values no key opens as unreadable instead of legacy plaintext 2026-10-22 19:11:23 +02:00
Matthew Meszaros 03170c5482 feat: share one cancellation-proof bounded DEK lookup per organization, bound worker token sealing, reseal empty mailbox credential values, refuse an invalid MAILBOX_CREDENTIALS_SEALING in warmblyctl, keep credential exports gated on the instance key and log workspace-key failures in mailbox erasure 2026-10-22 19:11:23 +02:00
Matthew Meszaros 537a622409 feat: seal mailbox SMTP/IMAP logins and OAuth tokens under KMS-protected workspace DEKs behind MAILBOX_CREDENTIALS_SEALING, carry them sealed in ADD_EMAIL and token refreshes, reseal stored credentials in a resumable consumer job, and cache DEKs in process with singleflight in front of Redis and KMS 2026-10-22 19:11:23 +02:00
Matthew Meszaros 95b4ca8c5e feat: refuse a malformed credential encryption key with a fixed message in encrypt.NewEncrypterFromHex and warmblyctl keys so the error never quotes key material 2026-10-22 15:55:46 +02:00
Matthew Meszaros 3518708a99 feat: add warmblyctl keys status, reseal and generate to count instance-key ciphertext by the key that opens it and move read-key values onto the primary with resumable compare-and-swap writes, and keep sealed-format OAuth values no key opens untouched 2026-10-22 15:24:33 +02:00
Matthew Meszaros fdea749005 feat: preserve encrypted credentials and MFA enrollments across staged key rotation with scoped token grace periods 2026-10-22 12:37:19 +02:00
Matthew Meszaros ee8581136e feat: require direct database sessions and verify authenticated worker dependencies during AWS deployment 2026-10-22 11:01:04 +02:00
Matthew Meszaros 99357a6823 feat: add Terraform AWS hosting with optional Postgres pooling and migration-gated deployments 2026-10-22 08:57:54 +02:00
Matthew Meszaros f8fbca7cbb feat: adopt the linked Cloud workspace's own SMTP/IMAP mailbox on self-hosted enrollment when the server presents its exact stored credentials and no active Cloud campaign sends from it, instead of answering pool_link_mailbox_conflict, with tests and Warmbly Cloud and error code docs 2026-10-21 06:20:14 +02:00
geetansh 4f926b3efc feat: make Warmbly Cloud the owner of an enrolled mailbox's warmup ramp, window and days by relaying PATCH /emails/:id and warmup lifecycle edits to Cloud, mirroring Cloud's reported settings into the local columns on enroll, listing and a 15-minute consumer sync, keeping re-enrollment from overwriting them, and showing the Cloud-managed state on the Warmup tab 2026-10-19 10:53:05 +02:00
geetansh aafcb4f759 feat: treat a missing Warmbly Cloud report as a send hold only, never a rest, while every real hold still applies in full and the send gate stays closed until a current report arrives 2026-10-18 10:13:00 +00:00
Matthew Meszaros eea71832ec feat: count campaign progress emails_sent through the existing sequences join and return the restore context error when ANALYZE is cancelled 2026-10-17 05:43:20 +02:00
Matthew Meszaros ae9eca5c7e feat: cut database load from issue 993 with placement, sweep and unibox indexes, redundant index drops, identical-result rewrites of contact facets, dashboard stats, campaign progress, advisor bounces and routing pre-filter, bounded delivery evidence, cold-ramp skip, held advisor sections, ANALYZE after restore and hidden-tab realtime deferral 2026-10-17 05:18:45 +02:00
devin-ai-integration[bot] 3b1c50b9ec Merge pull request #988 from warmbly/fix/reply-processing-stale-stored-mail
feat: withdraw reply intents and untouched follow-up tasks left by mail from before its sender's contact, and credit unthreaded mail only to an earlier send (#960)
2026-10-16 07:52:00 +00:00
devin-ai-integration[bot] bb1b93255d Merge pull request #987 from warmbly/fix/worker-send-deadline
feat: give worker sends a deadline that covers the SMTP budget and add ordered mailbox lanes on NATS
2026-10-16 07:51:59 +00:00
Matthew Meszaros fa6c935b12 feat: withdraw the reply intents and untouched follow-up tasks that mail from before its sender's contact produced through a one-time consumer cleanup, and credit an unthreaded contact message only to a campaign email sent before it arrived (#960) 2026-10-16 06:59:40 +02:00
Matthew Meszaros 46bd956229 feat: give worker SEND_EMAIL commands a 120s deadline that covers the SMTP client's 90s budget, run the worker command subscription under a 195s bus budget (NATS ack wait and Kafka handler context via eventbus.WithHandlerTimeout), and add ordered per-mailbox command lanes on NATS with in-progress heartbeats 2026-10-16 06:57:14 +02:00
Matthew Meszaros de4328b4cf feat: let Unibox forwards reach suppressed recipients by exempting forward tasks from the send-admission suppression check, refuse suppressed replies and direct sends before queueing with a recipient_suppressed 400 naming the address and matching entry, report admission refusals as RECIPIENT_SUPPRESSED with the address, show the server reason in the reply composer, and document it 2026-10-16 06:56:52 +02:00