Files
EasyTier/easytier-go
KKRainbow f26c2aa147 feat(wasi): run EasyTier core on Cloudflare Workers and browsers (#2548)
* fix(core): normalize secure keys for TOML instances

* feat(wasi): run core behind Cloudflare WebSockets

Introduce the Cloudflare Worker WASI host that runs the EasyTier core
behind host-upgraded WebSockets.

- Worker package scaffold (wrangler Durable Object, build-wasm script,
  vitest config) and core-runtime/websocket-host/data-plane runtime.
- WASI host WebSocket tunnel ABI (imports, adapter, runtime exports)
  with bounded receive memory and bounded admission queue.
- Route host sockets through the portable listener plan
  (HostListenerRegistration, listener queue, admission handler split).
- Build the WASM guest with the aes-gcm feature so secure peer
  sessions have their cipher available.

* feat(wasi): add outbound browser client runtime

Add the outbound-only WASI runtime and browser connector host so
browser pages can dial EasyTier peers through WebSocket relays.

- CoreConnectivityMode::{OutboundOnly, InboundOnly} gating for
  listeners, discovery, and direct connectivity modules.
- ExternalTunnelConnector plumbing through composite/connector_host/
  manual for browser WebSocket dials.
- Browser/Node smoke entries with shared helpers
  (smoke-shared.ts).

* feat(wasi): extend browser data plane with TCP half-close

Add the data-plane pieces the browser runtime needs for full-duplex
TCP streams behind host WebSockets:

- Guest TCP shutdown_write operation with submit/take ABI pair
  (DATA_PLANE_ABI_VERSION 3 -> 4) and smoltcp half-close support.
- Worker data-plane TCP listener/stream plumbing and core-runtime
  listener registration.
- Unit coverage for the new session ops and listener wiring.

* refactor(wasi): make host tunnel ABI transport-neutral

Replace WebSocket-specific core and WASI boundaries with a
message-oriented Host Tunnel interface. Keep WebSocket framing and text
rejection in the Cloudflare host while preserving payload boundaries,
ownership, cancellation, backpressure, and EOF behavior.

Rename feature flags and guest imports and exports to the Host Tunnel
ABI. Update both Worker profiles, tests, and architecture documentation.

* feat(web): split WASI hosts into publishable npm packages

Extract the shared JSPI, WASI, Host Tunnel, and data-plane runtime
into @easytier/runtime. Keep ABI handles, guest memory, TOML, and
operation broker details behind its adapter entry point.

Add typed, auto-starting @easytier/browser and factory-based
@easytier/cloudflare packages. Ship a matching Wasm profile with
each platform package and validate its capabilities before packing.

Persist Cloudflare instance identity in Durable Object storage,
centralize WebSocket admission ownership, and add package-level
coverage for the public interfaces.

* fix(web): make public packages portable

Embed the browser Wasm artifact in the published JavaScript entry
point. This lets esbuild consumers bundle the package without an asset
loader or a copied file.

Return Cloudflare's nominal Durable Object base type and document the
named subclass export required by generated Wrangler bindings.

* docs(web): add public package walkthrough

Expand both package READMEs with installation, configuration, local
validation, health checks, and deployment instructions.

Add a standalone Vite and Wrangler example that imports only the
public Browser and Cloudflare entries. Generate Worker bindings from
configuration and keep local secrets outside version control.

* chore(go): import EasyTier Go host

Add the standalone Go host runtime as a monorepo subtree without
carrying its development branch ancestry.

Preserve its API, tests, examples, generated protobuf bindings, and
embedded WASI artifacts.

* refactor(hosts): colocate Go and JavaScript runtimes

Move the browser, Cloudflare, shared runtime, and web example into
the easytier-js subtree. Update workspace metadata, build paths, and
documentation for the new layout.

Adopt github.com/EasyTier/EasyTier/easytier-go as the Go module path.
Resolve artifact and protobuf generation from the enclosing monorepo.

* build(web): isolate JavaScript host workspace

Keep public browser and Cloudflare packages outside the legacy frontend
workspace so root installs and cross-platform builds do not pull workerd.

Make each package build generate its required WASI artifact from a clean
checkout. Add a dedicated workflow that runs the same install and check
commands documented for contributors.

Move JavaScript dependencies into a scoped lockfile and restore the root
workspace lockfile to its pre-host state.
2026-09-06 13:35:02 +08:00
..

EasyTier Go

easytier-go runs the wasm32-wasip1 build of easytier-core in a pure-Go process through wazero. EasyTier remains the source and producer of the embedded WASM; this repository adapts Go host capabilities to the ABI exported and imported by that artifact.

import (
    "net/netip"

    corehost "github.com/EasyTier/EasyTier/easytier-go"
)

Public API

The public package owns wazero, standard WASI, the EasyTier host ABI, guest driving, completion notification, and resource shutdown. Applications create a host, build a typed instance configuration, and then use standard Go network interfaces:

host, err := corehost.New(ctx, corehost.Options{})
if err != nil {
    return err
}
defer host.Close(ctx)

config, err := corehost.NewInstanceConfigBuilder("office").
    NetworkSecret("secret").
    IPv4(netip.MustParsePrefix("10.144.0.10/24")).
    AddPeers("tcp://198.51.100.10:11010").
    Build()
if err != nil {
    return err
}

instance, err := host.CreateInstance(ctx, config)
if err != nil {
    return err
}
defer instance.Close(ctx)

if err := instance.Start(ctx); err != nil {
    return err
}
if err := instance.SendPacket(ctx, packet); err != nil {
    return err
}
received, err := instance.ReceivePacket(ctx)

listener, err := instance.Listen("tcp4", ":8080")
connection, err := instance.Dial(ctx, "tcp4", "10.144.0.2:8080")
packets, err := instance.ListenPacket("udp4", ":5353")

Web Client management

A host can also connect to an EasyTier Web configuration server. The embedded Rust WebClient retains the config-server protocol, heartbeat, reconnect, and secure-tunnel behavior; Go owns the resulting process-level instances:

webClient, err := host.ConnectWebClient(ctx, corehost.WebClientOptions{
    Endpoint:   "udp://config.example.com:22020/team-token",
    MachineID:  "11111111-2222-4333-8444-555555555555",
    Hostname:   "edge-gateway",
    SecureMode: true,
})
if err != nil {
    return err
}
defer webClient.Close(ctx)

for _, instance := range host.Instances() {
    log.Printf("%s: %v", instance.ID(), instance.State())
}

MachineID must be a stable UUID persisted by the application. Endpoint accepts tcp://, udp://, or the same shorthand token understood by native EasyTier. WebSocket transports are not part of this initial host integration. One WebClient may run per Host.

Web-created instances support the complete WebClientService lifecycle and status surface. Instances created through Host.CreateInstance are included in heartbeats and status listings, but are reported as read-only and cannot be overwritten, retained away, or deleted by the Web server. Host.Instances returns both ownership classes; Web-created instances use the same Instance data-plane and management APIs as application-created instances.

Instance.ListPeer and Instance.ListRoute call the embedded core's existing instance-scoped management RPCs and return peer and route slices directly. Their element types reuse the generated EasyTier protobuf models, while the request and response envelopes stay internal to the host. Callers never construct wire bytes or a separate RPC client. Cancelling the context frees the pending guest operation.

InstanceConfigBuilder exposes the instance settings supported by this host: network identity, hostname, virtual IPv4 address, peers and listeners, IPv4 and IPv6 STUN servers, Core-owned TCP and UDP port forwards, P2P policy, hole-punching methods, encryption, and secure mode. Omitted optional settings retain the embedded core's defaults. Calling STUNServers() or STUNServersV6() with no arguments explicitly selects an empty list.

AddPortForwards accepts typed rules containing a PortForwardTCP or PortForwardUDP protocol and netip.AddrPort bind and destination addresses. The embedded core owns their listener, overlay-flow, reload, and shutdown lifecycle.

Secure mode can generate an X25519 key with SecureMode() or use a caller supplied raw 32-byte private key with SecureModeWithPrivateKey(key). The public key is always derived by the builder. Secure mode currently requires a non-empty shared network secret; credential-based networks are a separate future configuration path.

Dial returns net.Conn, Listen returns net.Listener, and ListenPacket returns net.PacketConn. ABI v2 currently supports tcp, tcp4, udp, and udp4; destinations must be IPv4 literals and listeners bind all overlay IPv4 addresses. These APIs are overlay-only: an absent EasyTier route is returned as a normal network error and never falls back to the host network.

See KNOWN_LIMITATIONS.md for current UDP and port-forward edge cases.

No public type exposes wazero runtimes, WebAssembly pointers, raw handles, submit/take operations, or the cooperative drive loop. Each host owns one wazero runtime, guest module, and host completion domain; each instance is represented by an EasyTier guest handle. Per-instance drivers serialize guest calls through the host. The engine continues driving EasyTier after Start returns, calls easytier_instance_notify_completions before driving a host completion, and drains bounded data-plane completion batches after each guest turn.

The host serializes the typed configuration to TOML internally, wraps it in EasyTier's version 14 create envelope, and adds the configured environment snapshot. TOML, schema versions, and JSON envelopes are not application-facing APIs.

Cross-platform TUN example

The TUN example joins an existing EasyTier network with a fixed virtual IPv4 address on Linux, macOS, or Windows. It creates and configures the native TUN interface itself, then forwards raw IPv4 packets through SendPacket and ReceivePacket:

cd examples/tun
sudo go run . \
  -p tcp://198.51.100.10:11010 \
  --network-name office \
  --network-secret secret \
  --ipv4 10.144.0.10/24

Repeat -p to configure more peers. The command creates et-goN on Linux and Windows or utunN on macOS, assigns the requested address, and sets an MTU of 1380. Run it as root or with CAP_NET_ADMIN on Linux, with sudo on macOS, or from an Administrator terminal on Windows. Closing the command removes the TUN interface. The example does not install a default route or enable GSO.

On Linux and macOS, send SIGUSR1 to print the current peer list or SIGUSR2 to print the current route list.

Repeat -port-forward to expose local TCP or UDP ports through the embedded core's port-forward manager:

sudo go run . \
  -p tcp://198.51.100.10:11010 \
  --network-name office \
  --network-secret secret \
  --ipv4 10.144.0.10/24 \
  -port-forward tcp://127.0.0.1:5202/10.144.0.20:5201 \
  -port-forward udp://127.0.0.1:5202/10.144.0.20:5201

For example, run iperf3 -c 127.0.0.1 -p 5202 for TCP or add -u -b 0 -l 1200 for UDP. iperf3's UDP mode still needs the TCP forward for its control connection. The TUN example only parses these rules into the instance configuration; the core owns the host listeners and per-client overlay flows.

Instance.Dial example

The Dial example is a small overlay client dedicated to the public Instance.Dial API. TCP mode bridges the connected stream to standard input and output until the remote side closes or the command is interrupted:

printf 'GET / HTTP/1.0\r\nHost: 10.144.0.20\r\n\r\n' |
  go run ./examples/dial \
    -p tcp://198.51.100.10:11010 \
    --network-name office \
    --network-secret secret \
    --ipv4 10.144.0.10/24 \
    --network tcp4 \
    --address 10.144.0.20:8080

With --network udp4, standard input is sent as one datagram and one response datagram is written to standard output. The command does not create a local listener or implement port-forward management. It waits up to 10 seconds for a matching overlay or proxy route before dialing; override that limit with --connect-timeout.

Web Client example

The Web Client example registers a Host with an EasyTier Web configuration server and lets the server create, delete, and inspect its instances:

go run ./examples/web-client \
  --web-endpoint tcp://config.example.com:22020/team-token \
  --web-machine-id 11111111-2222-4333-8444-555555555555 \
  --web-hostname edge-gateway \
  --web-secure

--web-machine-id must remain stable across restarts. --web-hostname defaults to the system hostname. This example manages Host instances but does not create or attach an operating-system TUN interface.

Performance compared with native EasyTier

In this A/B benchmark two nodes on one i7-14700KF host (Linux 6.11) each run in their own network namespace, joined by a veth pair. Node A always runs a native easytier-core build of EasyTier master (2.6.4-6a186167) with overlay address 10.144.0.1/24; node B runs either the same native binary or this Go host (commit 78889d12, embedded EasyTier af640d49) with 10.144.0.2/24. A master build is used as the native baseline because the 2.6.4 release predates several native data-plane throughput fixes (EasyTier #2451, #2452). The underlay tunnel between the nodes is either tcp:// or udp://. Encryption is enabled and the overlay MTU is 1360 on both ends. Node A and the iperf3 server are pinned to CPUs 0,2,4,6, node B to 8,10,12,14. Each iperf3 run lasts 15 seconds and excludes the first 3 seconds. Forward means node B sends to node A; reverse uses iperf3 -R. Measured 2026-07-28.

The forwarding rows deliberately compare native Core port forwarding with the Go host's benchmark-only cmd/dial-forward-bench, which carries traffic through the public Instance.Dial API.

TCP, one stream:

Scenario Direction tcp:// native tcp:// Go host udp:// native udp:// Go host
TUN forward 6.06 Gbit/s 2.12 Gbit/s 3.71 Gbit/s 1.57 Gbit/s
TUN reverse 6.03 Gbit/s 2.57 Gbit/s 3.69 Gbit/s 1.48 Gbit/s
Native port forward / Go Dial forward 1.25 Gbit/s 1.29 Gbit/s 1.19 Gbit/s 1.20 Gbit/s
Native port forward / Go Dial reverse 6.49 Gbit/s 1.95 Gbit/s 4.26 Gbit/s 1.43 Gbit/s

UDP native port forward / Go Dial, 1 Gbit/s offered with 1200-byte datagrams (received / lost):

Direction tcp:// native tcp:// Go host udp:// native udp:// Go host
forward 996 Mbit/s / 0.3% 546 Mbit/s / 45% 996 Mbit/s / 0.3% 699 Mbit/s / 30%
reverse 950 Mbit/s / 5.0% 490 Mbit/s / 51% 983 Mbit/s / 1.7% 350 Mbit/s / 65%

Reading the numbers:

  • On TUN the Go host reaches roughly 35-45% of native single-stream throughput. Both sides run the same EasyTier core logic, so the gap is the WASM/Go data-plane boundary rather than routing or cryptography.
  • TCP forwarding is a tie at about 1.2 Gbit/s: both paths are bounded by the virtual TCP send path inside the shared EasyTier core, not by the host.
  • TCP reverse forwarding favors native by about 3x (4.3-6.5 versus 1.4-2.0 Gbit/s); the Go host benchmark's per-operation receive path is the limit.
  • Native sustains the offered 1 Gbit/s UDP nearly loss-free in both directions, while the Go host saturates at 350-700 Mbit/s with significant loss, consistent with the one-operation-per-datagram data-plane ABI documented in PERFORMANCE.md.

Platform capabilities

The default platform implementation uses Go's standard net and net.Resolver packages. Applications that need netns, socket marks, device binding, reuse policy, or custom DNS can inject capabilities through platform.Services:

host, err := corehost.New(ctx, corehost.Options{
    Platform: platform.Services{
        Sockets:     socketFactory,
        DNS:         dnsResolver,
        Environment: connectorEnvironment,
        Snapshot:    environmentSnapshot,
    },
})

platform.SocketFactory owns only TCP connect, UDP bind, and TCP listen creation. Once a standard Go network resource is returned, the host runtime owns its reads, writes, accepts, cancellation, and close path. EasyTier retains all routing, peer admission, protocol, retry, and connection policy.

The implementation is split by responsibility:

  • platform defines public capability ports; platform/netstd implements their portable defaults.
  • proto contains generated Go bindings for the existing EasyTier management protobuf definitions.
  • internal/reactor owns typed asynchronous operations, resources, operation IDs, backpressure, and completion signals without depending on wazero.
  • internal/hostabi implements the custom easytier_host imports, guest memory copying, wire codecs, and ABI status translation.
  • internal/coreabi owns guest memory, the big-endian data-plane wire codec, ABI discovery, and typed easytier_instance_*, easytier_data_plane_*, and easytier_rpc_* export calls.
  • internal/engine composes standard WASI, both EasyTier ABI directions, the single-owner driver, operation cancellation, deadlines, standard Go network resources, and instance shutdown.
  • internal/artifact contains only the embedded core and its provenance.

Embedded artifact

The committed WASM lets downstream Go builds and tests run without a Rust toolchain. Refresh it from a clean EasyTier checkout whenever the guest ABI or core implementation changes:

EASYTIER_SOURCE=/path/to/EasyTier go generate ./...

Generation runs EasyTier's script/build-wasi-core.sh, which builds release easytier_core.wasm with the Go-host features and writes an optimized easytier_core_go_host.wasm with the pinned, SHA-256-verified Binaryen release. The generator supplies a fixed source path remap and source-date epoch, then records the EasyTier commit and optimized artifact SHA-256. Tracked EasyTier changes block generation; unrelated untracked files do not. corehost.CoreInfo() exposes that provenance without exposing the artifact bytes.

The same generator rebuilds the Go protobuf bindings from that exact clean EasyTier commit and records their source commit and schema SHA-256. Host creation rejects an artifact/binding commit mismatch. Generation requires protoc 35.1 and protoc-gen-go 1.36.11 on PATH.

The test-only socket probe is retained from EasyTier commit 6a3d15f; its full commit and checksum are recorded in testdata/wasi_socket_guest.source.

Run all reactor, ABI conformance, lifecycle, and two-instance network tests with:

go test -count=1 ./...