42 KiB
Security
This page covers LogWisp's transport security: what it protects, how to configure it, and — equally important — what it does not yet do.
Current State
Implemented:
- TLS 1.2 / 1.3 on all network sources and sinks.
- Server certificate verification by dialers, by a CA or by the pin of the
server's key (
pin_sha256). - Certificates without files: listeners make theirs at startup, self-signed
or from an issuer CA, and
lw tlsmakes a CA and certificates: see Certificates made at startup. - Mutual TLS (client certificate required and verified), at the transport layer.
- Peer identity recorded per session.
- Authorization from certificate identity (allow-lists, node binding): see The Auth Block.
- Password (Argon2id-SCRAM) authentication, bound to the TLS channel: see Password Authentication.
- Authentication on the
httpsink's stream and status endpoints: client certificate or bearer token. - Browser logins behind a site's TLS-terminating proxy: see Browsers behind a TLS-terminating proxy.
- Server pinning by dialers: certificate identity (
mtls), bound certificate (scram). - Startup warnings for expiring certificates and risky settings: see Startup Warnings.
- Unknown configuration keys rejected: a typo in
tls,author a table path fails startup. - Configuration input hardened (lixenwraith/config v0.2.2 and
lixenwraith/toml v0.1.3, reviewed with adversarial tests and fuzzing like
auth):- a document creates at most 65536 tables, so a small file cannot exhaust memory, and unescaped control characters are refused in strings and comments;
- a string in the file is one list entry, so a filter pattern holding a comma is not split into patterns that match nothing;
- the file is opened without blocking, so a FIFO swapped in for it cannot
hang the watcher or a
SIGHUPreload; - a permission change on the file is reported once and does not stop auto-reload;
- parse and conversion errors name the key, never the value, so a secret placed in the wrong key does not reach the log.
Not implemented:
- Certificate revocation lists (CRL) or OCSP: revoke by editing the allow-list or credentials file.
- IP allow/deny lists, per-IP connection or request limits: only SCRAM logins are throttled per address.
- PROXY protocol: behind a proxy that passes TLS through, every peer shares the proxy's address; see Behind nginx or another proxy.
Two credentials are supported. Certificates (mtls) are the one the transport
already carries: the tls block establishes that a peer chains to your CA, and
the auth block decides which of those peers may do what. Passwords (scram)
need no client PKI: the listener holds verifiers, never passwords, and every
login is bound to the listener's certificate.
The TLS Block
One option shape serves both roles, so the configuration reads the same wherever it appears. Which keys matter depends on whether the plugin listens or dials.
[pipelines.plugin_sources.config.tls] # or plugin_sinks.config.tls
enabled = false
cert_file = ""
key_file = ""
client_auth = false
client_ca_file = ""
ca_file = ""
server_name = ""
insecure_skip_verify = false
pin_sha256 = ""
self_signed = false
issuer_cert_file = ""
issuer_key_file = ""
hosts = []
min_version = "1.3"
Options by role, each with its default:
- Both roles
enabled(false): master switch; when false the whole block is ignored.cert_file: local certificate; a listener needs it,self_signedor the issuer files, a dialer may present it as its client identity.key_file: private key forcert_file; set the two together.min_version("1.3"):"1.2"or"1.3".
- Listeners
self_signed(false): make a self-signed certificate at startup.issuer_cert_file,issuer_key_file: make one at startup, signed by this CA (lw tls ca).hosts([]): names and addresses a made certificate carries, beyond the listener'shost,os.Hostname(),localhost,127.0.0.1and::1.client_auth(false): require and verify a client certificate (mTLS).client_ca_file: CA bundle that verifies client certificates; required whenclient_authis true.
- Dialers
ca_file(system store): CA bundle that verifies the server certificate.server_name(the configuredhost): SNI and certificate name to verify against.insecure_skip_verify(false): disable server verification.pin_sha256:sha256//BASE64of the server's public key, curl's--pinnedpubkeyform,;between several; it replaces the CA and name checks.
Listeners are the tcp and http sinks and the tcp_chain and http_chain
sources; dialers are the tcp_chain and http_chain sinks.
min_versiontakes"1.2"or"1.3". The older"TLS1.2"spelling from pre-restructure releases is rejected. There is nomax_versionand nocipher_suitesoption; TLS 1.3 suites are not configurable in Go, and the 1.2 defaults are the standard library's.
Validation
Misconfiguration fails at plugin construction, before the pipeline starts:
- a listener with
enabled = trueand none ofcert_file/key_file,self_signed,issuer_cert_file/issuer_key_file, or more than one; an issuer that is no CA (lw tls camakes one) pin_sha256withca_fileorinsecure_skip_verify, or not of thesha256//BASE64form; a listener key on a dialer, orpin_sha256on a listenerclient_auth = truewith noclient_ca_file- a dialer with only one of
cert_file/key_file - a certificate or key that will not load, or a CA file containing no certificates
- a
min_versionthat is neither"1.2"nor"1.3" - a key the plugin does not know, at any depth:
unknown key "tls.enabeld". A misspelled option must not silently leave a protection switched off
The Auth Block
TLS answers "is this channel private, and does the peer chain to a CA". Auth answers "may this peer do this". They are separate blocks because they are separate questions.
[pipelines.plugin_sources.config.auth] # or plugin_sinks.config.auth
type = "none" # none | mtls | scram
identity = "cn" # cn | san_dns | san_uri | san_email
allow = [] # mtls
allow_patterns = [] # mtls
node_binding = "force" # chain sources only
credentials_file = "" # scram listeners
token_lifetime_ms = 0 # scram, HTTP listeners; 10 s to 24 h, 0 = 15 minutes
username = "" # scram dialers
password_file = "" # scram dialers
trusted_proxies = [] # scram http sink behind a TLS-terminating proxy
Options by where they apply, each with its default:
- Every plugin
type(none):noneignores the block;mtlsauthorizes by certificate identity,scramby password.
- Chain sources
node_binding(force):none,assertorforce.
mtls, andscramlistenersidentity: the certificate field carrying the identity;cnundermtls, unset underscram, where it binds the client certificate to the user.
mtlsallow([]): exact identities to admit.allow_patterns([]): RE2 patterns matched against the identity; anchor them yourself.
scramlistenerscredentials_file: verifiers written bylw auth add-user.token_lifetime_ms(15 minutes): bearer token lifetime, 10 s to 24 h; thehttpsink andhttp_chainsource only.trusted_proxies([]): addresses or CIDRs of the reverse proxies that end the browsers' TLS; thehttpsink only, see Browsers behind a TLS-terminating proxy.
scramdialersusername: user to log in as.password_file: file holding the password; one trailing line break is trimmed.
Roles by plugin, and what the block decides:
- Listeners
tcp_chainandhttp_chainsources: which senders may ingest, and what node label their entries carry.tcpandhttpsinks: which clients may read the stream (and, onhttp, the status endpoint).
- Dialers: the
tcp_chainandhttp_chainsinks.mtls: which server identity to accept, beyond hostname verification.scram: which user to log in as.
Identity
Under mtls the identity is one string pulled from the peer's verified leaf
certificate; under scram it is the username. The handshake has already
checked the chain, signature, and validity window, so this is pure field
selection.
Modes, each with the field it reads and its typical use:
cn(default):Subject.CommonName; matches the existingtls_peer_cnmetadata.san_dns: the first DNS SAN; host identities.san_uri: the first URI SAN; SPIFFE-style IDs.san_email: the first email SAN; operator identities.
A certificate with no usable value in the chosen field is rejected. An empty identity is a refusal, not an empty match.
The allow list
allow is an exact-match set; allow_patterns holds RE2 patterns. An identity
passes if it appears in either. Under scram the credentials file is the allow
list, and both keys are refused.
Leaving both empty under type = "mtls" admits any identity the CA vouches
for. That is deliberate — it is how you enable node binding without enumerating
a whole fleet — but it is announced rather than silent:
WARN msg="Auth policy admits any identity the configured CA vouches for"
component=tcp_chain_source instance_id=in_tcp
hint="set auth.allow or auth.allow_patterns to authorize named peers"
Anchor your patterns. allow_patterns = ["edge-\\d{2}"] matches
evil-edge-01-impostor; ["^edge-\\d{2}$"] does not. An unanchored pattern is
reported at startup.
Node binding
node_binding applies only to the chain sources. assert and force take the
connection label over from trust_node; only force also overrides the
per-entry labels.
none:trust_nodegoverns both the connection label and the per-entrynodefield.assert- Connection label: must equal the identity; a mismatch or an omission is rejected.
- Per-entry
nodefield:trust_nodegoverns.
force- Connection label: ignored; the identity is used.
- Per-entry
nodefield: overwritten with the identity.
Use force on an ingest boundary you do not trust. Every entry is
relabelled, so a compromised edge cannot smuggle a foreign origin through the
per-entry node field either. It is the default whenever type is mtls or
scram.
Use assert on a relay-to-relay hop. The relay must prove its own identity —
a mismatch fails loudly instead of being silently corrected — but the entries it
forwards keep the origin labels stamped at the first hop, so multi-hop
attribution survives.
When binding is active the source says so at startup:
INFO msg="Node labels bound to peer identity; trust_node is ignored"
component=tcp_chain_source node_binding=force trust_node=true
Dialer-side pinning
Under mtls, the block on a chain sink pins the server's identity. Hostname
verification already proves the server holds a certificate valid for the address
you dialed; pinning additionally requires that certificate to name an identity
you listed.
[pipelines.plugin_sinks.config.auth]
type = "mtls"
allow = ["relay.internal"]
The check runs as part of the handshake, so a server the policy rejects never
receives an entry — the sink's normal backoff loop handles it like any other
connect failure. Under scram the dialer binds its login to the certificate it
was shown instead; see Channel binding.
Validation
Misconfiguration fails at plugin construction, before the pipeline starts:
typemtlsorscramwithouttls.enabled(proxy mode aside), or on a dialer withtls.insecure_skip_verify: an identity read from an unverified chain is a claim, and an unverified server could relay a logintype = "mtls"on a listener withouttls.client_auth- a block naming peers or credentials (
allow,allow_patterns,credentials_file,token_lifetime_ms,username,password_file,trusted_proxies) whosetypeisnoneor unset: auth was intended and the type forgotten - a key of the other method:
alloworallow_patternsunderscram, ascramkey undermtls - a
scramlistener without a loadablecredentials_file(see Credentials file), withusernameorpassword_file, with atoken_lifetime_msoutside 10 s to 24 h or on a TCP listener, or withidentitybut notls.client_auth - a
scramdialer withoutusernameandpassword_file, withcredentials_file,token_lifetime_ms,trusted_proxiesoridentity(server pinning ismtlsonly), or with a password file that is empty or over 1024 bytes trusted_proxieson anything but thehttpsink, withidentity, or with an entry that is neither an address nor a CIDR;login_pageorviewer_pagewithouttrusted_proxies,viewer_pagewithoutlogin_page- an
identitythat is not one of the four modes - an
allow_patternsentry that does not compile - a
node_bindingthat is not one of the three values, or one set on a plugin that has no node concept - an HTTP path (
stream_path,status_path,ingest_path) equal to/auth, which is reserved for logins
Errors read like auth: type "mtls" requires tls.client_auth.
Startup Warnings
Some settings work but are usually mistakes. Each plugin reports them at WARN when it is constructed, so startup and every reload repeat them:
- a certificate in
cert_file,ca_file,client_ca_fileorissuer_cert_filethat has expired, is not yet valid, or expires within 30 days - a self-signed listener, with the
pin_sha256its dialers need insecure_skip_verifyon a dialer- an
allow_patternsentry not anchored at both ends of every alternative (^a|b$admitsa…and…b) - a
key_file,issuer_key_file,credentials_fileorpassword_fileevery local user can read (once per path per process)
Certificates made at startup
A listener needs no certificate files. With self_signed = true, or with
issuer_cert_file and issuer_key_file, it makes an ECDSA P-256 key once per
process and, at startup and every reload, a certificate for it valid 397 days
(never past the issuer), for hosts, its host (unless a wildcard),
os.Hostname(), localhost, 127.0.0.1 and ::1.
- Self-signed. No CA can vouch for it, so dialers pin its key:
pin_sha256, which the listener logs at WARN on every start. A reload keeps the key and so the pin; a restart changes both, and every dialer must be given the new pin. Suits one aggregator and a few edges, a test, or a stream read bycurl --pinnedpubkey. - Issuer.
lw tls camakes a CA once; the listener signs its own certificate with it, and dialers verify it withca_file = ca.crt, by name, across restarts. The CA key then lives on the listener's host: give each listener group its own CA, or issue certificates elsewhere withlw tls certand usecert_file. - Pins. A pin is the SHA-256 of the server's public key, not of its
certificate, so it survives reissue.
pin_sha256accepts several,;between them, for a rotation. It replaces chain, name and validity checks: whoever holds the key is the server.scramdialers still bind every login to that certificate.
lw tls ca --dir /etc/logwisp/pki # ca.crt, ca.key (0600)
lw tls cert --ca-dir /etc/logwisp/pki --name agg.example.org --server
lw tls cert --ca-dir /etc/logwisp/pki --name edge-01 --client
Enabling mTLS
1. Generate a CA and certificates
lw tls makes them (above); with openssl,
cfssl, step-cli or an existing PKI:
# CA
openssl req -x509 -newkey rsa:4096 -nodes -days 3650 \
-keyout ca.key -out ca.crt -subj "/CN=LogWisp CA"
# Relay (server) certificate — SAN must match how clients address it
openssl req -newkey rsa:2048 -nodes -keyout relay.key -out relay.csr \
-subj "/CN=relay.internal"
openssl x509 -req -in relay.csr -CA ca.crt -CAkey ca.key -CAcreateserial \
-out relay.crt -days 825 \
-extfile <(printf "subjectAltName=DNS:relay.internal\nextendedKeyUsage=serverAuth")
# Edge (client) certificate — CN identifies the node
openssl req -newkey rsa:2048 -nodes -keyout edge-01.key -out edge-01.csr \
-subj "/CN=edge-01"
openssl x509 -req -in edge-01.csr -CA ca.crt -CAkey ca.key -CAcreateserial \
-out edge-01.crt -days 825 \
-extfile <(printf "extendedKeyUsage=clientAuth")
The server certificate's SAN must cover the address clients dial. Dialers seed
ServerName from the configured host, so an IP literal in host requires an
IP SAN, and a DNS name requires a DNS SAN. Override with server_name when the
dialed address and the certificate name legitimately differ.
2. Configure the listener
[pipelines.plugin_sources.config.tls]
enabled = true
cert_file = "/etc/logwisp/tls/relay.crt"
key_file = "/etc/logwisp/tls/relay.key"
client_auth = true
client_ca_file = "/etc/logwisp/tls/ca.crt"
min_version = "1.3"
[pipelines.plugin_sources.config.auth]
type = "mtls"
allow = ["edge-01", "edge-02"]
node_binding = "force"
Without the auth block the listener accepts every certificate the CA issued.
With it, only edge-01 and edge-02 may ingest, and their entries are labelled
from their certificates rather than from whatever they declare.
3. Configure the dialer
[pipelines.plugin_sinks.config.tls]
enabled = true
ca_file = "/etc/logwisp/tls/ca.crt"
cert_file = "/etc/logwisp/tls/edge-01.crt"
key_file = "/etc/logwisp/tls/edge-01.key"
min_version = "1.3"
[pipelines.plugin_sinks.config.auth]
type = "mtls"
allow = ["relay.internal"]
4. Verify
Startup logs report the transport flags and the compiled policy:
INFO msg="TCP chain source initialized" ... tls=true mtls=true
auth="mtls identity=cn allow=[2 exact, 0 pattern(s)] node_binding=force"
INFO msg="TCP chain sink initialized" ... tls=true mtls=true
auth="mtls identity=cn allow=[1 exact, 0 pattern(s)] node_binding=none"
A client that presents no certificate is refused during the handshake
(tls: client didn't provide a certificate, counted in tls_handshake_errors).
A client whose certificate is valid but whose identity is not authorized gets
past the handshake and is refused by the policy:
WARN msg="Connection rejected by auth policy" component=tcp_chain_source
remote_addr=<addr> error="auth: refused: identity \"edge-99\" is not allowed"
Policy rejections are counted in the plugin's auth_rejected statistic; the
http sink's status endpoint reports its own. Accepted peers are recorded in
session metadata as auth_method and auth_identity.
test/mtls-chain-test.sh builds a throwaway PKI and exercises the whole surface
end to end — run it with --auto to see each guarantee asserted.
Password Authentication (SCRAM)
type = "scram" authenticates peers by username and password with
Argon2id-SCRAM from lixenwraith/auth. It needs TLS but no client
certificates, works on all six network plugins, and is LogWisp's own protocol,
not standard SASL: viewers use the lw auth CLI or,
behind a TLS-terminating proxy, the shipped browser client.
# Listener: tcp_chain/http_chain source, tcp/http sink
[pipelines.plugin_sources.config.tls]
enabled = true
cert_file = "/etc/logwisp/tls/relay.crt"
key_file = "/etc/logwisp/tls/relay.key"
[pipelines.plugin_sources.config.auth]
type = "scram"
credentials_file = "/etc/logwisp/users.toml"
# Dialer: tcp_chain/http_chain sink
[pipelines.plugin_sinks.config.tls]
enabled = true
ca_file = "/etc/logwisp/tls/ca.crt"
[pipelines.plugin_sinks.config.auth]
type = "scram"
username = "edge-01"
password_file = "/etc/logwisp/edge-01.pass"
Startup reports auth="scram users=2 certificate=independent node_binding=force"
on such a chain source, and auth="scram user=edge-01" on the dialer.
Mechanism
For each user the listener keeps a salt, the Argon2id cost, and two keys derived
from K = Argon2id(password, salt): StoredKey = SHA-256(HMAC(K, "Client Key")) and ServerKey = HMAC(K, "Server Key"). Neither logs anyone in, but
each password guess against them costs one Argon2id, so keep the file private.
Checking a login is HMAC work only; Argon2id (3 passes, 64 MiB, 4 threads) runs
on the dialer or the CLI. The proof is mutual: the dialer accepts the server's
final message only when it is signed with this user's ServerKey, and it
refuses a challenge asking for less Argon2 work than those defaults, so a rogue
server cannot request a cheaply crackable proof. An unknown user gets a stable
decoy challenge and fails exactly like a wrong password: authentication failed.
Channel binding
Both sides bind the proof to the SHA-256 of the listener's leaf certificate:
the listener hashes the certificate it serves, the dialer the one it was shown.
A TLS-terminating proxy or interceptor shows another certificate — CA-valid or
not — so the proof fails and the relay never obtains a link or a token. The
dialer is told authentication failed either way; the listener compares the
hash the dialer reports, logs the client saw another server certificate: TLS interception or a terminating proxy, and counts auth_binding_mismatch.
An HTTP login takes two requests, and every later request may open a new pooled
connection. After the challenge the dialer pins the certificate it was bound to:
the proof and every ingest request must meet the same certificate, or the TLS
handshake fails before anything is sent. The http_chain sink then drops token
and pin and logs in again, which also covers a rotated server certificate. A
token printed by lw auth token is not pinned.
Certificates and users
tls.client_auth is optional under scram, and on its own independent of the
password: a peer needs some certificate the CA issued and some valid
password, like PostgreSQL's clientcert=verify-ca. Setting identity (which
requires tls.client_auth) binds the two: the certificate's identity field must
equal the username, so every peer needs its own certificate and its own
password, like clientcert=verify-full. A mismatch fails the login; an HTTP
request whose certificate does not match its token's user gets 403. Startup
shows the mode as certificate=independent or certificate=cn=username.
Tokens
The http sink and http_chain source answer a login at POST /auth with a
bearer token: an HS256 JWT valid for token_lifetime_ms (default 15 minutes)
and signed with a key drawn when the plugin is built, so every reload revokes
every token (a rejected reload keeps the running service and its tokens). A
missing, invalid or expired token gets 401 with WWW-Authenticate: Bearer realm="logwisp". An SSE stream is checked when it connects and then outlives
its token; a reload ends it. TCP has no tokens: each connection runs its own
exchange.
Throttling
Logins are throttled per remote socket address or, on an http sink in proxy
mode, per forwarded client (an IPv6 client per /64); forwarded headers are read
only from trusted_proxies. Each exchange takes a token from a bucket of 10
that refills at one per second, and a successful login gives it back, so only
failed or abandoned attempts drain it. At most 4 exchanges per address may be
unfinished: an HTTP challenge never answered holds its slot for up to 30 s, a
TCP connection that ends mid-exchange frees it at once. A refused start answers
too many attempts (HTTP 429) and counts auth_throttled; the table holds
65,536 addresses and refuses new ones when full. Separately, at most 4,096
exchanges may be in flight per listener; beyond that, or while the plugin
stops, a login gets busy (HTTP 503) and counts auth_busy. Peers behind
one NAT or one passthrough proxy share a bucket: there, one client can exhaust
every other client's logins.
Credentials file
# logwisp SCRAM verifiers, written by `lw auth add-user`. Keep it private.
decoy_key = "<base64, 32 random bytes>"
[[users]]
argon_memory = 65536
argon_threads = 4
argon_time = 3
salt = "<base64>"
server_key = "<base64>"
stored_key = "<base64>"
username = "edge-01"
Write it with lw auth add-user rather than by
hand. The whole file is validated when the plugin is built: a decoy_key of at
least 32 bytes, at least one user, unique names, no unknown keys, and one Argon2
profile and salt length for every user, since mixed profiles would tell a prober
which users exist. decoy_key keeps unknown-user challenges stable across
restarts and edits; the CLI creates it once and preserves it. A single probe
cannot tell a real user from an unknown one, but a prober polling a name sees
its salt change when the user is added, rotated or removed. The file is read
only when the plugin is built and auto_reload does not watch it: send
SIGHUP after every change. Use one file per listener when listeners admit
different users.
Rollout, rotation and revocation
- Rollout. Turning
scramon cuts off every dialer of that listener that has no credentials. Upgrade every binary first, then add a second listener withscramon another port, move the dialers to it, and remove the old one. - Password rotation.
lw auth add-user --generatewith the user's--password-filereplaces verifier and password together.SIGHUPthe listener, deploy the password file,SIGHUPthe dialer. Logins fail in between and the dialer retries under backoff, holding its current entry or batch while its input queue fills. To avoid the gap, add a second user, move the dialer to it, then remove the first; undernode_binding = "force"the node label follows the username. - Revocation.
lw auth remove-user, thenSIGHUP. The reload drops every connection and revokes every token; other dialers log in again on their own.
Limits
- TLS must terminate at LogWisp, except on an
httpsink in proxy mode. Behind any other terminating proxy or load balancer every login fails by design; pass TLS through instead (TCP or SNI routing). All clients then share the proxy's address, and so one throttling budget: see Behind nginx or another proxy. - One process per HTTP address. Handshake state and the token key live in one instance, so behind a balancer the proof or the token can reach an instance that never saw the login.
- Browsers log in only to an
httpsink in proxy mode, below; elsewhere usemtlsfor browsers. ncandopenssl s_clientcannot read ascramtcpsink; uselw auth stream.
test/scram-chain-test.sh --auto exercises these guarantees end to end.
Browsers behind a TLS-terminating proxy
A site that serves the log stream inside its own pages ends TLS at its reverse
proxy and need not give LogWisp a private key. trusted_proxies puts the http
sink in proxy mode, where browsers log in with the client LogWisp ships; the
password reaches neither the proxy nor LogWisp.
[pipelines.plugin_sinks.config]
host = "127.0.0.1"
port = 8081
login_page = true # GET /auth/login
viewer_page = true # GET /auth/view, needs login_page
[pipelines.plugin_sinks.config.auth]
type = "scram"
credentials_file = "/etc/logwisp/users.toml"
trusted_proxies = ["127.0.0.1"] # addresses or CIDRs
location /logs/ {
proxy_pass http://127.0.0.1:8081/;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Proto $scheme;
}
- Trust. Every other peer gets
403on every path.X-Forwarded-Protomust behttpson every hop, so a site accidentally served in plaintext fails closed. The client is the rightmostX-Forwarded-Forhop that is not a proxy; throttling, sessions and logs use it. List only the proxies: a client inside a listed range is trusted to name its own hops. - Unbound logins. The browser cannot see a certificate LogWisp could bind
to, so proofs are unbound and a party on the hop between proxy and LogWisp
could relay a login. Keep that hop on loopback or a trusted network, or
enable
tlson the sink; a plaintext hop to a proxy off this host is warned about at startup.identitycannot be combined with proxy mode. - Sessions. The login page asks for a cookie:
logwisp_session,HttpOnly,Secure,SameSite=Strict,Max-Agethe token lifetime, and noPath, so it scopes itself to the mount (/logsabove). Stream and status accept it or a bearer token, sonew EventSource("/logs/stream")works on any page of the site, beside the site's own Basic auth too, andlw auth token --unboundkeeps working.POST /authwith{"logout": true}clears the cookie and revokes the token until it expires./authtakes onlyapplication/json, which a cross-origin page cannot send without a preflight. - Private windows. Private or incognito windows keep cookies in memory, apart from normal windows: they sign in on their own, and the session ends at the token lifetime or when the last private window closes.
- Cookies disabled. The viewer runs in token mode when the browser keeps no
cookie for the site.
- It notices from
navigator.cookieEnabled, from a throwaway cookie with the session's attributes that does not come back (Chromium blocking every cookie still reportscookieEnabled), or from a401right after a cookie login, and shows its own sign-in form. - The token lives in a page variable only, never in storage or the URL. It lasts as long as the page and at most the token lifetime: a reload, another tab, or a reconnect after expiry asks again; sign out revokes it.
- The login page says that cookies are unavailable and links to the viewer.
A page not served over HTTPS keeps no
Securecookie either: both pages name HTTPS instead and offer no sign-in.
- It notices from
- Integrating
scram.js. A site with its own CSP can copyscram.jsfrominternal/sink/http/web/into its bundle: one dependency-free ES module, wherebaseis the mount URL ending in/. It needs a secure context for WebCrypto and takes about 2 s of Argon2 per login on a desktop.- Cookie mode, the default:
login(base, username, password, {onProgress}), thenEventSourceandfetchas for any same-origin resource;logout(base). - Token mode:
login(..., {session: "token"})resolves to{username, expiresIn, token}. Keep the token in memory;stream(url, {token, signal, onEvent})reads the event stream throughfetchwith the bearer, status takesAuthorization: Bearer, andlogout(base, {token})revokes it. The bearer replaces the Basic credentials a browser would send, so token mode cannot pass a proxy that asks for its own Basic auth. cookiesUsable()tells which applies: false when the session cookie would not stick.loginUnavailable(), asked first, names why neither can run (no secure context), or is empty.
- Cookie mode, the default:
- Pages. Under
/auth/the sink servesscram.jsandstyle.cssalways, and withlogin_page/viewer_pagethe login page and a minimal live viewer with their scripts;GET /leads to the viewer, else the login page. All are served underdefault-src 'none'; script-src 'self'; connect-src 'self'; style-src 'self'; form-action 'self'; frame-ancestors 'none'; base-uri 'none'.
test/scram-proxy-test.sh --auto logs in from headless Chromium through such a
proxy, with cookies and with every cookie blocked.
Behind nginx or another proxy
A proxy in front of LogWisp works at one of two layers:
- L7, ending TLS (nginx
httpblock, HAProxymode http): thehttpsink in proxy mode.trusted_proxieslists the proxy's address.- The proxy sends
X-Forwarded-Proto: httpsandX-Forwarded-For. It may overwriteX-Forwarded-Forwith the real client: the rightmost hop that is not a proxy is the client either way.
- L4, passing TLS through to LogWisp's own TLS (nginx
streamwithssl_preread, HAProxymode tcp): whatever needs TLS to end at LogWisp.- Chain links (
tcp_chain,http_chain). lw auth streamviewers of atcpsink.- An
httpsink that keeps its own TLS, and with it SCRAM channel binding or client certificates.
- Chain links (
A common shape serves both from port 443:
:443 nginx stream: ssl_preread routes by SNI, proxy_protocol on
logs.example.org -> 127.0.0.1:8443 nginx http
relay.example.org -> a LogWisp TLS listener, without PROXY (below)
127.0.0.1:8443 nginx http: listens with proxy_protocol, ends TLS
/logs/ -> 127.0.0.1:8081 LogWisp http sink, proxy mode
The http sink behind the http block works in proxy mode as is:
trusted_proxies is the http block's address, usually 127.0.0.1, and the
block names the client from the PROXY header.
server {
listen 127.0.0.1:8443 ssl proxy_protocol;
server_name logs.example.org;
# ssl_certificate, ssl_certificate_key: the site's own
location /logs/ {
proxy_pass http://127.0.0.1:8081/;
proxy_set_header X-Real-IP $proxy_protocol_addr;
proxy_set_header X-Forwarded-For $proxy_protocol_addr;
proxy_set_header X-Forwarded-Proto https;
}
}
$proxy_add_x_forwarded_for does not fit this shape: it appends the stream
server's address, not the client's. LogWisp would name that address as every
client or, when it is trusted (both on 127.0.0.1), the hop to its left: one
the client wrote, so the client picks its own throttling address. LogWisp
ignores X-Real-IP.
LogWisp's own TLS listeners take no PROXY header. LogWisp cannot read the
PROXY protocol yet; it is planned first in the ACL work
(To Do, 1.2).
A stream route that sends proxy_protocol straight to a LogWisp TLS listener
breaks every connection: the header lands in front of the TLS handshake. nginx
sets proxy_protocol per stream server, so route LogWisp SNIs without it:
- Route 1: LogWisp gets its own stream
serverand port, withoutproxy_protocol. - Route 2: port 443 sends LogWisp SNIs to an internal stream
serverthatlistens withproxy_protocoland proxy_passes to LogWisp without it; that hop consumes the header. - Either way dialers must send the name: a
hostthat is one, ortls.server_name(--server-nameforlw auth); an IP literal sends no SNI. - With HAProxy, leave
send-proxyoff the LogWisp backends.
stream {
map $ssl_preread_server_name $route {
relay.example.org 127.0.0.1:10443; # route 2: the internal hop
tail.example.org 127.0.0.1:10443;
default 127.0.0.1:8443; # the http block, logs.example.org
}
map $ssl_preread_server_name $logwisp {
relay.example.org 127.0.0.1:9001; # tcp_chain source
tail.example.org 127.0.0.1:9002; # tcp sink, for lw auth stream
}
server {
listen 443;
ssl_preread on;
proxy_protocol on; # on every route of this server
proxy_pass $route;
}
server { # route 1: its own port, no header
listen 9443;
ssl_preread on;
proxy_pass $logwisp;
}
server { # route 2: consumes the header
listen 127.0.0.1:10443 proxy_protocol;
ssl_preread on;
proxy_pass $logwisp;
}
}
Passthrough without PROXY brings every peer from the proxy's address:
- All peers share one SCRAM throttling budget: 10 failed or
abandoned logins, then one per second, and 4 unfinished at once. One client
that keeps failing logins makes every other client's logins answer
too many attemptsuntil it stops. - Established
tcp_chainlinks and open streams keep flowing; a reconnect waits for the budget. Anhttp_chainsink whose early renewal is put off (too many attemptsorbusy) keeps sending on its token to the server it pinned, retrying every few seconds, and holds its batches only once that token has expired; any other refusal ends the token at once. - Logs and sessions name the proxy, not the peer.
- Proxy mode is unaffected: it throttles on the forwarded client.
- Until LogWisp reads PROXY, mitigate:
- expose the chain ports directly, without the proxy, where you can;
- keep the proxy hop on a trusted network, so only trusted clients share the budget;
- or accept the shared budget.
What Each Layer Enforces
tls with client_auth = true — a membership check. The peer holds a
certificate chaining to client_ca_file, within its validity window, and holds
the matching private key. Every CA-issued certificate is equivalent at this
layer.
auth with type = "mtls" — an identity check, per listener: only the
identities you list may connect, so one CA can serve several trust domains and
a single peer can be withdrawn without touching the others.
auth with type = "scram" — a password check, per listener: only the
users in its credentials file may connect, the login cannot be relayed through
another certificate (proxy mode, where TLS ends at the site's proxy, aside),
and with identity each user is tied to its own certificate.
Under either method the chain node label can be bound to the identity, so a
compromised edge cannot attribute its entries to another host, and the http
sink's stream and status endpoints stop being open to anyone who can reach the
port.
Revocation is the allow-list or the credentials file, not a CRL. Remove the
identity or user and send SIGHUP: the reload rebuilds every pipeline, so the
change takes effect on the next connection and existing ones are dropped by the
rebuild. No network call on the handshake path, and no window between revocation
and the next CRL publication. See
mtls-auth-plan.md for what CRL support
would add.
Surfaces Without Access Control
An auth block (mtls or scram) closes each of these. Without one, bind them
to a trusted interface or front them with an authenticating proxy.
What each exposes when auth.type = "none":
httpsinkstream_path: the full log stream, withAccess-Control-Allow-Origin: *, so any browser origin can read it (the header is omitted once an auth policy is set).httpsinkstatus_path: host, port, TLS flag, uptime, client counts, throughput counters.httpsinkGET /(303to/auth/view) and the viewer's files: static pages that read the two endpoints above under the CSP and expose nothing beyond them. Undermtlsthey are served before the allow list, while the stream and status stay gated.tcpsink: the full log stream to any client that connects.tcp_chainandhttp_chainsources: ingest from any peer that can connect (withclient_auth, any the CA vouches for), under any node label it claims.
max_connections bounds concurrency on all of them but does not distinguish
callers.
Both methods require TLS on the listener, except an http sink in proxy mode,
where TLS ends at the trusted proxy; mtls also requires client_auth.
Operational Guidance
Certificates and secrets
- Use a dedicated CA for LogWisp so its trust decisions stay independent.
- Keep leaf lifetimes short (90–825 days) and automate renewal.
- Key, credentials and password files should be
0600and owned by the service account; a world-readable one is reported at startup.lw authcreates them0600and keeps the mode of an existing file. - Rotation requires a reload (
SIGHUP), because certificates and credentials are loaded once at plugin construction; there is no on-disk watch for them. - Startup and every reload warn 30 days before a certificate lapses. Still automate renewal; the warning only reaches someone reading the log.
- Keep the identity field you authorize on stable across rotations. Reissuing a leaf with a different CN silently drops the peer out of the allow list.
Deployment
- Prefer
min_version = "1.3". Drop to"1.2"only for a peer that genuinely cannot do 1.3. - Never enable
insecure_skip_verifyoutside a lab; it disables server verification entirely and makes the connection trivially interceptable. It is reported at startup. - Bind listeners to specific interfaces rather than
0.0.0.0where you can. - On any ingest port reachable from a network you do not fully control, set an
authblock:mtlswith an explicitallowlist, orscram.trust_node = falseis the fallback when neither is an option; it is unforgeable but labels entries by remote address, which is useless behind NAT or a load balancer. - Run LogWisp as an unprivileged user with write access only to its own log and configuration directories.
Log content
Logs routinely contain secrets that were never meant to leave the host. Filters are the available tool:
[[pipelines.flow.filters]]
type = "exclude"
patterns = ["password", "api[_-]?key", "authorization", "bearer ", "secret"]
Choose a sanitizer policy that matches the sink — json for JSON output,
txt for files and consoles — so control characters in log data cannot break
framing or inject terminal escapes downstream. See
Formatters.
The raw format passes control characters through. A console sink writing to
a terminal escapes them itself (escape = "auto"), so a log line cannot move
the cursor, retitle the window, write the clipboard (OSC 52) or reorder text
with bidi controls; pipes and files get the bytes unchanged. See
Sinks.