Multipath
mqvpn uses Multipath QUIC to send traffic over multiple network paths simultaneously. This enables:
- Seamless failover — If one path goes down, traffic continues on the remaining paths to minimize disruption during path changes.
- Bandwidth aggregation — Combine bandwidth from multiple interfaces (e.g., WiFi + LTE). Aggregation works best with multiple concurrent flows; to aggregate a single TCP flow, use hybrid mode.
Setting Up Multipath
CLI
Use --path to specify each network interface:
sudo ./build/mqvpn --mode client --server 203.0.113.1:443 \
--auth-key <key> --path eth0 --path wlan0Config File
[Multipath]
Scheduler = wlb
Path = eth0
Path = wlan0TIP
Without any --path flags or Path entries, mqvpn uses the default interface (single path mode).
Schedulers
The scheduler decides how to distribute packets across paths. mqvpn supports the following schedulers:
WLB (Weighted Load Balancing) — Default
WLB combines path weighting and flow-aware scheduling for QUIC datagrams:
- Estimates each path's throughput from live metrics (loss, RTT, cwnd) and uses the result as a traffic distribution ratio
- Uses deficit-based WRR to distribute traffic across active paths
- Pins inner TCP flows (by flow hash) to a path to reduce reordering in VPN tunnels
- Uses soft pinning when the pinned path is temporarily cwnd-blocked (spillover without permanent re-pin)
- Falls back to MinRTT for non-datagram/control packets and when no active schedulable path is available
--scheduler wlbWLB UDP Pin (wlb_udp_pin)
A variant of WLB that keeps each UDP connection on a single path, on top of the TCP pinning that plain WLB already does.
--scheduler wlb_udp_pinUse this when you have inner UDP traffic that maintains its own packet ordering and you observe throughput degradation under plain wlb. The mechanism: when mqvpn spreads packets across paths with different latencies, an inner protocol that tracks ordering may mistake the reorder for packet loss, slow itself down, and throughput drops. wlb_udp_pin keeps the packets of each UDP connection on one path so this reorder doesn't happen.
Note that with a single inner UDP connection, wlb_udp_pin is capped at one path's bandwidth. As long as the inner protocol runs over a single sequence space, you cannot aggregate bandwidth across paths without the inner protocol itself going multipath. The point of wlb_udp_pin here is to give you a steady "one path's worth" of throughput, rather than per-packet striping under plain wlb potentially collapsing to less than one path's throughput under reorder.
Stick with plain wlb when your UDP traffic tolerates packet reorder. mqvpn then spreads packets across paths per-packet, giving better combined bandwidth than pinning. There's also a practical limit on wlb_udp_pin: mqvpn tracks UDP connections in a fixed-size table, so if your traffic creates thousands of short-lived UDP flows per second, wlb_udp_pin can lose track of older flows and the pinning becomes unreliable. For those cases plain wlb is safer.
In short: try wlb_udp_pin if you observe degraded UDP throughput under wlb. Otherwise leave it on wlb.
MinRTT (Minimum Round-Trip Time)
MinRTT sends each packet on the path with the lowest current RTT. It is simpler but may not utilize available bandwidth as efficiently.
- Optimizes for latency over throughput
- Simpler algorithm, more predictable behavior
--scheduler minrttBackup FEC (experimental)
Sends regular traffic on the AVAILABLE path and FEC repair symbols on the STANDBY path. Designed for lossy primary links (e.g., spotty WiFi) backed by a more reliable standby (e.g., LTE).
--scheduler backup_fecWhen to use: WiFi+LTE multipath in lossy environments. Repair symbols on the standby path enable instant recovery from primary-path losses without waiting for retransmission RTTs.
When NOT to use:
- Single-path setups (no standby path = no place for repair symbols)
- High-bandwidth scenarios where you want bandwidth aggregation (use
wlbinstead) - Both endpoints must be on mqvpn ≥ 0.4.0 with FEC build enabled (
-DXQC_ENABLE_FEC=ON -DXQC_ENABLE_XOR=ON)
Tuning: Default config uses XOR FEC with ~33% per-block overhead (see src/mqvpn_scheduler.h MQVPN_FEC_* macros). No CLI flags exposed for FEC parameters in this experimental release.
Performance: See weekly benchmarks for measured throughput vs WLB across loss rates 1%–10%.
Scheduler Selection Guide
| Scenario | Recommended |
|---|---|
| General use, bandwidth aggregation | WLB + Hybrid Mode |
| Inner UDP needing single-path delivery | wlb_udp_pin |
| Latency-sensitive applications | MinRTT (trades off bandwidth aggregation; if latency matters most, consider adding Reinjection (dgram)) |
| Combinations of poor-quality links | MinRTT + Hybrid Mode (consider adding Reinjection or the reorder buffer as needed) |
| Lossy primary + reliable standby (experimental) | backup_fec |
Reinjection (Speculative Duplication)
Reinjection sends copies of selected packets over a second path. It costs some extra bandwidth, and in return the tunnel rides out packet loss and sudden link trouble much more smoothly. Off by default, and independent of the scheduler choice: originals are scheduled normally, while copies are always placed on a different path than their origin.
Ref: XLINK (SIGCOMM 2021)
[Multipath]
Reinjection = deadline # off | deadline | idle | dgram| Mode | What gets copied | Use it for |
|---|---|---|
deadline | Stream-lane (TCP-side) data still awaiting delivery confirmation that is running late, plus everything sent on a link judged unhealthy | Insurance for tunnels running Hybrid Mode, which carries TCP over QUIC streams: does nothing (and costs nothing) most of the time, and minimizes the hiccup at the moment a link suddenly goes bad |
idle | Recent still-unconfirmed stream data (TCP side only), in moments when the tunnel has nothing else to send | Low-cost smoothing of occasional hiccups in interactive use (SSH, browsing). No tuning needed |
dgram | Every packet on the datagram lane, always — hybrid-mode TCP is not copied | Tunnels dedicated to real-time traffic (VoIP, gaming): a lost packet or a dying link no longer causes dropouts or lag spikes. Note: since everything is always copied, this trades off against bandwidth aggregation |
Why a hiccup can happen at all: when a link goes bad, the scheduler does steer new data to the healthy link — but data already sent on the failing link still has to be recovered, and in-order delivery makes everything behind it wait, even data that already arrived via the healthy link (multipath head-of-line blocking). A silently dead link is only detected after a timeout of hundreds of milliseconds, so in the worst case that wait approaches a second. deadline resends the late data on the healthy link right away, reducing that wait.
Deadline-mode tuning (defaults shown):
ReinjectionSrttFactorPct = 110 # duplicate when older than 1.1 × min_srtt (100–1000)
ReinjectionHardDeadlineMs = 500 # upper clamp on the deadline (1–60000)
ReinjectionDeadlineLowerBoundMs = 20 # lower clamp (1–60000; clamped down to the hard deadline)Notes:
- Reinjection is sender-side: each side's setting protects the traffic it sends, so enable it on the server to protect download traffic (and on the client for upload).
dgramuses double the bandwidth for that traffic and is not recommended for mixed tunnels: it duplicates all inner UDP — including HTTP/3 video streams — so the usable speed of the datagram lane drops to a single path's capacity.- Per-path duplicated bytes are reported as
reinject_tx_bytesin the control APIget_statusresponse. - Requires two or more active paths; silently inactive otherwise.
Path Weighting
WLB automatically updates path weights from live transport metrics. You do not need to configure weights manually.
How it works:
- Loss, RTT, and cwnd are used to estimate each path's throughput, which becomes its traffic distribution weight
- Deficit WRR uses those weights to assign packets/flows across available paths
- Existing TCP flow pins are reused, and stale pins are evicted on idle/loss/path failure
- Weights and deficits are refreshed at round boundaries and on path recovery events
This means asymmetric paths (e.g., 300 Mbps wired + 80 Mbps wireless) are utilized efficiently without any manual tuning.
How It Works
┌─────────────────┐ ┌─────────────────┐
│ Application │ │ Internet │
├─────────────────┤ ├─────────────────┤
│ TUN (mqvpn0) │ │ TUN (mqvpn0) │
├─────────────────┤ ├─────────────────┤
│ MASQUE │ HTTP Datagrams │ MASQUE │
│ CONNECT-IP │◄──(Context ID = 0)──────►│ CONNECT-IP │
├─────────────────┤ ├─────────────────┤
│ Multipath QUIC │◄── Path A (eth0) ─────►│ Multipath QUIC │
│ │◄── Path B (wlan0) ─────►│ │
├─────────────────┤ ├─────────────────┤
│ UDP (eth0/wlan)│ │ UDP (eth0) │
└─────────────────┘ └─────────────────┘
Client ServerEach path is a separate UDP socket bound to a specific network interface. Multipath QUIC manages the paths at the QUIC layer — the server sees a single QUIC connection with multiple paths.
Benchmarks
For failover and bandwidth aggregation measurements in a simulated dual-path environment (300 Mbps + 80 Mbps with netem), see the benchmark report.
Protocol Standards
| Protocol | Spec |
|---|---|
| MASQUE CONNECT-IP | RFC 9484 |
| HTTP Datagrams | RFC 9297 |
| QUIC Datagrams | RFC 9221 |
| Multipath QUIC | draft-ietf-quic-multipath |
| HTTP/3 | RFC 9114 |