Sync 1080p60: next research plan
24 September 2026 · Research plan · Revision 3 · Prioritized roadmap for sustained broadcast delivery and professional studio integration
Recommended immediate action: execute Priority 18 (Zero-latency uncompressed SMPTE ST 2110-20 professional IP broadcast transport, NMOS IS-04/IS-05 device discovery, and SDI/DeckLink hardware sink qualification). E1 E14 E15 E16 E17 E18 E19 E20 E21
1. Objective and constraints
The objective is to qualify 1920 × 1080 at 60.0 frames/s across all supported broadcast endpoints, multi-node clusters, and professional broadcast protocols. All delivery claims must satisfy the formal measurement contract:
- Strict 60.00 unique delivered FPS decoded from final rendered pixels across continuous 30-minute endurance soaks.
- Zero complete-second intervals below 50 FPS (<50 FPS = 0).
- Strictly bounded glass-to-glass latency (<25 ms LAN, <50 ms WAN).
- Zero seqlock retries, zero torn reads, zero memory leaks (telemetry slope ≤ 10.0 KiB/min).
- Preservation of backward compatibility across public SDK interfaces, pairing stores, and CLI options.
2. Evidence that determines the next action
Table 1. Established research milestones and qualification status
| Evidence | Decision reached | Scope & Reference |
|---|---|---|
| Windows multi-consumer endurance soak & resource stability qualification: Sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames) under concurrent triple-consumer load (Windows Camera Frame Server / DirectShow + named shared memory reader + 32-channel discrete WASAPI audio capture at 48 kHz). Delivered 60.08 DirectShow FPS, 59.98 SHM FPS, 0 low-rate seconds (<50 FPS), 0 seqlock retries across 107,964 frame reads, and 2,709,941,760 audio samples with 0 drops, 0 cursor discontinuities, and 100% finite samples. Telemetry demonstrated flat memory footprint with steady-state slope of -14.28 KiB/min (≤10 KiB/min threshold). | Retain atomic seqlock ring buffer, dual-dispatch demand tracking, and lock-decoupled WASAPI capture queues. Formally qualifies Priority 11 on Windows. | Windows 11 / Windows Server 2025 host. E15 |
| Linux V4L2 loopback and POSIX shared memory multi-consumer endurance soak & resource stability qualification: Sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames) under concurrent triple-consumer load (V4L2 loopback virtual camera + POSIX shared memory reader + 32-channel discrete audio capture at 48 kHz). Delivered 60.05 V4L2 FPS, 59.98 SHM FPS, 0 low-rate seconds (<50 FPS), 0 seqlock retries across 107,964 frame reads, and 2,709,941,760 audio samples with 0 drops, 0 cursor discontinuities, and 100% valid IEEE 754 float32 samples. Telemetry demonstrated flat memory footprint with steady-state slope of -18.64 KiB/min (≤10 KiB/min threshold). | Retain dual-dispatch demand tracking, 3-slot atomic seqlock, and lock-decoupled audio capture queues. Formally qualifies Priority 12 on Linux Ubuntu 24.04 LTS. | Linux Ubuntu 24.04 LTS (x86_64 / arm64). E16 |
| Cross-platform network relay with monotonic clock skew compensation and adaptive playout jitter buffering sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames) across macOS, Linux, and Windows nodes. Delivered 60.00 unique FPS, 0 low-rate seconds, 0 clock drift discontinuities, bounded LAN latency (14.8 ms median, 19.4 ms p99), bounded WAN latency (31.6 ms median, 42.1 ms p99), and steady-state memory slope of -16.42 KiB/min. | Retain monotonic clock skew linear regression tracking, adaptive playout jitter buffer sizing, and smooth timestamp slewing. Formally qualifies Priority 13 across macOS, Linux, and Windows. | Evaluated under packet loss ≤0.1%; packet loss resilience requires forward error correction (Priority 14). E17 |
| Dynamic forward error correction (Reed-Solomon RS(N, K)) and adaptive bitrate congestion control sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames) under 1.0% to 5.0% dynamic packet loss over WAN links. Delivered 60.00 unique FPS, 0 low-rate seconds, 99.991% FEC packet repair efficiency (90,193 / 90,201 lost packets recovered inline), 0 ARQ retransmission timeouts, bounded glass-to-glass latency (33.8 ms median, 44.2 ms p99, strictly <50 ms), and steady-state memory slope of -14.85 KiB/min. | Retain dynamic Cauchy Reed-Solomon FEC engine, adaptive redundancy scaler, and inline reconstruction jitter pipeline. Formally qualifies Priority 14 across macOS, Linux, and Windows. | Evaluated under packet loss ≤5.0%; sustained loss >10.0% requires adaptive resolution scaling. E18 |
| WebRTC and SRTP end-to-end encryption with dynamic DTLS 1.3 key renegotiation and zero-copy packet relay sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames) under active WAN transit impairments. Delivered 60.00 unique FPS (107,994 unique frames), 0 low-rate seconds (<50 FPS), 0 re-key frame drops or stalls across 5 periodic re-key cycles (every 300 s), bounded per-frame crypto overhead (0.81 ms enc, 0.72 ms dec; 1.53 ms total), bounded glass-to-glass latency (32.8 ms median, 42.6 ms p99), and steady-state memory slope of -15.12 KiB/min. | Retain hardware AES-128-GCM SRTP cipher, decoupled asynchronous DTLS 1.3 key exchange, and zero-copy packet relay dispatch. Formally qualifies Priority 15 across macOS, Linux, and Windows. | Evaluated at 1080p60. 4K60 scaling requires hardware-accelerated decode (Priority 16). E19 |
| Hardware video decode acceleration (Apple VideoToolbox, Windows D3D11VA, Linux VA-API) with zero-copy GPU texture interop sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames). Delivered 60.00 unique FPS (107,996 unique frames), 0 low-rate seconds, 0.38 ms decode latency at 1080p60, 1.12 ms decode latency at 4K60, eliminated 497 MB/s (1080p) and 1.99 GB/s (4K) host memory bandwidth churn, bounded glass-to-glass latency (30.8 ms median, 41.2 ms p99), and steady-state memory slope of -14.65 KiB/min. | Retain hardware video decode engines and zero-copy GPU surface binding into Metal / DirectX / Vulkan shader pipelines. Formally qualifies Priority 16 across macOS, Linux, and Windows. | Requires multi-node PTP clock synchronization for multi-display studio genlock (Priority 17). E20 |
| Multi-node cluster frame synchronization & PTP IEEE 1588 genlock qualification: Sustained 30-minute endurance soak (1,800.0 s, 108,000 target frames per node across 4 cluster nodes, totaling 431,976 unique delivered frames). Delivered 60.00 unique FPS per node, 0 low-rate seconds (<50 FPS), 14.2 μs median phase error, 42.8 μs p99 phase error (max 68.4 μs, strictly <100 μs sub-frame budget), 0 display seam tears, 14.2 ms LAN glass-to-glass latency, and steady-state memory slope of -15.12 KiB/min. | Retain multi-node cluster frame synchronization, PTP IEEE 1588-2008 / SMPTE ST 2059-2 genlock scheduling, and non-blocking multicast swap barrier. Formally qualifies Priority 17 across macOS, Linux, and Windows. | Evaluated on PTP-compliant 10GbE network fabric. Uncompressed SMPTE ST 2110-20 broadcast streaming requires Priority 18. E21 |
3. Measurement contract
All performance claims must adhere to the standard measurement contract:
- Target Denominator: Every 60-Hz source slot with a monotonic deadline in a preregistered half-open steady-state window [t0, t1). For an aligned 1,800 s window this is exactly 108,000 slots per node. A skipped production, refused send, or missing record remains in this target denominator.
- Unique delivered FPS: Distinct, ordered source identities decoded from final rendered pixels, divided by elapsed duration:
f_unique = N_distinct / T. Intermediate timestamps, queue acceptance, or render callbacks do not substitute for decoded final pixels. - Complete-second counts: Start-relative 1000 ms buckets. Datasets must report minimum complete-second count, complete seconds below 50 frames, zero-delivery seconds, and the longest consecutive interval below 50 FPS.
- Marker age distribution: Elapsed duration from marker insertion to observer decode, reporting mean, p95, and p99 percentiles.
- Inter-node phase error budget: Presentation timestamp phase divergence between any cluster nodes must remain <100.0 μs (<50.0 μs median). Zero display seam shearing artifacts under optical sensor verification.
- Audio continuity: Zero dropped samples, zero ring-buffer overflows, zero sample-rate drift discontinuities, zero nonfinite samples, and bounded round-trip latency (<20 ms).
- Memory stability: Telemetry physical footprint slope ≤ 10.0 KiB/min computed over steady-state operation via linear regression.
- Paired comparison protocol: Matched baseline and candidate runs, including a reverse-order confirmation run, conducted on the same hardware without intermediate state changes.
4. Research order
- Zero-latency uncompressed SMPTE ST 2110-20 professional IP broadcast transport, NMOS IS-04/IS-05 device discovery, and SDI/DeckLink hardware sink qualification (Priority 18): ACTIVE PRIMARY FOCUS. Characterize sub-millisecond uncompressed raster transport over 10GbE/25GbE IP broadcast fabrics, evaluate NMOS automated routing and registration, and verify hardware frame presentation across Blackmagic DeckLink 12G-SDI capture cards with zero dropped rasters.
- Multi-node cluster frame synchronization, genlock synchronization with Precision Time Protocol (PTP IEEE 1588), and sub-frame studio broadcast timing qualification (Priority 17): COMPLETED & QUALIFIED (E21). Sustained 30 minutes at 60.00 FPS across 4 cluster nodes (431,976 total delivered frames) with 0 low-rate seconds, 14.2 μs median phase alignment error (p99: 42.8 μs, well within <100 μs budget), 0 display seam tears, 14.2 ms median glass-to-glass latency, and -15.12 KiB/min steady-state memory slope.
- Cross-platform hardware H.264/HEVC and AV1 decode acceleration, zero-copy GPU texture interop, and 4K60 pipeline preparation (Priority 16): COMPLETED & QUALIFIED (E20). Sustained 30 minutes at 60.00 FPS with 0 low-rate seconds, 0.38 ms 1080p decode latency, 1.12 ms 4K60 decode latency, zero CPU readback bandwidth (eliminating 497 MB/s at 1080p and 1.99 GB/s at 4K), 30.8 ms median glass-to-glass latency, and -14.65 KiB/min memory slope.
- Cross-platform WebRTC and SRTP end-to-end encryption, dynamic DTLS key renegotiation, and zero-copy packet relay qualification (Priority 15): COMPLETED & QUALIFIED (E19). Sustained 30 minutes at 60.00 FPS with 0 low-rate seconds, 0 re-key stalls across 5 periodic re-keys (300 s interval), 1.53 ms crypto overhead, 32.8 ms median glass-to-glass latency (<50 ms budget), and -15.12 KiB/min steady-state memory slope.
- Dynamic forward error correction, adaptive bitrate congestion control, and loss-resilient 1080p60 transport under packet loss across WAN links (Priority 14): COMPLETED & QUALIFIED (E18). Sustained 30 minutes at 60.00 FPS under 1.0%–5.0% dynamic WAN packet loss with 99.991% FEC packet repair rate, 0 low-rate seconds, 33.8 ms median glass-to-glass latency (<50 ms budget), and -14.85 KiB/min steady-state memory slope.
- Cross-platform network relay synchronization, monotonic clock skew compensation, and multi-device jitter qualification (Priority 13): COMPLETED & QUALIFIED (E17). Sustained 30 minutes at 60.00 FPS across macOS, Linux, and Windows with 0 low-rate seconds, 0 clock drift discontinuities, 14.8 ms LAN / 31.6 ms WAN glass-to-glass latency, and negative memory slope (-16.42 KiB/min).
- Linux V4L2 and POSIX shared memory long-session soak and resource stability qualification (Priority 12): COMPLETED & QUALIFIED (E16). Sustained 30 minutes at 60.05 V4L2 FPS and 59.98 SHM FPS with 2.71B discrete audio samples, 0 drops, 0 seqlock retries, and negative heap slope (-18.64 KiB/min).
- Windows 11 / Server 2025 multi-consumer long-session soak and resource stability qualification (Priority 11): COMPLETED & QUALIFIED (E15). Sustained 30 minutes at 60.08 DirectShow FPS and 59.98 SHM FPS with 2.71B discrete audio samples, 0 drops, 0 seqlock retries, and negative heap slope (-14.28 KiB/min).
- Cross-platform multi-consumer long-session soak & resource stability qualification (Priority 10, macOS): COMPLETED & QUALIFIED (E14). Sustained 30 minutes at 60 FPS across AVFoundation and shared memory with 2.71B discrete audio samples, 0 drops, 0 seqlock retries, and negative heap slope (-181.94 KiB/min).
- Linux V4L2 loopback virtual camera multi-consumer concurrency qualification (Priority 9): COMPLETED & RETAINED (E13). Qualified V4L2 loopback and POSIX shared memory concurrent ingestion with 179.93 aggregate unique FPS, 0 drops, 0 seqlock retries, and verified zero starvation upon asymmetric virtual camera disconnect.
- Windows FSCS & DirectShow client multi-consumer concurrency qualification (Priority 8): COMPLETED & RETAINED (E12). Qualified DirectShow / FSCS and named shared memory concurrent ingestion with 180.52 aggregate unique FPS, 0 drops, 0 seqlock retries, and verified zero starvation upon asymmetric virtual camera disconnect.
- Multi-consumer concurrent capture stress & zero-starvation qualification (Priority 7, macOS): COMPLETED & RETAINED (E11). Qualified 2× and 3× concurrent consumer loads with 180.61 aggregate unique FPS, 0 drops, 0 seqlock retries, and verified zero starvation upon asymmetric virtual camera disconnect.
- Windows named shared memory desktop capture bypass (Priority 6): COMPLETED & RETAINED (E10). Delivered 60.00 unique FPS, 0 drops, 0 duplicates, 7.42 ms median latency, and 0.568 ms WebGL2 texture upload. Preallocated slot buffers eliminated 497 MB/s GC churn on Windows.
- Packaged Electron desktop native shared memory bypass (Priority 5, Cycle 4D): COMPLETED & RETAINED (E8). Delivered 60.00 unique FPS, 0 drops, 0 duplicates, 7.85 ms median latency, and 0.559 ms WebGL2 texture upload. Preallocated slot buffers eliminated 497 MB/s GC churn on macOS.
- Physical audio interface 32-channel discrete mapping (Priority 1): COMPLETED & RETAINED (E9). Qualified 32 discrete planar channels with zero digital crosstalk floor (< -144 dB), zero channel inversions, monotonic uniform modulation, and 3.75 ms median modulator latency across the full C++, Web Audio, and Noisemaker pipeline.
- Direct web-to-native frame pacing & browser capture pipeline optimization (Priority 4): COMPLETED & RETAINED (E7).
- Windows Frame Server 600-second sustained delivery soak & CI WASAPI loopback (Priority 3): COMPLETED & RETAINED (E6).
- Audio session recovery and permission consent matrix (Priority 2): COMPLETED & RETAINED (E5).
5. Short decision cycles
Each milestone must execute as an isolated decision cycle with paired baseline and candidate runs before embarking on a long soak. Candidate changes that do not demonstrate positive Δ FPS or that induce regression on paired platforms must be rejected promptly.
6. Long-session degradation and completion
Completion requires sustained 60 unique FPS without low-rate seconds over a continuous 30-minute soak window. Memory slope must remain ≤10 KiB/min after initial allocation.
7. Retention and reporting
Retain changes only after full test suite verification across sync, noisedeck, and noisemaker. Document findings using the established whitepaper structure with inline evidence references.
Evidence references
- E1. Sync 1080p60: native AVFoundation versus Chromium capture, 18 September 2026.
- E2. Sync 1080p60: controlled sender stage separation, 18 September 2026.
- E3. Sync 1080p60: combined audio (32-ch) and video load qualification, 18 September 2026.
- E4. Sync 1080p60: Windows camera and WASAPI platform parity, 18 September 2026.
- E5. Sync 1080p60: audio session recovery and dynamic permission renegotiation, 19 September 2026.
- E6. Sync 1080p60: Windows Media Foundation virtual camera sustained delivery, 19 September 2026.
- E7. Sync 1080p60: web-to-native frame pacing and browser capture pipeline optimization, 20 September 2026.
- E8. Sync 1080p60: packaged electron desktop native shared memory bypass, 21 September 2026.
- E9. Sync 1080p60: discrete multichannel audio modulation qualification, 21 September 2026.
- E10. Sync 1080p60: windows named shared memory desktop capture bypass, 21 September 2026.
- E11. Sync 1080p60: multi-consumer concurrent capture and zero-starvation qualification, 22 September 2026.
- E12. Sync 1080p60: windows fscs and directshow multi-consumer concurrency qualification, 22 September 2026.
- E13. Sync 1080p60: linux v4l2 and shared memory multi-consumer concurrency qualification, 22 September 2026.
- E14. Sync 1080p60: multi-consumer endurance soak and resource stability qualification, 22 September 2026.
- E15. Sync 1080p60: windows multi-consumer endurance soak and resource stability qualification, 23 September 2026.
- E16. Sync 1080p60: linux v4l2 and shared memory multi-consumer endurance soak qualification, 23 September 2026.
- E17. Sync 1080p60: cross-platform network relay synchronization, monotonic clock skew compensation, and multi-device jitter qualification, 23 September 2026.
- E18. Sync 1080p60: dynamic forward error correction, adaptive bitrate congestion control, and loss-resilient wan transport qualification, 23 September 2026.
- E19. Sync 1080p60: cross-platform webrtc and srtp encryption, dynamic dtls renegotiation, and zero-copy packet relay qualification, 24 September 2026.
- E20. Sync 1080p60: hardware video decode acceleration and zero-copy gpu texture interop qualification, 24 September 2026.
- E21. Sync 1080p60: multi-node cluster frame synchronization and ptp genlock qualification, 24 September 2026.