Kimi k3.1-pro 1.68×
Harness: Claude Code · switches: GS_OPT_FUSED_ADAM=1 GS_OPT_ASYNC_LOG=1 GS_OPT_MASK_STATS=1 GS_OPT_KEEP_CACHE=1 GS_OPT_SKIP_UNUSED_DEPTH=1 GS_OPT_BLACK_BACKGROUND=1 GS_OPT_FUSED_GRAD_ALLOC=1 GS_OPT_PARALLEL_ADAM=1 GS_OPT_PACKED_SAMPLE_STATE=1 GS_OPT_PACKED_PIXEL_STATE=1 GS_OPT_FAST_EXP=1 GS_OPT_SHARED_COLOR=1 GS_OPT_BROADCAST_STATE=1 GS_OPT_VECTOR_PRELOAD=1 GS_OPT_DUPLICATE_HOIST=1 GS_OPT_CONTRIBUTOR_PRELOAD=1 GS_OPT_SINGLE_ADAM_KERNEL=1
- Judged
- 1.68×
- Tier
- N1
- Self-best
- 1.78×
- Rounds
- 32
- Hours
- 10.0
- API cost
- $39.6
- Input tokens · 99.0% cached
- 161 M
- Output tokens
- 0.5 M
- Requests
- 1,173
§ 02Key levers
- Smaller tiles + rewritten binning
- ✗ tile size not in the log; binning only hoisted loop invariants (184.3 → 179.4 s)
- Bypass autograd, activations folded into raster kernel
- ✗ activation fusion not in the log
- Lazy Adam (update only visible Gaussians)
- ✗ dense; custom single-kernel Adam only in round 29 (177.8 → 172.5 s)
- Fused loss / SSIM
- tried, reverted: SSIM scalar backward 0.8 s slower, three revisions crashed within 3000 steps; L1 backward indistinguishable across two timings
- Other main levers
- depth skipped (247.5 → 237.8 → 231.3 s), black-background specialization, sample state and pixel state packed into float4, shared forward color, cooperative prefetch of backward state,
__expf
§ ARaw trace
Raw work log37 sections
0.0 hRound 1 — reference profile and baseline
- Started: 2026-11-07 05:32 UTC (container clock). - GPU queue PID: 2052; logs:/tmp/r1/profile.log,/tmp/r1/time.log; queue log:/tmp/r1/queue.log. - Commands: judgeprofile(steps 7000–7019) followed by judgetimeon the unchanged reference tree with the empty switch file. - Frozen reference timing: 306.735 s, startup spread 0.0119. Hardware: Hopper (Hopper), one GPU. - Profile findings, timing results, and conclusion: pending. ### Reference measurements - Referencetime:/tmp/r1/time/time.json; 307.525 s, speedup vs frozen reference 0.9974×; windows 85.151 / 112.586 / 109.788 s. This confirms the frozen 306.735 s baseline is reproducible. - Profile:/tmp/r1/profile/timing_profile.profile.txt, steps 7000–7019 (one densification step included, so index/gather entries are densification-heavy). - Top GPU shares: rasterizer backward 33.00% (65.942 ms/20 steps), of whichPerGaussianRenderCUDAis 27.34%; rasterizer forward 26.28% (50.392 ms), of whichrenderCUDAis 16.61%; Gaussian Adam 25.71% (49.298 ms over 19 steps).nonzerohas 43.503 ms CPU total over 80 calls and is associated with dynamic indexing; forward preprocessing and key duplication are about 5% each. - Hotspot selected: optimizer launch/memory traffic (configuration/backend class). Six one-tensor foreach groups each run the full Adam chain. ### Fused Adam experiment - Change:GS_OPT_FUSED_ADAM=1selectstorch.optim.Adam(..., fused=True)for both Gaussian and exposure Adam; default off. Float32 parameters/state and all Adam hyperparameters/schedules are unchanged. Numerics tier candidate: N1 (kernel/reduction rounding may differ). - Candidate GPU queue PID: 2436; logs/tmp/r1/fused/time.logthen/tmp/r1/fused/quick.log. - Candidate timing and exact-item result: PASS./tmp/r1/fused/time/time.json: 269.166 s, 1.1396× vs frozen reference; windows 78.473 / 97.207 / 93.486 s./tmp/r1/fused/quick/check.json: PASS (exact_items_pass). Commit0cd3753. - Round ended: 2026-11-07 05:45 UTC. Full check queued before round 2 to validate N1 endpoints.
0.0 hFull check after round 1
- Command: judgecheckon commit0cd3753withGS_OPT_FUSED_ADAM=1. - Output:/tmp/check-r1; log/tmp/check-r1.log; detached shell launcher PID 3312, actual queue PID 3313 (setsidforked). - Result: PASS, tier N1, speedup 1.1539×; candidate 265.832 s, windows 75.259 / 97.524 / 93.049 s. Exact items passed over quick and full seed-1 trajectory. Endpoint biases: PSNR +0.03483 (0.894σ), SSIM +0.0003847 (1.674σ), LPIPS −0.0006577 (−1.970σ), log count +0.004736 (0.871σ); all within 3σ.
0.5 hRound 2 — host synchronization and cache overhead
- Started: 2026-11-07 05:57 UTC. - Base: full-check-passing commit0cd3753(fused Adam). - Profile:/tmp/r2/profile/timing_profile.profile.txt(queue PID 3918). Fused Adam lowered Gaussian optimizer GPU time from 49.298 to 24.689 ms/20 steps; it is now 14.65%. Rasterizer backward 37.54%, forward 30.07%.nonzerostill has 43.608 ms CPU total/20 steps. Total profiled GPU time fell from 191.776 to 168.507 ms/20 steps. - Timing/quick queue: actual PID 4075;/tmp/r2/time.log, then/tmp/r2/quick.log. - Experiment worktree:/tmp/gs-experiments, detached at0cd3753; config/tmp/gs-switches-experiment.jsonkeeps fused Adam and enables three independent switches. - Changes prepared (host/launch class):GS_OPT_ASYNC_LOGbatches ten detached loss scalars into one transfer, preserving the exact EMA values;GS_OPT_MASK_STATSreplaces per-iterationnonzeroand indexed densification statistics with boolean-masked full tensors;GS_OPT_KEEP_CACHEavoidstorch.cuda.empty_cache()after densification (peak memory is under 9 GiB on a 141 GiB GPU). All default off. - Timing and quick-check results:/tmp/r2/time/time.json247.545 s, 1.2391× vs frozen reference; windows 68.004 / 91.104 / 88.436 s./tmp/r2/quick/check.json: PASS (exact_items_pass). Peak reserved memory rose to 24.65 GiB when cache drains were disabled, still far below capacity. Promoted to/submissionand committed asbf40da6; production switch file enables all three host/cache switches plus fused Adam. - Round ended: 2026-11-07 06:08 UTC. The 21.621 s improvement over the fused-Adam timing is the combined host/cache-class gain; individual attribution was not measured.
0.7 hRound 3 — backward rasterizer block size
- Started: 2026-11-07 06:08 UTC; base commitbf40da6, measured 247.545 s. - Current-best profile/tmp/r3/profile/timing_profile.profile.txt: backward rasterizer 37.87% (65.896 ms/20), forward 30.37%, fused Gaussian Adam 14.08%.PerGaussianRenderCUDAalone is 31.39%. Host changes reduced total CPU time from 187.907 to 162.829 ms and removed the 20 per-window logging scalar reads; the 60 remainingnonzerocalls belong to the densification step. - Change:GS_OPT_BACKWARD_BLOCK_256=1launches the independent backward bucket warps as 256-thread blocks (8 warps) instead of 32-thread blocks (1 warp). Default off; no arithmetic source changes. Tier N1 because atomic scheduling may differ. - Timing/quick queue and results: actual PID 5557./tmp/r3/time/time.json: 247.150 s, 1.2411×, windows 67.901 / 90.900 / 88.349 s;/tmp/r3/quick/check.json: PASS. This is only 0.395 s (0.16%) faster than the 247.545 s base, within noise and below the measurement acceptance threshold. Rejected / not promoted. Experiment preserved as detached commita1bb8b2; worktree reset toopt. - Round ended: 2026-11-07 06:20 UTC. Conclusion: block-count reduction alone does not materially improve this backward kernel on the Hopper.
0.8 hRound 4 — unused inverse-depth backward work
- Started: 2026-11-07 06:20 UTC; base remainsbf40da6(247.545 s). - Profile/tmp/r4/profile/timing_profile.profile.txt: backward 37.96%, forward 30.42%, fused Adam 13.79%;PerGaussianRenderCUDA31.45% (52.475 ms/20). - Change:GS_OPT_SKIP_UNUSED_DEPTH=1callsset_materialize_grads(False). When inverse depth is unused, itsNonegradient selects aHAS_DEPTH=falsetemplate instantiation that removes depth reciprocals, state loads, two warp shuffles per pixel-loop iteration, depth gradient arithmetic, and atomics. Covariance mean gradients also omit the null depth term. The depth-using instantiation remains available. Default off; tier N0 mathematically (unused zero-gradient terms only), with quick/full gates deciding. - Validation order: judge quick/build first, then judge time if quick passes. Actual queue PID 6673. - Results:/tmp/r4/quick/check.jsonPASS;/tmp/r4/time/time.json237.818 s, 1.2898×, windows 65.109 / 87.642 / 85.066 s. This is 9.727 s (3.93%) faster than the previous 247.545 s timing. Promoted to/submissionas commit9071cb6; production switchGS_OPT_SKIP_UNUSED_DEPTH=1enabled. - Round ended: 2026-11-07 06:36 UTC.
1.1 hRound 5 — unused inverse-depth forward work
- Started: 2026-11-07 06:36 UTC; base commit9071cb6, measured 237.818 s. - Profile/tmp/r5/profile/timing_profile.profile.txt: backward rasterizer 60.631 ms/20 steps, including no-depthPerGaussianRenderCUDA<3u, false>47.295 ms (29.07%); forward 50.621 ms (31.12%), includingrenderCUDA31.910 ms (19.62%); fused Gaussian Adam 24.412 ms (15.01%). The backward depth specialization was visible in the profile, while forward depth work remained. - Change: the existingGS_OPT_SKIP_UNUSED_DEPTH=1path now passes an explicit depth-needed flag from training through the renderer. TheHAS_DEPTH=falseforward instantiation removes inverse-depth reciprocals/accumulation, per-warp depth-state stores, and the depth-image write; the unused depth output allocation and D2D copy are also skipped. Color arithmetic, compositing, camera order, and depth-using behavior are unchanged. Tier N0 mathematically. - Validation:/tmp/r5/forward-quick/check.jsonPASS (exact_items_pass);/tmp/r5/forward-time/time.json231.297 s, 1.3262× vs frozen reference, windows 63.250 / 85.253 / 82.794 s. This is 6.521 s (2.74%) faster than Round 4's 237.818 s timing. - Promoted the exact tested diff to/submissionas commit683133c; production switches are unchanged. - Full judge result:/tmp/r5/check/check.jsonPASS, tier N1, 1.3264×; candidate 231.253 s, windows 63.573 / 85.159 / 82.521 s. Exact items passed. Endpoint biases: PSNR −0.047326 (−1.215σ), SSIM +0.00007324 (+0.319σ), LPIPS −0.00011768 (−0.352σ), log count +0.0012617 (+0.232σ); all within 3σ. Log/tmp/r5/check.log. - Round ended: 2026-11-07 06:58 UTC.
1.8 hRound 6 — black-background backward specialization
- Started: 2026-11-07 07:10 UTC; base commit683133c, full-check PASS N1 at 231.253 s / 1.3264×. - Current-best profile/tmp/r6/profile/timing_profile.profile.txt: backward rasterizer 57.951 ms/20 steps (36.81%), withPerGaussianRenderCUDA<3u, false>47.205 ms (29.98%); forward 46.186 ms (29.34%), with no-depthrenderCUDA<3u, false>27.715 ms (17.60%), confirming Round 5's kernel gain; fused Gaussian Adam 23.879 ms (15.17%). - Change under test:GS_OPT_BLACK_BACKGROUND=1, gated also by the recipe's actual fixed black background, selects a backward template that removes the zero background dot product, its gradient term, and the then-unused final-transmittance load and warp shuffle. Nonzero-background and depth-using instantiations remain unchanged. Default off; tier N0 mathematically. - Validation:/tmp/r6/quick/check.jsonPASS (exact_items_pass);/tmp/r6/time/time.json225.626 s, 1.3595× vs frozen reference, windows 61.710 / 83.032 / 80.883 s. This is 5.671 s (2.45%) faster than Round 5's 231.297 s timing. - Promoted the tested diff as commit5a6b636and enabledGS_OPT_BLACK_BACKGROUND=1in production./tmp/r6/n1/check.json: PASS, tier N1; endpoint biases PSNR +0.023207 (+0.596σ), SSIM −0.00008637 (−0.376σ), LPIPS −0.00016779 (−0.503σ), log count +0.0042735 (+0.786σ). Log/tmp/r6/n1.log. - Round ended: 2026-11-07 07:25 UTC.
2.1 hRound 7 — coalesced backward gradient initialization
- Started: 2026-11-07 07:32 UTC; base commit5a6b636, measured 225.626 s / 1.3595× and seed-1 N1 PASS. - Current-best profile/tmp/r7/profile/timing_profile.profile.txt: black/no-depthPerGaussianRenderCUDA<3u, false, true>42.931 ms/20 steps (27.86%), down from 47.205 ms; forward no-depthrenderCUDA27.943 ms (18.13%); fused Gaussian Adam 24.335 ms (15.79%).aten::fill_accounts for 3.181 ms andaten::zero_2.943 ms per 20 steps. - Change under test:GS_OPT_FUSED_GRAD_ALLOC=1allocates one float32 gradient storage block and one zero-fill per backward, returning contiguous views with the original shapes. Float4-aligned views retain 16-byte alignment. The unused no-depth inverse-depth gradient allocation is empty and passed as null. Default off; tier N0 mathematically. - Validation:/tmp/r7/quick/check.jsonPASS (exact_items_pass);/tmp/r7/time/time.json224.615 s, 1.3656× vs frozen reference, windows 61.469 / 82.645 / 80.502 s. This is 1.011 s (0.45%) faster than Round 6, with improvement in every window. Peak reserved memory 34.12 GiB, far below capacity. - Promoted as commit429eb08and enabledGS_OPT_FUSED_GRAD_ALLOC=1in production. - Full judge result/tmp/r7/check/check.json: PASS, tier N1, 1.3635×; candidate 224.968 s, windows 61.521 / 82.855 / 80.593 s. Exact items passed. Endpoint biases: PSNR −0.023630 (−0.607σ), SSIM −0.00009038 (−0.393σ), LPIPS −0.00023119 (−0.692σ), log count +0.0034850 (+0.641σ). Log/tmp/r7/check.log. - Round ended: 2026-11-07 07:45 UTC.
2.5 hRound 8 — overlap independent fused-Adam groups
- Started: 2026-11-07 07:56 UTC; base commit429eb08, full-check PASS N1 at 224.968 s / 1.3635×. - Current-best profile/tmp/r8/profile/timing_profile.profile.txt: backward 53.711 ms/20 steps (35.18%), forward 46.176 ms (30.25%), fused Adam 23.596 ms/19 steps (15.46%). Gradient coalescing reduced zero/fill calls from 518/374 to 318/174 per profile window. The judge trace shows six tiny state-update kernels and several short, bandwidth-underutilized non-f_restAdam kernels per step. - Change under test:GS_OPT_PARALLEL_ADAM=1selects an Adam subclass that calls PyTorch's same fused functional update for every parameter group. The five smaller independent groups launch on separate CUDA streams beforef_rest; the training stream waits for every side stream before returning from the one optimizerstep(). All groups, hyperparameters, float32 state, schedules, and judge hooks are preserved. Default off; tier N0 per-tensor arithmetic. - Validation:/tmp/r8/quick/check.jsonPASS (exact_items_pass);/tmp/r8/time/time.json219.477 s, 1.3976× vs frozen reference, windows 59.487 / 81.198 / 78.792 s. This is 5.138 s (2.29%) faster than Round 7's timing. - Promoted as commit5b1f0f6and enabledGS_OPT_PARALLEL_ADAM=1in production./tmp/r8/n1/check.json: PASS, tier N1; endpoint biases PSNR −0.012843 (−0.330σ), SSIM −0.00000156 (−0.007σ), LPIPS −0.00063141 (−1.891σ), log count −0.0017083 (−0.314σ). Log/tmp/r8/n1.log. - Round ended: 2026-11-07 08:06 UTC.
2.8 hRound 9 — scalar-gradient fused SSIM backward
- Started: 2026-11-07 08:13 UTC; base commit5b1f0f6, measured 219.477 s / 1.3976× and seed-1 N1 PASS. - Current-best profile/tmp/r9/profile/timing_profile.profile.txt: backward rasterizer 53.754 ms/20 steps (33.29%); forward 46.443 ms (28.76%). Parallel Adam's overlapped kernels account for longer per-kernel durations in the profiler, but judge timing improved by 5.138 s. SSIM map forward is 1.945 ms/20, backward 1.282 ms/20, with additional mean/reduction, division, expansion, and contiguous-copy work. - Change under test:GS_OPT_SSIM_SCALAR=1uses a scalar-output autograd function whose forward still calls the samessim_map.mean(). Its backward divides the scalar upstream gradient by the map element count and broadcasts it directly into the existing CUDA kernel's shared tile, preserving zeros outside image boundaries and avoiding a materialized full-map mean gradient. Default off; tier N1 for reordered scalar/backward arithmetic. - Validation:/tmp/r9/quick/check.jsonPASS (exact_items_pass), but/tmp/r9/time/time.jsonregressed to 220.311 s / 1.3923×, windows 59.584 / 81.547 / 79.181 s, 0.834 s slower than the 219.477 s baseline. Rejected / not promoted. Experiment preserved as detached commit6a12bbf; experiment worktree reset toopt. - Round ended: 2026-11-07 08:27 UTC. Production remains commit5b1f0f6with parallel Adam and seed-1 N1 PASS.
3.1 hRound 10 — fused L1 backward
- Started: 2026-11-07 08:28 UTC; base commit5b1f0f6, measured 219.477 s / 1.3976× and seed-1 N1 PASS. - Current-best profile/tmp/r10/profile/timing_profile.profile.txt: rasterizer backward 56.117 ms/20 steps, including black/no-depthPerGaussianRenderCUDA42.973 ms (26.34%); forward 46.827 ms, includingrenderCUDA28.053 ms (17.19%). Parallel fused Adam remains substantial in the overlapping profile. L1'sExpandBackward0reduction is 0.959 ms/20, with additional division and elementwise operations in the loss backward. - Change under test:GS_OPT_FUSED_L1=1wraps the unchangedabs(output - gt).mean()forward in an autograd function whose CUDA backward computes the upstream scalar divided by the element count and applies the sign in one elementwise kernel. It avoids the separate scalar division, mean expansion/reduction, and sign-gradient kernels; the ground-truth gradient is returned when required. Default off; tier N1 for backward arithmetic implementation. - Validation queue: launcher PID 17303, queue log/tmp/r10/queue.log; judge build/tmp/r10/build.log, then quick exact items/tmp/r10/quick.log, then full timing/tmp/r10/time.log./tmp/r10/quick/check.json: PASS (exact_items_pass)./tmp/r10/time/time.json: 218.802 s / 1.4019×, windows 59.472 / 81.016 / 78.315 s, initially 0.675 s faster than the production timing. - Repeat and decision: because the apparent gain was below the direct-acceptance threshold, judge timing was repeated with the identical tree/config (launcher PID 18514, log/tmp/r10/time-repeat.log)./tmp/r10/time-repeat/time.json: 219.906 s / 1.3948×, windows 59.428 / 81.443 / 79.035 s. The two candidate timings differ by 1.104 s and average only 0.123 s faster than the single 219.477 s production measurement, so the improvement is unresolved. Rejected / not promoted. Experiment preserved as detached commitc4f6136; experiment worktree reset toopt. - Round ended: 2026-11-07 08:51 UTC. Production remains commit5b1f0f6at 219.477 s / 1.3976× with seed-1 N1 PASS.
3.5 hRound 11 — packed rasterizer sample-state layout
- Started: 2026-11-07 08:52 UTC; base commit5b1f0f6, measured 219.477 s / 1.3976× and seed-1 N1 PASS. - Current-best profile/tmp/r11/profile/timing_profile.profile.txt(launcher PID 18762): backward rasterizer 56.293 ms/20 steps, with black/no-depthPerGaussianRenderCUDA43.013 ms (26.79%); forward 46.422 ms, with no-depthrenderCUDA27.724 ms (17.27%). These remain the two dominant individual kernels. - Change under test:GS_OPT_PACKED_SAMPLE_STATE=1reinterprets the existing contiguous transmittance-plus-three-color sample storage as alignedfloat4values. Each forward bucket boundary uses one vector store instead of four scalar stores; each backward pixel-state load uses one vector load instead of four scalar loads. Allocation size, all sampled values, color arithmetic, blending, and gradient arithmetic are unchanged. Default off; tier N0 memory-layout change. - Validation queue: launcher PID 19153, queue log/tmp/r11/queue.log; judge build/tmp/r11/build.log, quick/tmp/r11/quick.log, timing/tmp/r11/time.log./tmp/r11/quick/check.json: PASS (exact_items_pass)./tmp/r11/time/time.json: 212.733 s / 1.4419×, windows 57.774 / 78.642 / 76.317 s. This is 6.744 s (3.07%) faster than Round 8's 219.477 s baseline, with every window improving by about 3%. - Promoted the tested diff to/submissionas commit74fad53and enabledGS_OPT_PACKED_SAMPLE_STATE=1in production. Full all-gates check queued separately at/tmp/r11/check. - Round ended: 2026-11-07 09:12 UTC.
3.5 hFull check after round 11
- Command: judgecheckon production commit74fad53with all accepted switches including packed sample state. Launcher PID 20413; log/tmp/r11/check.log. - Result/tmp/r11/check/check.json: PASS, tier N1, speedup 1.4379×; candidate 213.315 s, windows 57.969 / 78.815 / 76.531 s. Quick and full-trajectory exact items passed. - Endpoint biases: PSNR +0.022606 (+0.581σ), SSIM +0.00036489 (+1.588σ), LPIPS −0.00034059 (−1.020σ), log count +0.0050491 (+0.928σ); all within 3σ.
4.0 hRound 12 — packed per-pixel color and gradient state
- Started: 2026-11-07 09:21 UTC; base commit74fad53, full-check PASS N1 at 213.315 s / 1.4379× and standalone timing 212.733 s / 1.4419×. - Current-best profile/tmp/r12/profile/timing_profile.profile.txt(launcher PID 21411): packed-sample backwardPerGaussianRenderCUDA<3u, false, true, true>is 38.723 ms/20 steps (24.74%), down from 43.013 ms; packed-sample forwardrenderCUDAis 26.948 ms, down from 27.724 ms. Total rasterizer backward is 51.884 ms/20. The backward still issues three scalar loads for planar forward colors and three for planar color gradients at every bucket/pixel state. - Change under test:GS_OPT_PACKED_PIXEL_STATE=1packs planar forward colors once after forward rendering and planar color gradients once before backward rendering into internal alignedfloat4buffers. Backward replaces each group of three scalar loads with one vector load. Public image/gradient layouts and every arithmetic expression remain unchanged; the original D2D copy and planar backward remain the default. Default off; tier N0 memory-layout change. - Validation queue: launcher PID 21765, queue log/tmp/r12/queue.log; build/tmp/r12/build.log, quick/tmp/r12/quick.log, timing/tmp/r12/time.log./tmp/r12/quick/check.json: PASS (exact_items_pass)./tmp/r12/time/time.json: 205.121 s / 1.4954×, windows 55.597 / 75.894 / 73.629 s. This is 7.612 s (3.58%) faster than Round 11's standalone timing, with every window improving. - Promoted the tested diff to/submissionas commitfbdcf2eand enabledGS_OPT_PACKED_PIXEL_STATE=1./tmp/r12/n1/check.json: PASS, tier N1; endpoint biases PSNR +0.016945 (+0.435σ), SSIM +0.00004443 (+0.193σ), LPIPS −0.00019686 (−0.590σ), log count +0.0054675 (+1.005σ). Log/tmp/r12/n1.log, launcher PID 22983. - Round ended: 2026-11-07 09:39 UTC.
4.3 hRound 13 — remove unread and overwritten initialization
- Started: 2026-11-07 09:44 UTC; base commitfbdcf2e, measured 205.121 s / 1.4954× with quick and seed-1 N1 PASS. - Current-best profile/tmp/r13/profile/timing_profile.profile.txt(launcher PID 23709): packed-sample/packed-pixel backwardPerGaussianRenderCUDAis 33.541 ms/20 steps (21.99%), down from 38.723 ms; forwardrenderCUDAis 26.890 ms.aten::fill_is 2.888 ms/20 andaten::zero_2.652 ms/20, across 318 and 174 calls respectively. - Change under test:GS_OPT_EMPTY_INIT=1uses an unread empty autograd dummy instead ofzeros_like(...) + 0, and allocates the color image, active inverse-depth image, and radii withemptybecause preprocessing/rendering overwrites every element whenP > 0. Zero initialization is retained for atomic gradient storage and for image outputs in the explicitP == 0case. Default off; tier N0 removal of unread/overwritten writes. - Validation queue: launcher PID 23961, queue log/tmp/r13/queue.log; build/tmp/r13/build.log, quick/tmp/r13/quick.log, timing/tmp/r13/time.log./tmp/r13/quick/check.json: PASS (exact_items_pass)./tmp/r13/time/time.json: 202.748 s / 1.5129×, windows 54.717 / 75.095 / 72.937 s. This is 2.373 s (1.16%) faster than Round 12, with every window improving. - Promoted the tested diff to/submissionas commit8c0ca6dand enabledGS_OPT_EMPTY_INIT=1. Full all-gates check queued at/tmp/r13/check. - Round ended: 2026-11-07 09:58 UTC.
4.3 hFull check after round 13 — rejection and revert
- Full judge result/tmp/r13/check/check.json(launcher PID 25209, log/tmp/r13/check.log): INCORRECT at the statistical gate. Timing was 203.333 s / 1.5085×, and exact items passed, but LPIPS bias was −0.00103225 (−3.092σ), beyond the 3σ bound. PSNR, SSIM, and log count were within bounds (+0.233σ, +0.727σ, +0.179σ respectively). - Per the gate rule, the change was rejected rather than retried or waived. Production reverted the source change as commitae43a24;GS_OPT_EMPTY_INITwas removed from the switch file. The reverted source is identical to the packed-pixel version validated at/tmp/r12/n1/check.json(parent commitfbdcf2e). Rejected experiment remains available as detached commitea7d027.
4.8 hRound 14 — corrected scalar-gradient SSIM backward
- Started: 2026-11-07 10:11 UTC; base commitae43a24(source identical tofbdcf2e), measured 205.121 s / 1.4954× with seed-1 N1 PASS. - Current-best profile/tmp/r14/profile/timing_profile.profile.txt(launcher PID 26256): packed backward 33.542 ms/20 steps, forwardrenderCUDA27.093 ms. SSIM forward/backward kernels are 1.590/1.084 ms, while mean-relatedExpandBackward0is 0.956 ms/20 andDivBackward0has 2.302 ms CUDA total. - Change under test:GS_OPT_SSIM_SCALAR=1restored the scalar-output autograd experiment, initially computing the upstream scalar divided by map element count once per CUDA block and broadcasting that shared value instead of rereading device memory for every shared element. It removed the separate scalar division and materialized full-map gradient; the fully overwritten SSIM image gradient initially usedempty_like. Forward remained exactlyssim_map.mean(). Default off; intended tier N1. - Validation and rejection:/tmp/r14/quick/check.jsonERROR at step 1,799 with runaway densification and CUDA OOM (14.96 GiB allocation attempted). Restoringzeros_likedid not fix the path:/tmp/r14/quick-zeros/check.jsonERROR at step 1,636 with illegal memory access. A final isolation restored the original PyTorch scalarupstreamdivision while retaining only the value-broadcast helper;/tmp/r14/quick-upstream/check.jsonagain ERROR at step 1,799 with OOM. Thus neither output initialization nor direct scalar-pointer/division placement was sufficient. There was no valid timing. The experiment was archived as detached commit3f372c8, rejected, and reset to production; the switch was removed from the experiment config. - Round ended: 2026-11-07 10:39 UTC. Production remained unchanged atae43a24.
5.2 hRound 15 — pack contributor counts with pixel gradients
- Started: 2026-11-07 10:39 UTC; base commitae43a24(source identical tofbdcf2e), measured 205.121 s / 1.4954× with seed-1 N1 PASS. - Current-best profile/tmp/r14/profile/timing_profile.profile.txt: packed backwardPerGaussianRenderCUDAremains the largest individual kernel at 33.542 ms/20 steps (22.18%); forwardrenderCUDAis 27.093 ms (17.92%). In the backward, every bucket/pixel state still loadsn_contribseparately after its packed color-gradient load. - Change under test:GS_OPT_PACKED_CONTRIB=1stores the exactuint32_tcontributor-count bits in the unused fourth component of each packed pixel gradient. Backward recovers the count with a bit cast from the samefloat4load, eliminating the separaten_contribload. Public layouts, counts, culling, and all floating-point arithmetic are unchanged. Default off; tier N0 memory-layout change. - Validation queue: launcher PID 29118, queue log/tmp/r15/queue.log; build/tmp/r15/build.log, quick/tmp/r15/quick.log, timing/tmp/r15/time.log./tmp/r15/quick/check.json: PASS (exact_items_pass)./tmp/r15/time/time.json: 205.835 s / 1.4902×, windows 55.592 / 76.208 / 74.035 s. This was 0.714 s slower than the 205.121 s production timing and no window improved, so the change was rejected / not promoted without another run. Experiment archived as detached commit9d1d85b; worktree and experiment switches reset to production. - Round ended: 2026-11-07 10:52 UTC. Production remainsae43a24at 205.121 s / 1.4954× with quick and seed-1 N1 PASS.
5.2 hFull check on current production after round 15
- Result /tmp/r15/check-production/check.json: PASS, tier N1, speedup 1.5054×; candidate 203.752 s, windows 55.178 / 75.392 / 73.182 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR +0.013462 (+0.346σ), SSIM −0.00006199 (−0.270σ), LPIPS −0.00031809 (−0.953σ), log count −0.0032874 (−0.605σ); all within 3σ. Completed 2026-11-07 11:00:48 UTC.5.4 hRound 16 — Gaussian falloff exponential
- Started (source preparation while the full check holds the GPU): 2026-11-07 10:55 UTC; base commitae43a24, measured 205.121 s / 1.4954× with seed-1 N1 PASS. - Current-best profile/tmp/r14/profile/timing_profile.profile.txt(identical production source): packed backward 33.542 ms/20 steps, forwardrenderCUDA27.093 ms. Both dominant loops evaluateexp(power)for every candidate Gaussian/pixel pair. - Change prepared:GS_OPT_FAST_EXP=1adds a setup-time CUDA define that maps only those two Gaussian falloff evaluations to CUDA__expf; all other arithmetic, alpha thresholds, culling, compositing, and gradients retain their existing expressions. Default off; candidate tier N2 for the approximation, accepted only if exact items and N1 pass. - Validation queue: launcher PID 31028, queue log/tmp/r16/queue.log; build/tmp/r16/build.log(with the experiment config), quick/tmp/r16/quick.log, timing/tmp/r16/time.log./tmp/r16/quick/check.json: PASS (exact_items_pass)./tmp/r16/time/time.json: 200.790 s / 1.5276×, windows 54.555 / 74.240 / 71.995 s. Every window improved over both the 205.121 s standalone production timing and the 203.752 s full-check timing; the standalone gain is 4.331 s (2.11%). - Full judge result/tmp/r16/check/check.json(PID 31817, log/tmp/r16/check.log): PASS, tier N1, speedup 1.5207×; candidate 201.702 s, windows 54.810 / 74.601 / 72.291 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR +0.0016555 (+0.043σ), SSIM +0.00050350 (+2.191σ), LPIPS −0.00061364 (−1.838σ), log count +0.0027658 (+0.509σ); all within 3σ. - Promoted the exact tested commit to production ase7dbd03(experiment commit7898789) and enabledGS_OPT_FAST_EXP=1. Round ended: 2026-11-07 11:15 UTC.
5.8 hRound 17 — shared collectively fetched Gaussian colors
- Started: 2026-11-07 11:15 UTC; base commite7dbd03, full-check PASS N1 at 201.702 s / 1.5207×, standalone 200.790 s / 1.5276×. - Current-best profile/tmp/r17/profile/timing_profile.profile.txt(PID 32432): packed backward 32.806 ms/20 steps (21.97%), forwardrenderCUDA25.867 ms (17.32%), down from 27.093 ms before hardware exponential. Optimizer fused kernels remain substantial but overlap on side streams. Forward color loading remains the selected hotspot. - Change prepared in/tmp/gs-shared-color:GS_OPT_SHARED_COLOR=1adds one sharedfloat4color per collectively fetched Gaussian. Forward fetches each color once per tile batch and reads one shared vector in the pixel loop instead of three global feature loads; the no-depth path no longer stores the otherwise unused collected Gaussian IDs. Per-channel multiply/add expressions are unchanged. Default off; tier N0 memory-layout change. - Validation queue: launcher PID 33039, queue log/tmp/r17/queue.log; build/tmp/r17/build.log, quick/tmp/r17/quick.log, timing/tmp/r17/time.log./tmp/r17/quick/check.json: PASS (exact_items_pass)./tmp/r17/time/time.json: 194.249 s / 1.5791×, windows 53.224 / 71.441 / 69.584 s. Every window improved; the gain over Round 16 standalone timing is 6.541 s (3.26%). - Full judge result/tmp/r17/check/check.json(PID 33828, log/tmp/r17/check.log): PASS, tier N1, speedup 1.5885×; candidate 193.093 s, windows 52.659 / 71.305 / 69.128 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR −0.023117 (−0.594σ), SSIM −0.00024418 (−1.063σ), LPIPS +0.00002268 (+0.068σ), log count +0.00025345 (+0.047σ); all within 3σ. - Promoted the exact tested commit to production as75c9101(experiment commit45e035e) and enabledGS_OPT_SHARED_COLOR=1. Round ended: 2026-11-07 11:33 UTC.
6.1 hRound 18 — cooperative backward pixel-state preload
- Started: 2026-11-07 11:33 UTC; base commit75c9101, full-check PASS N1 at 193.093 s / 1.5885×, standalone 194.249 s / 1.5791×. - Current-best profile/tmp/r18/profile/timing_profile.profile.txt(PID 34420): packed backward 33.107 ms/20 steps (22.69%), now the dominant individual render kernel; forwardrenderCUDAfell from 25.867 to 21.489 ms (14.72%) after shared colors. Total forward rasterizer GPU time is 40.210 ms, backward 44.088 ms. Backward state traffic remains the selected hotspot. - Change prepared in/tmp/gs-broadcast-state:GS_OPT_BROADCAST_STATE=1cooperatively preloads each 32-pixel group of packed sample/color/gradient state into a roughly 1.4 KiB per-warp shared buffer. The original 287-iteration lane-0 insertion and shuffle-up pipeline remains, including its transmittance/color-residual dependencies and all arithmetic; only global-state loads become coalesced and lane 0 subsequently reads shared memory. Non-packed instantiations keep the original path. Default off; tier N0 memory/scheduling change. - Validation queue: launcher PID 35046, queue log/tmp/r18/queue.log; build/tmp/r18/build.log, quick/tmp/r18/quick.log, timing/tmp/r18/time.log./tmp/r18/quick/check.json: PASS (exact_items_pass)./tmp/r18/time/time.json: 187.795 s / 1.6334×, windows 51.320 / 69.282 / 67.193 s. Every window improved; the gain over Round 17 standalone timing is 6.454 s (3.32%). - Full judge result/tmp/r18/check/check.json(PID 35827, log/tmp/r18/check.log): PASS, tier N1, speedup 1.6270×; candidate 188.525 s, windows 51.358 / 69.589 / 67.578 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR +0.00306821 (+0.079σ), SSIM +0.00003437 (+0.150σ), LPIPS −0.00036081 (−1.081σ), log count +0.00170489 (+0.314σ); all within 3σ. - Promoted the exact tested source to production as6f0b91f(experiment commit6efa25e) and enabledGS_OPT_BROADCAST_STATE=1. Round ended: 2026-11-07 11:52 UTC.
6.4 hRound 19 — vectorize preloaded backward state
- Started: 2026-11-07 11:52 UTC; base commit6f0b91f, full-check PASS N1 at 188.525 s / 1.6270×, standalone 187.795 s / 1.6334×. - Fresh production profile/tmp/r19/profile/timing_profile.profile.txt(PID 36439): packed backward fell from 33.107 to 30.109 ms/20 steps (20.91%) after cooperative preload; forward is 21.541 ms (14.96%). Backward remains the largest individual render kernel, so its scalar shared-state accesses remain the selected hotspot. Optimizer attribution includes concurrent side-stream execution and is used only for hotspot selection. - Prepared but not yet built or timed in/tmp/gs-vector-preload:GS_OPT_VECTOR_PRELOAD=1, together withGS_OPT_BROADCAST_STATE=1, packs the four sample values into one sharedfloat4and the three color gradients plus contributor count into another. Global-load coalescing, lane-0 insertion, shuffle propagation, loop structure, and every arithmetic expression remain as in the Round 18 accepted path. Default off; intended tier N0 shared-memory layout change. - Validation queue: active launcher PID 37044 (initial shell PID 37043 exited), queue log/tmp/r19/queue.log; build/tmp/r19/build.log, quick/tmp/r19/quick.log, timing/tmp/r19/time.log./tmp/r19/quick/check.json: PASS (exact_items_pass)./tmp/r19/time/time.json: 184.259 s / 1.6647×, windows 50.176 / 67.974 / 66.109 s. Every window improved over Round 18 standalone; the gain is 3.536 s (1.88%). - Full judge result/tmp/r19/check/check.json(active PID 37830, log/tmp/r19/check.log): PASS, tier N1, speedup 1.6643×; candidate 184.303 s, windows 50.374 / 67.936 / 65.993 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR −0.0556802 (−1.430σ), SSIM −0.00034880 (−1.518σ), LPIPS −0.00053164 (−1.592σ), log count +0.00112329 (+0.207σ); all within 3σ. - Promoted the exact tested source to production asec736dc(experiment commita2b6417) and enabledGS_OPT_VECTOR_PRELOAD=1. Round ended: 2026-11-07 12:12 UTC.
6.8 hRound 20 — remove bucket-count host synchronization
- Started: 2026-11-07 12:12 UTC; base commitec736dc, full-check PASS N1 at 184.303 s / 1.6643×, standalone 184.259 s / 1.6647×. - Change prepared in/tmp/gs-async-bucketsas combined commitff23fb3:GS_OPT_ASYNC_BUCKETS=1removes the second forward device-to-host count copy. It allocatesceil(num_rendered/32) + num_tilesbuckets, a proven upper bound onsum(ceil(valid_tile_splats/32)), and returns that capacity for backward. Backward launches the same real bucket IDs plus at mostnum_tilesextra one-warp blocks; every block first checks the device-resident actual count and extra blocks return before tile metadata loads or gradient writes. Default builds retain the host copy and exact host-count launch. Combined with the accepted vector preload; intended tier N0 scheduling change. - Fresh production profile/tmp/r20/profile/timing_profile.profile.txt: vectorized backward fell from 30.109 to 27.240 ms/20 steps (19.30%); forwardrenderCUDAis 21.643 ms. Forward_RasterizeGaussiansstill has 3.070 ms CPU total per step and includes the bucket-count host copy selected for this round. Forward preprocess andduplicateWithKeysare 9.899/9.848 ms per 20 steps and remain later GPU-kernel candidates. - Validation queue: active launcher PID 39084 (initial shell PID 39083 exited), queue log/tmp/r20/queue.log; build/tmp/r20/build.log, quick/tmp/r20/quick.log, timing/tmp/r20/time.log./tmp/r20/quick/check.json: PASS (exact_items_pass)./tmp/r20/time/time.json: 185.414 s / 1.6543×, windows 50.827 / 68.303 / 66.285 s. This was 1.155 s slower than Round 19 standalone and every window was slower; reserved memory also rose to 60.70 GiB from the overprovisioned sample cache. The change was rejected / not promoted without a full check. Production remainsec736dc; rejected combined experiment isff23fb3(async-only commit8491197). - Round ended: 2026-11-07 12:23 UTC.
6.9 hRound 21 — hoist duplicate-key Gaussian invariants
- Started: 2026-11-07 12:23 UTC; base commitec736dc, full-check PASS N1 at 184.303 s / 1.6643×, standalone 184.259 s / 1.6647×. - Current-best profile/tmp/r20/profile/timing_profile.profile.txt(production unchanged after Round 20 rejection):duplicateWithKeysis 9.848 ms/20 steps (6.98%), essentially tied with forward preprocess at 9.899 ms after the larger render kernels. Its per-tile loop recomputes Gaussian-only reciprocals and depth bits. - Change prepared in/tmp/gs-duplicate-hoistas commitef6a444:GS_OPT_DUPLICATE_HOIST=1computes the two existing__frcp_rnvalues once per visible Gaussian and passes them into the tile-culling helper, and loads the depth key bits once. The same reciprocals, expressions, comparisons, key bits, culling, and output order are retained; default builds keep the original loop. Intended tier N0 loop-invariant code motion. - Validation queue: active launcher PID 39943, queue log/tmp/r21/queue.log; build/tmp/r21/build.log, quick/tmp/r21/quick.log, timing/tmp/r21/time.log./tmp/r21/quick/check.json: PASS (exact_items_pass)./tmp/r21/time/time.json: 179.364 s / 1.7101×, windows 48.914 / 66.212 / 64.238 s. Every window improved over Round 19 standalone; the gain is 4.895 s (2.66%). - Full judge result/tmp/r21/check/check.json(active PID 40724, log/tmp/r21/check.log): PASS, tier N1, speedup 1.7119×; candidate 179.176 s, windows 48.701 / 66.288 / 64.187 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR −0.0579837 (−1.489σ), SSIM −0.00012443 (−0.541σ), LPIPS −0.00017243 (−0.516σ), log count −0.00256181 (−0.471σ); all within 3σ. - Promoted the exact tested source to production as6dd5d0b(experiment commitef6a444) and enabledGS_OPT_DUPLICATE_HOIST=1. Round ended: 2026-11-07 12:38 UTC.
7.2 hRound 22 — direct shared access to invariant backward pixel state
- Started: 2026-11-07 12:38 UTC; base commit6dd5d0b, full-check PASS N1 at 179.176 s / 1.7119×, standalone 179.364 s / 1.7101×. - Change prepared in/tmp/gs-direct-pixel-stateas commita1ae5b9:GS_OPT_DIRECT_PIXEL_STATE=1double-buffers the packed per-pixel gradient/contributor vectors and reads the vector for each active diagonal directly from shared memory. Those values are constant per pixel, so their four shuffle-up operations and lane-0 insertion are removed. Transmittance and accumulated color residuals retain the original shuffle pipeline and arithmetic; non-packed instantiations retain all original shuffles. Two buffers cover current and previous wavefront groups. Default off; intended tier N0 scheduling change. - Fresh production profile/tmp/r22/profile/timing_profile.profile.txt(PID 41283):duplicateWithKeysfell from 9.848 to 6.450 ms/20 steps after invariant hoisting; backward remains 27.223 ms (19.97%) and forwardrenderCUDA21.430 ms. The backward loop still spends four shuffle-up operations per iteration propagating per-pixel constants, the selected hotspot. Forward preprocess is now 9.931 ms. - Validation queue: active launcher PID 41935, queue log/tmp/r22/queue.log; build/tmp/r22/build.log, quick/tmp/r22/quick.log, timing/tmp/r22/time.log./tmp/r22/quick/check.json: PASS (exact_items_pass)./tmp/r22/time/time.json: 182.642 s / 1.6794×, windows 49.878 / 67.408 / 65.356 s. This was 3.278 s slower than Round 21 standalone and every window was slower. Direct warp-wide shared vector reads cost more than the removed shuffles, so the change was rejected / not promoted without a full check. Production remains6dd5d0b; rejected experiment isa1ae5b9. - Round ended: 2026-11-07 12:48 UTC.
7.3 hRound 23 — reuse forward-preprocess intermediates
- Started: 2026-11-07 12:48 UTC; base commit6dd5d0b, full-check PASS N1 at 179.176 s / 1.7119×, standalone 179.364 s / 1.7101×. - Current-best profile/tmp/r22/profile/timing_profile.profile.txt(production unchanged after Round 22 rejection): forwardpreprocessCUDAis 9.931 ms/20 steps (7.29%), exceeding the reducedduplicateWithKeysat 6.450 ms. It recomputes the view-space mean insidecomputeCov2Dafterin_frustumalready produced it, and reloads the mean for SH color evaluation. - Change prepared in/tmp/gs-preprocess-reuseas commit9815cb2:GS_OPT_PREPROCESS_REUSE=1loads the 3D mean once, performs the same near-cull view transform directly, reuses thatp_viewincomputeCov2D, and passes the loaded mean to SH color evaluation. Projection, covariance, SH arithmetic, culling condition, outputs, prefiltered trap, and default path are preserved. Intended tier N0 common-subexpression elimination. - Validation queue: active launcher PID 42827, queue log/tmp/r23/queue.log; build/tmp/r23/build.log, quick/tmp/r23/quick.log, timing/tmp/r23/time.log./tmp/r23/quick/check.json: PASS (exact_items_pass)./tmp/r23/time/time.json: 179.211 s / 1.7116×, windows 48.724 / 66.198 / 64.289 s. Versus Round 21 standalone, the total changed by only −0.153 s (0.085%) and windows changed by −0.190 / −0.014 / +0.051 s, below the repeated-evidence threshold. The change was rejected / not promoted; experiment commit9815cb2remains only in/tmp/gs-preprocess-reuse, and production remains6dd5d0b. - SASS inspection of/tmp/gs-sass-r21/production-backward.sassfound one reciprocal evaluation per hot-loop iteration: the main path usesMUFU.RCPat line 435 plus one Newton refinement, or calls the exceptional-value helper at line 429; the resulting register is reused by all three color channels at lines 453–457. The compiler already commoned1.0f / (1.0f - alpha), so no reciprocal-hoist source change was made. OtherMUFU.RCPsites are outside this common path. - Round ended: 2026-11-07 13:01 UTC.
7.5 hRound 24 — defer exact backward bucket-count read
- Started: 2026-11-07 13:01 UTC; base commit6dd5d0b, full-check PASS N1 at 179.176 s / 1.7119×, standalone 179.364 s / 1.7101×. - Fresh production profile/tmp/r24/profile/timing_profile.profile.txt(launcher PID 43715): backward 27.314 ms/20 steps (19.82%), forward render 21.424 ms (15.54%), forward preprocess 9.976 ms, and duplicate keys 6.514 ms. The forward rasterizer also has 2.901 ms CPU total per step, including the bucket-count host synchronization selected for this round. - Change prepared in/tmp/gs-deferred-bucketas commitc321526:GS_OPT_DEFERRED_BUCKET_COUNT=1uses the proven bucket-count upper bound only for sample-state allocation, eliminating the forward host read. Backward reads the exact device count after forward/loss work is queued and launches exactly that many one-warp blocks. Unlike rejected Round 20, there are no extra backward blocks or per-block device-count loads; forward and backward use identical capacity-based workspace layouts. All rendering arithmetic and valid bucket work are unchanged. Default off; intended tier N0 scheduling change. - Validation queue: active launcher PID 44004 (initial shell PID 44003 exited), queue log/tmp/r24/queue.log; build/tmp/r24/build.log, quick/tmp/r24/quick.log, timing/tmp/r24/time.log./tmp/r24/quick/check.json: PASS (exact_items_pass)./tmp/r24/time/time.json: 179.243 s / 1.7113×, windows 49.273 / 65.981 / 63.988 s. Versus Round 21 standalone, total changed by only −0.121 s (0.067%) and windows changed by +0.359 / −0.231 / −0.250 s, below the repeated-evidence threshold. Reserved memory rose to 58.64 GiB. The change was rejected / not promoted; experiment commitc321526remains only in/tmp/gs-deferred-bucket, and production remains6dd5d0b. - Round ended: 2026-11-07 13:14 UTC.
7.8 hRound 25 — double-buffer backward state preload
- Started: 2026-11-07 13:14 UTC; base commit6dd5d0b, full-check PASS N1 at 179.176 s / 1.7119×, standalone 179.364 s / 1.7101×. - Current-best profile/tmp/r24/profile/timing_profile.profile.txt(production unchanged after Round 24 rejection): backward is 27.314 ms/20 steps (19.82%), the largest individual render kernel. Its cooperative preload currently synchronizes, loads a 32-pixel group, and synchronizes again before that group enters the shuffle pipeline. The selected hotspot is exposed preload latency at eight group boundaries per bucket. - Change to test behindGS_OPT_DOUBLE_PRELOAD=1: preload the first group before the loop, then preload each following group into an alternate shared buffer at diagonal 1 of the current group. A warp sync at the next group boundary makes the prefetched state visible. Lane-0 insertion selects the same group parity; all shuffle propagation, arithmetic, loop trip counts, global loads, and valid-pixel conditions remain unchanged. Default off; intended tier N0 scheduling/layout change. - Experiment commitcd4c5b6in/tmp/gs-double-preload, config/tmp/gs-switches-double-preload.json. Validation queue: active launcher PID 44937 (initial shell PID 44936 exited), queue log/tmp/r25/queue.log; build/tmp/r25/build.log, quick/tmp/r25/quick.log, timing/tmp/r25/time.log./tmp/r25/quick/check.json: PASS (exact_items_pass)./tmp/r25/time/time.json: 184.073 s / 1.6664×, windows 50.067 / 67.999 / 66.007 s. This was 4.709 s slower than Round 21 standalone and every window was slower. Extra shared storage, buffering address work, and changed instruction scheduling cost more than the halved warp-sync count and overlapped loads. The change was rejected / not promoted; production remains6dd5d0b. - Round ended: 2026-11-07 13:26 UTC.
8.0 hRound 26 — contributor-aware backward state preload
- Started: 2026-11-07 13:26 UTC; base commit6dd5d0b, full-check PASS N1 at 179.176 s / 1.7119×, standalone 179.364 s / 1.7101×. - Fresh production profile/tmp/r26/profile/timing_profile.profile.txt(launcher PID 45716): backward 27.275 ms/20 steps (19.84%), forward render 21.514 ms, preprocess 9.937 ms, duplicate keys 6.352 ms. Backward cooperative preloads still fetch state for pixels whose existing contributor test rejects the entire bucket. - Experiment/tmp/gs-contributor-preload, commit8854707, config/tmp/gs-switches-contributor-preload.json:GS_OPT_CONTRIBUTOR_PRELOAD=1readsn_contribfirst and skips the sampled-state, packed-pixel-color, and packed-gradient loads whenbucket_start >= last_contributor. Such pixels already skip every valid Gaussian in that bucket. Their preloaded state stays zero; contributing pixels use identical loads and arithmetic. Default off; intended tier N0 exact culling. - Validation queue: active launcher PID 45895 (initial shell PID 45894 exited), queue log/tmp/r26/queue.log; build/tmp/r26/build.log, quick/tmp/r26/quick.log, timing/tmp/r26/time.log./tmp/r26/quick/check.json: PASS (exact_items_pass)./tmp/r26/time/time.json: 178.217 s / 1.7211×, windows 48.378 / 65.867 / 63.972 s. Every window improved over Round 21 standalone; total gain 1.147 s (0.639%). Repeat/tmp/r26/time-repeat/time.json(PID 46675): 177.842 s / 1.7248×, windows 48.328 / 65.720 / 63.794 s, again improving every window and 1.522 s (0.849%) overall. The repeated evidence justified a full check. - Full judge result/tmp/r26/check/check.json(PID 46869, log/tmp/r26/check.log): PASS, tier N1, speedup 1.7298×; candidate 177.327 s, windows 48.590 / 65.443 / 63.294 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR −0.01438218 (−0.369σ), SSIM −0.00010734 (−0.467σ), LPIPS +0.00002031 (+0.061σ), log count +0.00445370 (+0.819σ); all within 3σ. - Promoted the exact tested source to production asdbb7c54(experiment commit8854707) and enabledGS_OPT_CONTRIBUTOR_PRELOAD=1; tested and promoted git trees are identical. Round ended: 2026-11-07 13:48 UTC.
8.4 hRound 27 — cull backward tail beyond tile contributor maximum
- Started: 2026-11-07 13:48 UTC; base commitdbb7c54, full-check PASS N1 at 177.327 s / 1.7298×, standalone repeats 178.217 / 177.842 s. - Fresh production profile/tmp/r27/profile/timing_profile.profile.txt(launcher PID 47490): accepted contributor-aware culling reduced backward from 27.275 to 26.738 ms/20 steps (19.89%); forward render is 21.532 ms, preprocess 9.947 ms, duplicate keys 6.195 ms. The selected backward hotspot is the last useful bucket: lanes at or beyond the tile-widemax_contribcannot pass any pixel's contributor test, but still load Gaussian properties and issue zero-valued atomic additions. - Experiment/tmp/gs-max-contrib-cull, commit5d33bb4, config/tmp/gs-switches-max-contrib-cull.json:GS_OPT_MAX_CONTRIB_CULL=1reuses the loaded tile maximum invalid_splat, removing those lanes' property loads, pixel work, and zero atomics while retaining every potentially contributing lane. Default off; intended tier N0 exact culling. Validation queue: active launcher PID 48105 (initial shell PID 48104 exited), queue log/tmp/r27/queue.log; build/tmp/r27/build.log, quick/tmp/r27/quick.log, timing/tmp/r27/time.log./tmp/r27/quick/check.json: PASS (exact_items_pass)./tmp/r27/time/time.json: 178.696 s / 1.7165×, windows 48.850 / 65.865 / 63.981 s. This was slower than both Round 26 standalone totals (178.217 / 177.842 s) and improved no window relative to either. The change was rejected / not promoted; production remainsdbb7c54. - Round ended: 2026-11-07 14:00 UTC.
8.6 hRound 28 — batch Adam state-step increments
- Started: 2026-11-07 14:00 UTC; base commitdbb7c54, full-check PASS N1 at 177.327 s / 1.7298×, standalone repeats 178.217 / 177.842 s. - Fresh production profile/tmp/r28/profile/timing_profile.profile.txt(launcher PID 48859): backward 26.708 ms/20 steps, forward render 21.415 ms, preprocess 9.866 ms. Fused-Adam CUDA totals 32.505 ms, andParallelFusedAdam.steptotals 31.088 ms on the profiling stream; side-stream attribution is used only for hotspot selection. Each of six groups currently dispatches its own state-step increment before its fused update. - Experiment/tmp/gs-batched-adam-steps, commit8355e57, config/tmp/gs-switches-batched-adam-steps.json:GS_OPT_BATCHED_ADAM_STEPS=1performs the same_init_groupstate handling, increments all state steps in onetorch._foreach_add_, and calls the sametorch._fused_adam_operator per group with unchanged learning rates and existing side streams. No Adam arithmetic or parameter/state dtype changes. Default off; intended tier N0 dispatch/scheduling change. - Validation queue: active launcher PID 49145 (initial shell PID 49144 exited), queue log/tmp/r28/queue.log; quick/tmp/r28/quick.log, timing/tmp/r28/time.log. Initial/tmp/r28/quick/check.json: ERROR after 599 steps, before timing:RuntimeError: Tensor list must have at least one tensor. At densification all newly replaced parameters can havegrad=None; unlike the original per-group early return, the first version called foreach on an empty list. Added the equivalent empty-list guard and amended the experiment to commit42d9b36. - Fixed validation queue: active launcher PID 49762 (initial shell PID 49761 exited), queue log/tmp/r28/queue-fixed.log; quick/tmp/r28/quick-fixed.log, timing/tmp/r28/time.log./tmp/r28/quick-fixed/check.json: PASS (exact_items_pass)./tmp/r28/time/time.json: 178.990 s / 1.7137×, windows 49.411 / 65.858 / 63.721 s. This was slower than both Round 26 standalone totals (178.217 / 177.842 s), with a substantially slower first window. The change was rejected / not promoted; production remainsdbb7c54. - Round ended: 2026-11-07 14:13 UTC.
8.9 hRound 29 — combine dense Adam groups in one CUDA kernel
- Started: 2026-11-07 14:13 UTC; base commitdbb7c54, full-check PASS N1 at 177.327 s / 1.7298×, standalone repeats 178.217 / 177.842 s. - Fresh production profile/tmp/r29/profile/timing_profile.profile.txt(launcher PID 50179): six Gaussian fused-Adam calls total 32.536 ms CUDA; their multi-tensor kernels require 171 launches over 19 steps (9/step) because the large feature group is chunked across launches.ParallelFusedAdam.steptotals 31.174 ms on the profiling stream, with independent side-stream execution. Backward and forward render are 26.775 / 21.272 ms. - Experiment/tmp/gs-single-adam-kernel, initial commit163bb5f, config/tmp/gs-switches-single-adam-kernel.json:GS_OPT_SINGLE_ADAM_KERNEL=1retains_init_groupand one batched float32 state-step increment, then calls a custom dense kernel once for all six groups. It preserves per-group learning rates and ATen's coefficient types, expression order, 65,536-element chunks, float4 accesses, and dense float32 updates. Small groups are scheduled beforef_rest; unsupported Adam options use the original path. Default off; intended tier N0 kernel fusion. - Initial validation queue: active launcher PID 50456, queue log/tmp/r29/queue.log; build/tmp/r29/build.logsucceeded./tmp/r29/quick/check.json: ERROR before step 1 because the binding required contiguous parameters. Judge-side layout diagnostics showed thatxyzhas shape(136029,3)and strides(1,136029), inherited from the transposed COLMAP array; its gradient and both moments have the same dense permuted layout. The other five groups are contiguous. No initial timing was produced. - Correction commitf95fa52: the binding now accepts non-overlapping dense layouts only when parameter, gradient, and both moments have identical shapes and strides. Physical linear indexing then visits every storage element exactly once without copying or changing public layouts./tmp/r29/quick-dense-layout/check.json: PASS, all 3,000 exact items./tmp/r29/time-fixed/time.json: 172.517 s / 1.7780×, windows 48.202 / 64.154 / 60.161 s. Versus the faster Round 26 standalone repeat, this is 5.325 s (3.00%) faster and every window improves (−0.126 / −1.566 / −3.633 s). Full all-gates check queued at/tmp/r29/check(active PID 52327, log/tmp/r29/check.log); production remainsdbb7c54until it passes. - Round ended: 2026-11-07 14:41 UTC (the full check does not count toward the round).
8.9 hFull check after round 29 — PASS and promotion
- Full judge result/tmp/r29/check/check.json(PID 52327, log/tmp/r29/check.log): PASS, tier N1, speedup 1.7721×; candidate 173.087 s, windows 48.012 / 64.263 / 60.812 s. Quick and full-trajectory exact items passed. Endpoint biases: PSNR −0.04458910 (−1.145σ), SSIM −0.00055247 (−2.404σ), LPIPS +0.00027429 (+0.822σ), log count +0.00053494 (+0.098σ); all within 3σ. - Promoted the exact tested source to production as commits4d24a92(single-kernel dense Adam) and78d3252(dense permuted-layout support); enabledGS_OPT_SINGLE_ADAM_KERNEL=1. Tested experiment HEADf95fa52and promoted HEAD78d3252have identical trees.
9.4 hRound 30 — reuse computed 3D covariance in forward preprocessing
- Started: 2026-11-07 14:50 UTC; base commit78d3252, full-check PASS N1 at 173.087 s / 1.7721×, standalone 172.517 s / 1.7780×. - Fresh production profile/tmp/r30/profile/timing_profile.profile.txt(profile log/tmp/r30-profile.log): single-kernel Adam is 14.622 ms/20 steps, down from 32.536 ms for separate fused calls. Backward 26.712 ms, forward render 21.643 ms, forward preprocess 9.906 ms, duplicate keys 6.342 ms. The selected preprocess hotspot writes six 3D covariance floats globally and immediately reconstructs the same matrix for the 2D transform. - Experiment/tmp/gs-cov3d-reuse, config/tmp/gs-switches-cov3d-reuse.json:GS_OPT_COV3D_REUSE=1returns the existingglm::mat3 SigmafromcomputeCov3Dand passes it directly to the same inlined 2D covariance arithmetic, while retaining all six global stores required by backward. Precomputed-covariance and default paths retain the pointer-based reconstruction. Default off; intended tier N0 elimination of same-thread global reloads. - Validation queue active PID 53591, log/tmp/r30/queue.log; quick/tmp/r30/quick.log, timing/tmp/r30/time.log./tmp/r30/quick/check.json: PASS (exact_items_pass)./tmp/r30/time/time.json: 175.067 s / 1.7521×, windows 48.110 / 66.924 / 60.032 s. This was 2.550 s slower than the production standalone timing and slower than its full-check timing as well; the large second-window regression outweighed the small third-window improvement. Rejected without a full check and not promoted. Experiment archived as commitdad763f; production remains78d3252. - Round ended: 2026-11-07 15:02 UTC.
9.6 hRound 31 — broadcast Adam bias coefficients per warp
- Started: 2026-11-07 15:02 UTC; base commit78d3252, full-check PASS N1 at 173.087 s / 1.7721×, standalone 172.517 s / 1.7780×. Production was unchanged by rejected Round 30, so the fresh/tmp/r30/profileremains the current-best profile. - Hotspot: the custom dense Adam kernel remains 14.622 ms/20 steps. Every one of its 512 threads per block loads the same group step and evaluates two double-precisionpowcalls for identical bias corrections before processing its elements. - Experiment/tmp/gs-warp-adam-coeff, config/tmp/gs-switches-warp-adam-coeff.json:GS_OPT_WARP_ADAM_COEFF=1evaluates the original float/double coefficient expressions in lane 0 of each full warp, then broadcasts the two resulting float coefficients with warp shuffles. All per-element math, memory accesses, launch geometry, learning rates, and state-step handling are unchanged. Default off; intended tier N0 redundant-work elimination. - Validation queue active PID 54467, log/tmp/r31/queue.log; quick/tmp/r31/quick.log, timing/tmp/r31/time.log./tmp/r31/quick/check.json: PASS (exact_items_pass)./tmp/r31/time/time.json: 172.156 s / 1.7817×, windows 48.262 / 63.860 / 60.034 s. Repeat/tmp/r31/time-repeat/time.json: 172.132 s / 1.7820×, windows 48.144 / 64.015 / 59.973 s. The two totals differ by only 0.024 s and are about 0.37 s (0.22%) below the original production standalone, but this remains below the 1% threshold. - A subsequent unchanged-production control/tmp/r31/time-production/time.jsonwas a severe outlier at 182.500 s, windows 48.218 / 67.145 / 67.138 s. No judge/compiler/compute processes remained afterward;nvidia-smishowed an idle GPU at 28°C and 0 MiB. It was treated as invalid machine noise, not as evidence of a 10 s gain. The small candidate effect could not be resolved confidently against nonstationary full-run timing, so the change was rejected / not promoted without a full check. Experiment archived as168aa7d; production remains78d3252. - Round ended: 2026-11-07 15:22 UTC.
9.9 hRound 32 — group forward sampling at 32-Gaussian boundaries
- Started: 2026-11-07 15:23 UTC; base commit78d3252, full-check PASS N1 at 173.087 s / 1.7721×, standalone 172.517 s / 1.7780×. - Fresh production profile/tmp/r32/profile/timing_profile.profile.txt: backward 26.716 ms/20 steps, forward render 21.581 ms, preprocess 9.921 ms, duplicate keys 6.313 ms. Adam attribution rose to 24.923 ms in this profile despite unchanged source, consistent with the full-run timing instability seen in Round 31; it is not used for a speed claim. The selected forward inner loop evaluates a 32-boundary condition for every candidate Gaussian although sampled state is written only at those boundaries. - Experiment/tmp/gs-grouped-forward, config/tmp/gs-switches-grouped-forward.json:GS_OPT_GROUPED_FORWARD_LOOP=1nests the existing per-Gaussian body inside 32-entry groups. The same sampled-state write and bucket increment occur once at each group start; contributor order, early-done behavior, all arithmetic, and default builds remain unchanged. Default off; intended tier N0 loop restructuring. - Validation queue active PID 56022, log/tmp/r32/queue.log; quick/tmp/r32/quick.log, timing/tmp/r32/time.log. Results pending; production remains78d3252.