DigiNews

Summary

Shu Ding's gpu-lexer introduces a 27.5KB language-agnostic WebGPU syntax highlighter that tokenizes code into parts and labels them with a shared model. It claims broad language support and provides held-out token-label agreement versus Shiki, along with performance benchmarks against Prism.js, Highlight.js, and Starry Night; the approach is experimental and not grammar-equivalent. It also notes embedded script/style regions and cross-language scenarios.