DigiNews

Tech Watch by Johan Denoyer

← Back to articles

OpenJev

Quality: 8/10 Relevance: 9/10

Summary

OpenJev showcases a browser-based, local inference experiment for large language models, comparing direct readout of option probabilities with token-by-token JSON probability generation. The demo highlights privacy (weights stay in the browser) and performance tradeoffs across model sizes (MiniCPM5-2B, Qwen variants) with live timing metrics and source links.

🚀 Service construit par Johan Denoyer