vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep
Article URL: https://blog.vllm.ai/2025/12/17/large-scale-serving.html Comments URL: https://news.ycombinator.com/item?id=46602737 Points: 109 # Comments: 28...
Article URL: https://blog.vllm.ai/2025/12/17/large-scale-serving.html Comments URL: https://news.ycombinator.com/item?id=46602737 Points: 109 # Comments: 28...
As DePIN projects generate revenue and AI agents move onchain, builders are shifting focus from speculation to fundamentals, but questions remain about Web3’s decentralization ethos....
Hi HN, I have been working with regulation-heavy documents lately, and one thing kept bothering me. Flat RAG pipelines often fail to retrieve related articles together, even when they are clearly conn...
The GPU market is turning into a mess again. Asus told Hardware Unboxed earlier this week that it was winding down production of its RTX 5070 Ti, but the PC maker is now walking back that claim and bl...
Ticketed help desks and live support are replacing always-on Discord channels at major DeFi protocols....
Cesar Carvalho worked at McKinsey from 2010 to 2012. Pascal Perich/© Pascal Perich Cesar Carvalho left a consulting job at McKinsey to launch Wellhub, a wellness startup. 14 years later, Wellhub is ch...
The Bravia 8 II draws you in. Sony has a history of making excellent TVs, from the Trinitron CRTs of last century to the world's first OLED nearly 20 years ago to 2016's ZD9 mini-LED that delivered ex...
On Thursday, Hardware Unboxed reported that Asus is winding down production of its RTX 5070 Ti, saying, Asus "explicitly told us this model is currently facing a supply shortage and, as such, they hav...
Verizon is offering customers a $20 account credit following a massive outage that brought down service across the US on Wednesday. In an update on X , Verizon says you'll receive a text message when ...
Animal Crossing , like Kirby , has come back when it seems like the world needs it most. In 2020, Animal Crossing: New Horizon s released on the Nintendo Switch. The game instantly became a smash hit,...
Kirill Avery is the CEO and founder of Alien. Courtesy of Kirill Avery Kirill Avery sold a percentage of his future earnings to fund startups like Alien and Human. He used a SAFE agreement to raise $5...
Article URL: https://www.simplethread.com/redis-solidqueue/ Comments URL: https://news.ycombinator.com/item?id=46614037 Points: 11 # Comments: 2...
Raspberry Pi is launching a new add-on board capable of running generative AI models locally on the Raspberry Pi 5. Announced on Thursday , the $130 AI HAT+ 2 is an upgraded - and more expensive - ver...
It’s so cute you may overlook the Charmera’s many limitations. Like trading cards, Lego figures , and even the coveted Labubu , you don't know exactly what your Kodak Charmera camera is going to look ...
The Neo 2 looks a lot like the first Neo, but it’s had plenty of upgrades. I'm not a drone guy. In fact, I've always been a bit nervous to play around with them too much. They're big, fragile, and exp...
Hi HN, In most codebases I’ve worked on, temporary hacks (“TODO: remove later”, “just for this release”) slowly become permanent. Nobody remembers why they exist, but they keep shipping to production....
With the advent of PC gaming handhelds, the nearly limitless library of games on Steam and other PC clients are now at your fingertips anytime and anywhere. The best gaming handhelds have a hefty pric...
Hello all! I've been an avid fan of Pocket Operators by Teenage Engineering since I found out about them. I even own an EP-133 K.O. II today, which I love. A couple of months ago, Reddit user andiam03...
OP here. Birth of a Mind documents a "recursive self-modeling" experiment I ran on a single day in 2026. I attempted to implement a "Hofstadterian Strange Loop" via prompt engineering to see if I coul...
Article URL: https://usetero.com/blog/the-question-your-observability-vendor-wont-answer Comments URL: https://news.ycombinator.com/item?id=46617744 Points: 15 # Comments: 3...