younotesunreadstarredadd url

@TeksEdge: 🍎⚡ Qwen3.8-27B is now hitting ~70 tok/s on an M5 Max MacBook Pro with MLX. And t

https://x.com/TeksEdge/status/2090249962840043832

august 2026twitter twitter-post importedopen in karakeep

by David Hendrickson ‧ X (formerly Twitter) ‧ published 2026.08.20 ‧ saved copy from 2026.08.28

From X bookmark — @TeksEdge (David Hendrickson), Aug 20 2026 https://x.com/TeksEdge/status/2090249962840043832
David Hendrickson announced that Qwen3.8-27B now achieves around 70 tokens per second on an M5 Max MacBook Pro using MLX, without sacrificing model size or output quality. This speedup is enabled by DFlash 2, which leverages speculative decoding to generate multiple candidate tokens in parallel while verifying them. Users can run this locally with two models and the updated oMLX software, avoiding cloud inference or specialized GPUs. However, some divergence in longer outputs compared to plain autoregressive decoding was noted.

regenerate summary

page description:

🍎⚡ Qwen3.8-27B is now hitting ~70 tok/s on an M5 Max MacBook Pro with MLX. And this isn’t a smaller model or a quality-reducing speed hack. DFlash 2 landed for Qwen3.8-27B, using speculative decoding to generate multiple candidate tokens in parallel while Qwen verifies them.
screenshot of the page

« back to bookmarks

top tags     all tags251020manage

*bookmark *download *tobuy *tofollow *toread *wishlist 2d 360 3d 3dprinting 3g abandonware accounting actionscript air airplay algorithm android animation api app apple appstore arcade arduino art article askreddit asm assembler audio automation baby backlight backup bambulab bbs berlin bitcoin bivert blipfm blipster blog blu-ray bluetooth book bookmark bootcamp boxee brasil brazil bruno bug bugtracking buildapc business c c# c++ carro casa cell chart chiptune chiptunes citypop claudeai cliq cocoa cocoa-touch code collection component controller cooking core-graphics crt css curso database ddwrt debug demoscene design deutschland dev developer development diy dj dns doc dos dosbox dotnet download dreamcast drink drm ds dvb-c dvd ebook electronics emu emudev emulation emulator engine example expedition33 facebook famicom feedbin firmware fix flash flashcart flex fluorine forum framework freeware gadget game gameboy gameboy-pocket gamecollecting gamedesign gamedev gamegear games gaming gba genesis german germany git google googlemaps GoogleReader gps gsm gui guide hack hacks hamburg hardware home home-automation homeassistant homeautomation homebrew honda howto html htpc http icon IFTTT ikea image imported indie inspiration install insteon interview ios iosprogramming ipad iphone iptv iso itunes jailbreak japan japantravel java javascript job keyboard lastfm lcd lib library linux live lldb localization london mac macos mame management mapkit mastersystem math mce media mediacenter megadrive memory-management miami midi mod movie mp3 mpd msn music mythtv nas nes network nvidia nyc objective-c opengl opengles opensource osx pc pcb perlerbeads php physics piracy plex plugin Pocket portfolio prepaid programming project ps1 ps2 ps3 ps4 psp puremvc push pvr python raspberrypi recalbox recipe reddit reddit-comment reddit-post region remote repro resource restaurante retrogaming retrograming retropc retropie rgb rip rom roms router ruby rubyonrails saopaulo scart science scumm sdk security seedbox serial server shmups shop shopping sim sms snes software sonos sound soundblaster soundtrack source spotify sql sqlite star startup steamdeck store stream subtitles svn swift sync synology synth tax technology terminal three20 tips todayilearned tool tools toread torrent tracker travel trip tutorial tweak twitter twitter-post ubuntu ui uitableview unix unlock uremote usa veralite viagem video vista vita vpn vps vst walkthrough warez web2.0 webdesign webradio webservices wifi wii wiiu windows wishlist wordpress xbmc xbox xcode xml xna youtube z-wave z80 zigbee