Usually IEEE floats have an implied 1 in the front. So for the standard represented numbers, there's some minimum number 1.bbbbbb.. * 2^-N. This allows 1bit more precision than is actually stored.
between any two numbers, there's basically the same epsilon difference, but from the smallest number to zero it's bigger.
A subnormal number breaks that convention, it just becomes 0.bbbbb... * 2^-N. As the numbers get smaller, the relative difference between the numbers gets larger. That also means their precision is smaller than the normal floats.
Why not just use an 8-bit LUT to encode the 256 most common ternary vectors with 6 components. That means of the possible 729 possible such vectors, you can only represent 256 different ones. You have to do more aggressive rounding, but at least the scheme is very simple to decompress and stream.
I think the weights are iid distributed, so all 729 patterns will be roughly equally likely. That doesn't make this a bad idea though -- it just means there's no point trying to select the most common 256 to keep, since any 256 will be roughly as good.
In the article it said that in ternary, the majority of weights are 0. The components may be independent, but any group of weights won't be evenly distributed across all probable occurences.
Good point, I was wrong. Groups of weights having more zeros will be more likely, so should be favoured. Due to independence there won't be any meaningful difference in frequencies between two groups of weights that have the same number of zeros, but that doesn't invalidate the above.
It is indeed very strange and annoying. And I don't remember it being so bad ten years ago (although I had to use witcher for alt-tabbing - which actually worked well, unlike AltTab now). Since Linux, and both OG Mac Os, I am used to having multiple Desktops, in total multiple windows of the same applications (browsers, pdf reader, office, file browser). Mac Os is completely hostile towards doing multiple tasks at the same time, and compartmentalizing them into desktops -- you keep getting thrown around to random windows on random desktops (example if you close a window), it's super difficult to find your windows, it's just crazy. You're afraid of ever moving away from a window.
I think this paradim is also what's makes the Mac OS feel snappy. If basically having multiple windows for one software open is "holding it wrong", the OS is pushing you into one application, one window paradigm. As long as you do that, everything is pretty quick. But don't dare open two browser windows, or even worse, two windows of a word processor. The performance will degrade (and you'll keep searching for your windows...)
I don't know, while I miss the super+right click drag to resize window and super+left click drag to move window from KDE on my work machine, I also kinda miss the smoothness of macOS's handling of many windows and desktops utilizing the trackpad on my gaming desktop. The swipe up and down/ctrl+arrow up and down to juggle windows within the desktop, and then left/right to move between desktops even makes their at first awkward handling of fullscreening apps feel right and efficient. What I really miss in KDE though is multiple virtual desktops per display I can switch independently per display. Actually makes me enjoy using multiple monitors slightly slightly more on macOS. What I sadly can't see happening is a merging of KDE, macOS, and the superior i3, as there would be too few few safe shortcut combinations available for programs to rely on.
I don’t get it either. What are these people doing that keep saying that Mac OS is snappy. It’s the same slow garbage as windows.
One problem is that you need Firefox because safari doesn’t peppery do ad blocking. But once you have 20 tabs open or so, it uses 5GB GB ram. But perhaps your also need safari for something else. That’s another 5GB of RAM. Then once you count a finder replacement (2GB ram), and some office stuff (probably 1-4GB for each app window), 16GB of ram are almost as sluggish as an old windows laptop. Add MS Teams, and the thing is brought to it’s knees. And Mac OS has a lot of quirks and the window management is atrocious (alt-tab doesn’t switch between app windows, a bunch of apps to get alt-tab behavior don’t work properly either).
I feel like more and more that Mac Users are being forced by the atrocious window management to only have one window open per software, so then the system is fast. Problem is when you have multiple tasks going on in parallel, then you need many windows and desktops.
I don't really think it's all that much about macOS. I think it more has to do with the state of web development - claude.com or chat.com or grok.com all can use up to 5GB of RAM as an idle webpage in the background regardless of browser. Most apps these days seem to be electron apps which can fire off multiple 4+ GB node processes doing who knows what.
I think most true native apps don't have these issues. Unfortunately there is very little incentive to build on the macOS platform these days, which is where I point more of the finger at Apple. UX, UI, & DX are all quite a bit worse for Mac native.
I live with safari and finder and all my office ware is native (mail.app) or web based (Google Docs). Chat is via slack, but I use the website and not the native app. I've adapted to the quirks and I'd bet that's a lot of the reason why it doesn't feel slow to me. I feel I have plenty of windows open at once but likely less than you do.
If you have to use specialized software to make your system snappy, then it is, as a system, not snappy. The attitude about the MacBook is that it never slows down … what, unless you use MS office?
my point was I'm not using specialized software, I'm using the software shipped with the system. MS Office isn't Apple Software, so holding apple responsible for Microsoft code quality seems counter to your first point.
If I have Office stuff open and the whole system crawls, then the system isn’t snappy.
It’s like the claim is “get a Mac and you’ll never see a slow down ever again! Just as long as you run software that won’t make the whole system come to a crawl”
I don’t get that sentiment. I have an m4 16gb and it’s such a sluggish machine. and that’s not even doing development, just browsers, word, excel, PowerPoint. (And so many eternal bugs… I feel like I’m on windows)
do you have a corp laptop with a dozen scanners like Carbon Black, Crowdstrike, etc. installed? My corp M4 Max with 48 GB is slower than my old M1 16GB machine by a large margin. I don't know what evil things those scanners do, but they're alwayus spinning like 35% CPU, and the M4 Max machine just drags..
Nope. Just a MacBook with office, safari, Firefox, and some finder replacement. And preview. If every tab and window uses 1GB+, then you don’t need many tabs/windows to bring the system to it’s knees.
I have an M2 Pro MBP 16GB, compared to the latest MBP issued by my employer a couple months ago, I see zero difference in real world performance. Can’t speak for Office on Mac, I have not used it in over a decade, but for typical full stack web dev I literally don’t need anything more.
Sounds broken, somehow. The M1 iPad Pro I just traded in worked fine. Traded it for a Neo and the Neo does some stuff faster, but for day-to-day casual use, it's not notably different.
between any two numbers, there's basically the same epsilon difference, but from the smallest number to zero it's bigger.
A subnormal number breaks that convention, it just becomes 0.bbbbb... * 2^-N. As the numbers get smaller, the relative difference between the numbers gets larger. That also means their precision is smaller than the normal floats.
reply