Posts in "Blog"

Longer stuff, and a lot of older stuff.

The Theoretical Beauty of the Legislative Branch

I’ve been reading John Roberts rulings since I was a pre-law undergraduate student, and simply put… the guy lives in a fantasy world.

The Supreme Court on Friday curtailed the power of federal government agencies to regulate vast parts of American life, overturning a 40-year-old legal precedent long targeted by conservatives who say the government gives unaccountable bureaucrats too much authority.

For decades, the court’s decision in Chevron U.S.A. v. Natural Resources Defense Council directed judges to defer to the reasonable interpretations of federal agency officials in cases that involve how to administer ambiguous federal laws. That power will now revert to judges, a move experts said could lead to a spate of challenges of federal guidelines and make regulation more unpredictable as different courts assess agency decisions in different ways.

Writing for the majority in the 6-3 ruling in a pair of cases, Chief Justice John G. Roberts Jr. said the Chevron framework has proved “unworkable” and allowed federal agencies to change course even without direction from Congress. 

“Chevron was a judicial invention that required judges to disregard their statutory duties,” Roberts wrote.

You don’t have to be especially cynical to realize that the United States Congress has had a lot of trouble producing thorough, detailed legislation at a rate sufficient to meet the challenges of the 21st century. That’s why so many things go to the courts! But Roberts is nothing if not consistent — from his judicial philosophy to his decisions and opinions on the regulatory state, this dude has always believed that the legislative branch should clearly articulate what is and isn’t permitted, and that courts can make this happen by simply rejecting regulatory actions that don’t have express legislative authority. 

Cool, cool. But I have to like, live here, man, and the thing you are describing almost never happens. We hate long, detailed legislation! We’ve been told to hate it since the Reagan administration, by legislators waving around giant stacks of papers and lamenting “this 9000 page bill!”, as if the number of pages in a law is a measure for the “amount of government” or something. So which is it? Simple bills, or detailed bills?

I actually believe that Roberts would like detailed bills. He would probably shoot a lot of them down from his position on Mount Olympus, but he would enjoy the back and forth, and I don’t think he’d undercut the few things he actually allowed to pass. It’s not an intellectually incoherent approach to government at all — it’s just a completely impractical civic fantasy that people should be debating in dorm rooms late at night, not suddenly deciding to implement in a country that is already paralyzed and ready to tear itself apart. 

Again — "the Chevron framework has proved ‘unworkable’”, says… some freaking guy we don’t even vote for. I mean, look, I’m not begging for my life to be micromanaged by a bunch of dorks at the Department of Agriculture or anything, but at least I can vote for one of two extremely old men who can appoint some political hack to get in or out of their way a little bit. John Roberts, on the other hand — I mean, the guy literally has zero accountability. Zero! So don’t start poking at shit, man!

I just can’t take seriously anybody who thinks today’s Congress — we didn’t even have a SPEAKER OF THE HOUSE for weeks for absolutely no discernible reason — is even remotely up to the task of providing the kind of detail Roberts and his coalition have suddenly decided is necessary. This pre-WWII vision of American government guys like Roberts continue to wave around a hundred years after it had any relevance at all is just childishly unworkable, and now my kids are probably going to have to do their own private-sector mercury testing or whatever while the guy puts up William McKinley posters in his bedroom. I’ve been super patient with this dude for 25 years but I think I’m done with him. 

"complimentary chiropractic adjustment"

This is funny, informed, profane, and generally delightful. 

Most organizations cannot ship the most basic applications imaginable with any consistency, and you're out here saying that the best way to remain competitive is to roll out experimental technology that is an order of magnitude more sophisticated than anything else your I.T department runs, which you have no experience hiring for, when the organization has never used a GPU for anything other than junior engineers playing video games with their camera off during standup, and even if you do that all right there is a chance that the problem is simply unsolvable due to the characteristics of your data and business? This isn't a recipe for disaster, it's a cookbook for someone looking to prepare a twelve course fucking catastrophe.

I have no notes. There is going to be some absolutely incredible goalpost-moving over the next five years — unlike crypto, the vague, amorphous “AI” space will be able to declare victory in any number of ways even if the most visible applications never become practical or production-viable. “But Nate, AI is everywhere now!” is a thing you will definitely be able to say without lying in 2026, but also a thing you could have said in 2016 before the market discovered thirsty chatbots and mass-laundering of intellectual property.

AI'll Believe It When I See It

As someone who’s been deep (trapped, often) in the Apple ecosystem since 1987, it’s very important to me that the company not… ruin everything, basically. Then again, one of the reasons I’m still here is that Apple 2.0 has been surprisingly good at maintaining the basic customer experience even as they became far, far too large to punk rock their way through things like “should we comply with the request of this lucrative market’s authoritarian regime”.

Being a big public company in 2024 does not usually allow you to prioritize “wisdom". I get it.

As the Generative AI Hype Bubble Spectacular reaches it’s eye-rolling stage — the part where everyone knows how this movie is going to end except the investor class that’s too deep in it now to get out — Apple has apparently assessed the terrain and decided what it’s going to do with all of this stuff. 

  1. Throw in commodity transformer text replacement into the operating system level (i.e., shorten this, make it “friendly”, etc., basically everyone’s AI-app from early 2023)
  2. Bake some image generation into a few low-stakes areas (chats, emojis, etc.)
  3. Give you a HILARIOUSLY walled off integration with ChatGPT where it literally asks you if you want to send this stuff to OpenAI every single time
  4. Use an on-device LLM to theoretically make Siri less stupid when it comes to listening 
  5. Invest in a whole bunch of non-LLM stuff at the operating system level to allow apps to give Siri the necessary context to be less stupid when it comes to doing stuff

The first three are very real things that I don’t care about at all, and will probably never use except to troll my friends once or twice a year. The fourth one is a win unless it somehow makes things worse, but talking to Siri is already like talking to an old person who doesn’t speak English very well so that seems unlikely. 

The fifth is such a massive, fundamental effort that has so little to do with the kinds of innovations OpenAI, Anthropic, etc. have put into the world, it might as well be an entirely different company/product/industry. Throwing all this under the roof of “AI” is so meaningless and self-deluding I don’t even know where to begin. 

Anyways, the net impact on me as a consumer is… low. The obvious shareholder-appeasement cruft (ChatGPT integration, image generation) is pretty easy to ignore, and Apple’s been pretty good at not shoving stuff like this in my face as long as it’s not an opportunity to sell me one of their services. This isn’t one, and in fact, might even cost them cloud compute sometimes for no revenue, so I feel pretty good they’ll leave me alone. I am most certainly not upgrading any of the (alarmingly numerous) Apple hardware products in my home for any of this, though. I’ll do that at the same rate I always do, because generative nonsense aside, these products continue to marginally improve in generally positive ways. 

Will this make other people upgrade more quickly? I kinda doubt it. Is that the intent? Honestly I kind of doubt that, too — Apple might be just another stupid, next-quarter-minded 2024 corporation like everyone else, but at the same time… they aren’t. They’re the king of the mountain, they print money, and their executives are long-term Apple people shareholders have never been very good at dethroning. So I think they threw those guys a bone (AI! ChatGPT!) in the most non-destructive way possible, and then went on to promote a vision of “intelligence” that is much more inline with what they want to do (the Siri as a real assistant model), but is probably still well outside of their ability to deliver. 

Good Things - Bad Things = The Things

This is a pretty incredible look at (among other things) how their best player being such a massive defensive liability is just killing the Dallas Mavericks, whether casual fans are able to see it or not.

I’ve absolutely played on recreational teams with this problem, where our best scorer and most obviously talented guy was pretty clearly the reason we lost. And I’ve seen in it non-basketball scenarios as well, like incredible sales closers who put up big numbers but suck the life out the rest of the teams, hurt our brand, etc. 

The real question for Luka is… is he willing to be different? Can he make himself valuable without the ball in his hands, or because he’s less talented in those areas, and excellence is harder to achieve as a result, is that just off the table and everyone else needs to somehow mitigate it?

Instagram: Now With More, Worse Ads

I’ve worked almost entirely in B2B (or B2B2C) software, so I’ve never had the now borderline cliche experience of working on a free application that starts off being exactly what people want, but is unprofitable, and then needs to be made incrementally worse — forever — first just to break even, and then eventually to grow profits ad infinitum.

At least when you just increase your prices, you can try to provide some additional value (as long as it costs less to provide than the size of the price increase) and wave your hands a lot and hope people accept the tradeoff. But with this, Instagram is just… worse. It’s not even debatable — the business makes tons and tons of money doing what it does, but if the product was worse it could make more. So they made it worse.

Writing user communications for this kind of thing seems like it would be absolutely soul-crushing. 

Someone Else Further Down the Stack

I mentioned this when I first saw it, but I just cannot get over this ridiculous interview with the CEO of Zoom. Somehow, it manages to simultaneously highlight pretty much all of the major things that are bothering me as I careen into my grumpiest, middle-ag-iest years. It features an incredibly successful (and presumably rich) entrepreneur who sounds completely insane, and utterly high on his own supply. It’s about a company that is extraordinarily pervasive in our professional life — Zoom, dammit! — and yet seems obviously, visibly disinterested in the actual thing that causes us to use them. And finally, it’s got my personal favorite: an ambitious, potentially impossible value proposition for the future that makes absolutely no sense and logically collapses with even the most cursory investigation.

I’ve been working at startups for a long time, and many, many times me and/or my colleagues have made the “giant bong rip” hand motion as we’ve listened to someone visionary explain what they’d like to be doing instead of what we actually do. This is not new to me. But at the same time, it’s also why I’m so hard on my career — I often convince myself that the companies I’ve worked for are less sophisticated or impressive than you might think because they’ve said completely insane things like this, and presumably real companies with real interest in what they’re doing and a firm grasp of what it is would not say those things.

But… here we are. Zoom Communications has a market cap of eighteen and a half billion dollars, and the guy running it unveiled one of the craziest, impractical, and most nonsensical product visions I’ve ever heard to a leading publication without even really being asked about it. He just… said it out loud for no real reason. And it’s fine! The stock is fine. Presumably Zoom still works, maintained and operated by competent subordinates of this man with totally crazy, horrible, unfeasible ideas about what meetings should be like and what would happen if a bunch of large language models added themselves to them and babbled uncontrollably at each other.

Still, that’s not what bothers me the most, or at least what bothers me in a fundamental way that reminds me of so many other things that bother me. For that, you have to go to this section.

NILAY PATEL, The Verge: When you say the hallucination problem will be solved, I am thinking about this literally in terms of Moore’s law because it’s the closest parallel that I can think of to how other CEOs talk to me about AI. I don’t think you spend a lot of time thinking about transistor density on chips. I’m guessing you don’t just assume that Intel and Nvidia and TSMC and all the rest will figure out how to increase transistor density on chips, and Moore’s law will come along, and the chips will be more powerful and you can build more applications. Just correct me if I’m wrong. I’m guessing you—

ERIC YUAN, Zoom: No, you’re so right. Absolutely. This is a technology stack. You have to count on so many others.

NP: So is the AI model hallucination problem down there in the stack, or are you investing in making sure that the rate of hallucinations goes down?

EY: I think solving the AI hallucination problem — I think that’ll be fixed.

NP: But I guess my question is by who? Is it by you, or is it somewhere down the stack?

EY: It’s someone down the stack. 

NP: Okay.

EY: I think either from the chip level or from the LLM itself. However, we are more at the application level: how to make sure to level the AI to improve the application experience, create some innovative feature set, and also, at the same time, how to make sure to support customized personalized LLM as well. That is our work. I mean… pardon my French, but… holy shit. This guy is talking about re-centering a successful, eighteen billion dollar video conferencing company entirely around a technology that (a) doesn’t work reliably, (b) may never work reliably, and (c) is completely outside of his control. It’s like Ford announcing that all their cars are going to run on peanut oil, and just saying “eh, I’m pretty sure Exxon can figure it out. Or maybe Penzoil, I dunno."

LLMs having no understanding of what they’re spitting out, but using pattern recognition to make it kinda-sorta hard to figure out exactly when they are wrong — that’s the whole game right now. That is everything when it comes to making this technology, and all the things people are extrapolating from it, worth literally anything at all. Yuan is excited by the “AI” summaries of meetings. Great! Neat! That is an extremely niche feature with, potentially, some real value, which is why he’s not focusing on it but instead using it as an example of how close he is to allowing people to building virtual, digital doubles who speak, argue, and make decisions on your behalf. The second thing is a much, much bigger thing — a world changing thing, honestly — but it should also go without saying that it is infinitely more complicated and difficult to execute since a computer connected to actual, operational actions simply cannot be wrong the way a computer spitting out text for some bored office drone to skim can be. It’s questionable whether present, best-in-class levels of LLM accuracy are acceptable for even the corporate-virtue-signaling email writing tasks they’re starting to be pointed at now. It is not questionable at all that those levels of accuracy, or even significantly improved ones, are totally unacceptable for authorizing a purchase, or even scheduling a follow-up meeting.

I’m sure it’s a lot of fun to envision interesting product scenarios that sit on top of a magical, accurate, Jarvis-from-Iron-Man-like artificial intelligence apparatus with a reasonably priced API sticking out the back. But it’s not “product management”, or business strategy, or really anything more sophisticated than a couple of stoned college guys try to process the ending of “Her” in 2013. The hard part is building Jarvis, not fantasizing about all the cool things Jarvis could do if he existed. We had all kinds of fun concept fantasies and Dick Tracy watch scenarios floating around in our heads going back to the 1970s (or earlier!), but none of them really meant anything until Apple built us an iPhone to run those applications. And honestly, this feels even more egregious, like if somebody saw a rotary phone and started talking about his idea for Pokemon Go.

The Hologram Isn’t The Hard Part, or the Important Part

The largely forgettable movie “I Robot” was randomly on cable the other night, and I watched the beginning for a while, occasionally looking over at my vacuum and giggling. There’s a scene where the dead guy Will Smith is investigating has left behind this sort of interactive hologram, and Will Smith asks it all these questions. He gets some answers, but every once in a while it says something to the effect of “I’m sorry, I can only answer questions that I’ve been programmed to answer”. Which… makes total sense! This thing is important, and was left behind to help a police officer solve a murder, for God’s sake. I love imagining an LLM-powered version of this, answering correctly 92% of the time, but never admitting it didn’t know an answer and just making plausible sounding stuff up the other 8% of the time. “Sure, I was murdered. It was a band of criminals, seeking my money. Robbery gone wrong, you know? How else can I help you?"

This is all a long-winded, oft-made argument that whatever we decide to call AI — giant if-then statements attached to holograms, probability models, whatever — is not going to fulfill the dreams of the Silicon Valley elite unless either (a) it’s basically right all the time, or (b) it has an excellent grasp of whether it’s right about something and it’s at least right about that basically all the time. Again, this is the ball game right now. If you want to launder stock photos and generate spam sales outreach, maybe do some code suggestion, you’re good. Grab your API key and see what the market will bear for your probability driven idea. But if you think we’re going to automate like… actual people? Who make decisions? Who are held accountable for those decisions? First of all, you gotta figure out if LLMs can even do this, and it’s not looking great right now. And then, if not, you’ve got to invent something else.

Nope! That’s “someone down the stack”. Maybe it’s the chip! Maybe the chip will make large language models turn into… something else? Something better, and also fundamentally different. Chips do that all the time, right? Or maybe we’ll get a transparent, visible decision making engine from an LLM provider, even though no language model works like that because they literally add randomness to make interactions feel more interesting and human-like at the expense of predictability and exactitude.

Look, I’ve clearly had it with this LLM nonsense, and that’s in no small part because it stunk to high heaven from day one, if I’m being honest. And it might feel like I’m an ideologue on this, but I’m really not —  I’ve done the reasonable thing and admitted where the utility may lie. I’ve even built test applications with this stuff. I have an OpenAI developer account, for crying out loud.

But this is some of the worst, most red-flag waving magical thinking I’ve seen from tech in my entire life, and we just sat through crypto! Apple is frantically trying to get away from having to buy freaking cellular modems from Qualcomm because that apparently limits their ability to implement their medium-term vision for iPhones, a product that exists and is real and has literally changed the world. Meanwhile, Zoom and the rest of these guys are just standing around, taking their huge, imaginary bong rips (or real ones, I don’t know, I’m not there) and waiting — just waiting! — for some band of machine learning elves to make it all possible. And when they do, Zoom will be there, leveraging this fantasy technology for the dumbest, most impractical purposes you can think of.

Disclosure: I have a pretty broad 401k managed by someone else so, God help me, I probably own some Zoom stock. 

Dirty Basketball

When assessing the “dirty” aspect of a basketball play, a good but non-all-encompassing question to ask is “if I did this in a pickup game, would someone fight me”. The play in question one hundred percent qualifies, not because it’s so physically egregious (it’s not), but because it’s such an obvious cheap shot (the ball isn’t even in bounds!) that it’s clear the aggressor wanted everyone to know it was a cheap shot. 

This is not “I am a tougher basketball player than you”, this is “I can do whatever I want to you”. And look, I get that a lot of people are horrified by the Matt Barnes-es of the world imploring for some extra-legal, on-court revenge justice. I’m usually not into that stuff either, to be honest. But that’s only when the powers that be are making a real effort to regulate what’s happening to people on the court. If somebody goes after one of my best players, after the play, the league needs to throw him or her out of the game, period. Otherwise, the 12th man is coming out and putting the aggressor into the basket stanchion on the next play, and the league can sort all that out instead.

Zoom Delusion

I don't know a polite way to say it, but the CEO of Zoom sounds like he's completely lost his mind. You should read this whole Verge interview to experience his bizarre, dystopian, AI-double fantasy for yourself, but also to witness the perfect example of zero-accountability AI-fueled investment hype, pictured here:

"It's someone down the stack." That's the most revealing quote I've heard in a while about today's AI hype.

Anti-Social Media

Quitting social media over the last five years has been a net positive for me, but I do miss having a place for quick observations and small rants. Turns out it's not the audience that does it for me, it's just the therapeutic exercise of documentation. Crazy, huh?

Anyways, I'm adding a feed here for short things like that, and we'll see how it goes. This also gives me an excuse to try hooking something up to ActivityPub.