In the work I have done with Claude over the past months, I have not learned to trust it for big things - if anything the opposite. It’s a great tool, but - to anthropomorphize - it’s “hallucination rate” is down there with my less trustworthy colleagues. Ask it to find all instances of X in this code base of 100 files of 1000 lines each… yeah, it seems to get bored or off-track quite a bit, misses obvious instances, finds a lot but misses too much to say it’s really done a thorough review. If you can get it to develop a “deterministic process” for you (shell script or program) and test that program, then that you can trust more, but when the LLM is in the loop it just isn’t all there all the time, and worse: it’ll do some really cool and powerful things 19/20 times, then when you think you can trust it it will screw up an identical sounding task horribly.

I was just messing around with it and I had it doing a files organization and commit process for me, was working pretty good for a couple of weeks, then one day it just screwed up and irretrievably deleted a bunch of new work. Luckily it was just 5 minutes of its own work, but still… that’s not a great result.

Agree, I’ve been using claude extensively for about a month, before that for little stuff for about 3 months. It is great at little stuff. It can whip out a program to do X in 5 minutes flat, as long as X doesn’t amount to more than about 1000 lines of code. Need a parser to sift through some crazy combination of logic in thousands of log files: Claude is your man for that job. Want to scan audio files to identify silence gaps and report how many are found? Again, Claude can write the program and generate the report for you in 5 minutes flat (plus whatever time the program takes to decode the audio…)

Need something more complex, nuanced, multi-faceted? Yeah, it is still easier to do most of the upper level design stuff yourself, but if you can build a system out of a bunch of little modules, AI is getting pretty good at writing the little modules.

If you install Microsoft Windows 11 AI edition on your PC and let these AI features run, you get what you deserve.

regardless of whether or not customers want it. They don’t have a say in the matter except the more tech savvy of them who will find ways to edge around the restrictions

The tech savvy will run Linux. They all (tech savvy or not) have a say in the matter. Even my non-tech savvy wife has been using an Ubuntu laptop, purchased direct from Dell, pre-configured by the factory with Ubuntu 22.04 for the past 3 years. I recently talked her off of her Samsung fetish into the slightly less evil Pixel line of phones. It’s a purchase and use decision. Walking away from Windows isn’t all that hard for most people, if they would just do it. Most are so bloody apathetic, they get what they deserve.

(Some) corporations are going to go hard for the AI in Windows on corporate IT managed machines because “magic free productivity fairy dust…” no, they don’t know how it works, or if it will work, or if it will be a bigger waste of time than the Solitaire app, but it’s new and a lot of corporations embrace the new simply based on Fear Of Missing Out.

The lock performs a singular function adequately enough for the risk involved for most people. And it does it passively.

The AI is not the same no matter how often or how hard you try to shoehorn it into your silly analogy.

Technology marches on, the world does get more complicated. Before we had metal keys that had to be made by keysmiths, there were more simple latches that people could open but most animals couldn’t. Metal keys introduced all kinds of complexity and inter-dependencies and failure modes, but generally we have adopted them as the preferred solution over a peg through two holes.

stop drinking the flavorade for five minutes and just think about the fact that people don’t want this

A lot of people do want it, I’m not saying that people who don’t want it should be forced to use it, far from that. But people have to start standing up for themselves when it comes to what tech they do and don’t allow into their lives. Nobody is making people wear smartwatches, or have smart-speaker(microphones) in their homes, and you’re not actually forced to use any particular desktop operating system either. Maybe your job forces you to use one for work, that’s why you get the paycheck - for doing what they want.

Microsoft is saying that they know it’s problematic but they are forcing it on people anyway.

Only the people who let themselves be forced. Our local dominant grocery chain started inflating their prices radically about 7 years ago, we have plenty of other stores around town, but over half are this dominant chain. I shopped in that chain my whole life, since my grandmother pushed me around in the cart, I stocked shelves in one during college, and it was our 95%+ source of food up until about 7 years ago. I finally had enough with the price abuse when they were about 30% higher than the competition, we stopped going there. They’re over 100% higher than the competition now in most prices and people STILL shop there in droves. Nobody is forcing them to, they’re volunteering to pay double to keep using their familiar grocery store.

I hope the world of desktop operating systems is different, but it’s probably not. People who put up with intrusive agents on their PCs doing things they don’t understand: get what they deserve.

the door lock is not doing anything of its own volition

Neither does an AI agent. You give it power (electricity), you give it access to your computer / phone, any cloud storage accounts you may have, local NAS, network connectivity. You do all these things just like you install a lock on a door, or don’t. Once the lock is installed and you leave the premises, you are trusting the lock to do what it does.

If you hand an AI your CC#, you get what you deserve.

If you hand an AI access to your hard drive and you store your CC# on your hard drive, you get what you deserve.

If you leave your door unlocked and the school bus lets a bunch of 14 year olds off by your house while you’re away, you get what you deserve.

If you install Microsoft Windows 11 AI edition on your PC and let these AI features run, you get what you deserve.

I have many “smart home” appliances and features. They do not: control things that make fire, control the lights on our staircase, control the house door locks. I give them such access as I trust them with. I do “overtrust” one with alarm clock features, and the morning our power went out at 4AM we overslept, just like would have happened if we used an old 1960s style electric alarm clock. You can go back to wind-up with bells, if you like, or you can accept that the modern world isn’t always more reliable than the older ways.

The AI LLM is doing stuff both of its own volition

The AI stuff I have been working with has an explicit switch: Agent mode vs Plan mode. In Agent mode it can (and frequently does) do all sorts of surprising things, some good, some bad. In Plan mode all it does is throw responses up on the screen for me to read, no modification of files on my system. I effectively ran in “Plan mode” for a few months, copy-pasting stuff by hand back and forth - it was still more useful than web-search, imperfect, annoyingly incorrect at times, but I was in “total control” over what got written to (and read from) files on my system. I’ve had Agent mode access for about 6 weeks now. All in all, Agent mode is 10x more productive. And I have never, ever, even slightly considered the thought of handing it my CC#, though I’m sure many people will, and eventually we’ll get a story about how one of these wonky agents ordered three lifetime supplies of Tide Pods on Amazon when it was asked to get some detergent.

A door lock can’t buy up Amazon’s entire stock of tide pods on my credit card.

But it can let in a burglar who can find your credit card inside and do the same. And why are you giving AI access to your CC#? You’d better post it here in a reply so I can keep it safe for you.

A door lock can’t turn on someone’s iot oven while they’re out of town.

But it can let in neighborhood children who will turn on your gas stove without lighting it while you’re out of town.

A door lock can’t publish every email some journalist has ever received to xitter.

True, the journalist, or his soon-to-be-ex-spouse, can “accidentally” do that themselves - and I suppose the ex-spouse who still has a copy of the key can “fool” the lock with that undisclosed copy of the key while the journalist is out having sushi with his mistress.

A mechanical door lock doesn’t hallucinate extra fingers, and draw them into all the family photos saved on a person’s hard drive.

I’ve worked with AI for a while now, it’s not going to up and hallucinate to do that - unless you ask it to do something related.

“Hey siri create me an e-commerce site”

You should try it. If your e-commerce site is simple with a lot of similar examples out in the wild to point at, I believe the latest agents actually can do such a thing. You’ll just have to give them access to your financial account details so the site can process payments to you, you understand? While that’s a joke, it’s also true. You need to be able to check what the AI has done to be sure it’s doing what you want.

I started working with AI in earnest a few weeks ago, I find myself constantly making the distinction between “deterministic” processes and AI driven things. What I’m mostly focused on is using AI to develop reliable deterministic processes (shell scripts, and more complex things) - because while it’s really super cool that I can ask an AI agent to “do a thing” and it just does what I want without being told all the details, it’s really super un-cool that the tenth time I ask it to do a very similar, even identical, thing it gets it wrong - sometimes horribly wrong: archive these files, oops I accidentally irretrievably deleted them.

without money involved

Without money involved the court system is useless. The whole point of legal action around contracts is to determine what happens when the agreements of contracts have been broken.

turn down the randomness to get more consistent outputs for simple tasks.

This is a tricky one… if you can define good success/failure criteria, then the randomness coupled with an accurate measure of success, is how “AI” like Alpha Go learns to win games, really really well.

In using AI to build computer programs and systems, if you have good tests for what “success” looks like, you’d rather have a fair amount of randomness in the algorithms trying to make things work because when they don’t and they fail, they end up stuck, out of ideas.

Mechanical key based door lock cylinders are “Agentic AI” - they decide whether or not to allow the tumbler to turn based on the key (code) inserted. They’re out there, in their billions around the world, deciding whether or not to allow people access through doorways WITHOUT HUMAN SUPERVISION!!! They can be easily hacked, they are not to be trusted!!! Furthermore, most key-lock users have no idea how the thing really works, they just stick the key in and try to turn it.

The whole legal/courts system is pretty dysfunctional at the low end of the economic spectrum (like: license fees that a group of 10s of developers might charge…) We have a shared well with our neighbor, put there by the previous owner of both properties. When he tried to sell to a previous potential buyer, they tried to hammer out a legal agreement around the shared well, and it just wasn’t feasible. The cost of anything approaching a legal agreement about sharing maintenance of the well cost more than putting in two new wells.

We didn’t want to control or manipulate people, using our code to extort a particular behavior out of them.

The FOSS community, and even the community of developers on single large FOSS projects, is large and diverse… The royal “We” doesn’t really apply at all, even in the case of Linus and the kernel - sure, he’s a clear leader, but he’s hardly in control of the larger community and their wants.

I think the current state of open source licensing is much as it should be… MIT has its place, as does GPL, and if we’re going to pretend that intellectual property is about protecting creators, then it’s the creators who should get to choose.

In the world I live in, intellectual property is a barrier to entry that’s primarily used by organizations with a lot of power (money) to prevent others from disturbing their plans of making more money. MIT seems most appropriate for individual creators to assure that that world doesn’t come crashing into their bedroom with CDOs and lawsuits. GPL is “cute” - but I think most practitioners of GPL licensing don’t have any clue how far out of their depth they are if they should ever seek actual enforcement of their self-declared license terms. That’s not to say GPL is toothless. It gives small players a tool to amplify the trouble they can make for those who would violate their license (primarily mode of violation being by use of the code so licensed.) But, other than making minor trouble for the bigger players, thus discouraging the bigger players from entangling with them, GPL isn’t going to “make” the bigger players do much of anything other than stay away.

GPL does shape the community, it has its effects, I just get tired of hearing about the specific immediate legal language of it, because that’s far from the actual effects it has.

Of course, shit-for-neighbors can make all kinds of trouble out of anything. I was thinking more along the lines of MIT free nuts, take 'em, eat 'em, sell 'em, just don’t sue me over 'em. As opposed to GPL “free nuts,” must be consumed on the property. If you take a dump while you’re here be sure to bury it at least 3" deep along with any TP used. Bring your own privacy screening.

In the corporate world, they have a lot to lose. So, they have lawyers - expensive lawyers - who, in theory, protect them from expensive lawsuits. One of the easiest ways to stay out of lawsuits over GPL and friends is to not use GPL software, so… that’s why it’s radioactive. Just having the parasitic lawyers review possible exposure is hellishly expensive, better to re-develop in-house than pay lawyers or even begin to think about the implications of entering into an agreement with a bunch of radical FOSS types.

It sucks, but it’s also how it is. Some corporations (like Intel) do heavily support and contribute to FOSS, when they feel like it.

GPL has certainly failed time and time again, openly in the case of FFmpeg and their clones all over Eastern Europe and elsewhere. FFmpeg made a lot of noise and resorted to “public shaming” mostly because the courts weren’t working for them. And they have a very visible product… so many GPL licensed things are lurking inside proprietary products where they’ll never be seen.

It’s like putting a license on COVID to prevent it from spreading… it just doesn’t work in the real world.

The point of all of this is that you really should, no matter what it is.

That’s like saying: I have a pecan orchard, I like my trees and I don’t mind if people collect the nuts as they walk by. Oh, but the point is: you really should, those are your nuts, you pay the taxes on the land, you care for the trees, YOU should be the one to sell them, not give them away to some randos passing by.

Yeah, sure. You do you.

without my consent or their assuredly begrudging reciprocation. This should not be controversial. The GPL accomplishes this

In legal theory. In corporate practice, MIT and similar “pushover” licensed software, especially FOSS libraries, is more readily adopted by corporate users - and through this adoption it is exercised, tested, bug reported - sometimes the corporate trolls even crawl out from under their rocks and publish bug fixes and extensions for it. By comparison, GPL stuff is radioactive, therefore less used.

Then we can talk about how successful you are likely to be in enforcing GPT on any large entity, particularly those in foreign countries.

I’m just wondering about basic functionality - can it play through without a crash or is it still Windows only for a smooth UX?

But, what’s the user experience playing the MYST humble bundle on it?

Had a friend who used to put his super-workstation laptop in his backpack. It would randomly turn itself back on and get HOT in there at times, like firestarter hot.