@futurebird Studio Ghibli Controversy?

Things my husband didn't know:

* what is grok(in the context of X)
* That OpenAI used to be non-profit
* What Studio Ghibli is.
* The Studio Ghibli Controversy
* What "Training Data" are

Thought "everyone" knew this stuff. That's *my* bubble I get it.

He's very up to date on news, just not this.

Nonetheless his IT department keeps asking them to "learn copilot" so they can "be more efficient" everyone hates it. (Is Microsoft doing something to make IT departments do this all over the place?)

@futurebird They're making us learn copilot as work as well. I hate it say it but it has made my job easier and more bearable the more I automate.

@futurebird

Grok will always be from Stranger In a Strange Land, and no nazi-bastard-created chatbot will take it from me.

@futurebird I'm pretty sure that MS *is* doing that. Their hearts-and-minds people go around offering all sorts of funding and free licenses as the lure, with an apparently reasonable hook attached, like "use this language and toolchain exclusively for all of your output". It's a small step from there to "use Copilot everywhere; and we *will* be checking your usage stats".

I've been in the meetings where they make these offers you can't refuse. I come out wanting a long shower and strong soap.

Things my husband didn't know:

* what is grok(in the context of X)
* That OpenAI used to be non-profit
* What Studio Ghibli is.
* The Studio Ghibli Controversy
* What "Training Data" are

Thought "everyone" knew this stuff. That's *my* bubble I get it.

He's very up to date on news, just not this.

Nonetheless his IT department keeps asking them to "learn copilot" so they can "be more efficient" everyone hates it. (Is Microsoft doing something to make IT departments do this all over the place?)

In other "non-computer obsessed people" AI news I had a big breakthrough with my mom. She has been writing these self-published books with the local historical society about the Civil War graves in the Pittsburgh area. I think it's great. Books like that don't get much attention but someday some historian will cry tears of joy that they exist. Otherwise the information will vanish.

But she said she was using chat GPT to help.

I kind of lost it.

1/

I wrote her this long (probably too passionate note) about how it would "sand away" her voice. What's the point of making your writing sound exactly like everyone else?

My mom is a mathematician and not really into writing. So, I can understand the appeal. "It just makes the sentences sound like they're supposed to"

It makes the sentences sound boring. And the topic is already boring enough.

Anyway she's come around I think to writing. And I'm offering to help edit. 2/2

@futurebird Has OpenAI made a profit?

@imp3tuz

OK but how do they make the IT departments in various companies and agencies and schools all start nagging everyone in the same way?

Do they give them nagging lessons and call it "training" or something?

@futurebird @imp3tuz

They start by making the bonuses if MS sales droids entirely dependent on their AI upsells. Get someone to increase their number of M365 seats by 20%? No bonus. Get them to move to a Copilot++ subscription? Big bonus. Need to almost 100% discount the product to shift it? No problem, lock people in now and exploit them later.

To get their bonuses, the sales droids need a narrative that makes people move to the AI thing. All of your competitors are buying it and seeing a 10% reduction in costs! They're shipping twice as fast! Oh, sorry, I can't give you details, they're covered by NDA (and you wouldn't want me to give your competitors details about you, would you?) but trust me bro, they're all seeing huge productivity wins.

So now some decision maker had been persuaded to buy this nonsense. Now their reputation is on the line. If it improves things, yay! They're a visionary! They led the AI transition at the organisation! Leadership! But what if it doesn't work? Not possible, they're a leader. If you're not seeing a productivity boost, it can't possibly because some snake-oil salesdroid sold them a lemon it must be because you are using it wrong.

And, helpfully, Microsoft added dashboard things so you can see who is using Copilot and his much. Not seeing a big productivity win? Just go to the dashboard and see who isn't using it. It must be their fault. Pressure them to use it more. You'll see big wins! And you must see them, because otherwise you have to admit that you were scammed.

Because then I have a best friend who keeps saying things like "chatGPT said that he didn't think ..."

There is no "he"
There is no "think"
There probably isn't even a "said"

I feel like I'm fighting a multi-front war.

This new tech has not been explained to "the general public" well. This reminds me of the early days of the internet when everyone was so scared of it... only now they aren't scared enough... in the right ways if that makes sense.

@graydon
I've been in the room when people decided to drop tens of millions on absolute 'brick' McKinsey consultants, just to get a voice of 'authority' in the room.
That's when I learned that even highly domain-specific VPs are desperate for the deniability that comes with consulting a third-party or Key Opinion Leader (KOL)

I think @graydon hit it on the nose with the urge to ask the oracle about every little thing.

@futurebird

@futurebird "and from the cave of oracles"

People _love_ having an oracle, a divine voice. It frees them from responsibility and produces something that possesses both intimacy and authority.

Our eusociality is mediated by our constructions of authority; the AI movement as we have it is a push to own the construction of authority and thus society, and it's entirely on purpose.

Assuming there are survivors, in a hundred years there either won't be facts or there will be some new authority.

@graydon
I was hoping that by this point non technical users would have hit the reliability wall with this tech and realized that it isn't as accurate as their smartest friend, but maybe that's not true.

I have a theory that we haven't seen the vendors attach an Alexa voice to these systems, because hearing a mistruth hits people differently than reading one.

Although it's funny to tally who the pronoun split each direction for. Almost everyone in tech uses "it" or rarely "she"
@futurebird

@futurebird Studio Ghibli Controversy?

@dnavinci
my experience is that most users aren't reading past the "you're absolutely right!" before they share their oracles entrails. quite often the actual pronouncement is more nuanced and subtle, but they dont get beyond the initial praise and therefore learn nothing.

assumption is that this by design...

@graydon @futurebird

@graydon
I was hoping that by this point non technical users would have hit the reliability wall with this tech and realized that it isn't as accurate as their smartest friend, but maybe that's not true.

I have a theory that we haven't seen the vendors attach an Alexa voice to these systems, because hearing a mistruth hits people differently than reading one.

Although it's funny to tally who the pronoun split each direction for. Almost everyone in tech uses "it" or rarely "she"
@futurebird

@dnavinci @graydon @futurebird Anyone using "she" for an LLM immediately raises a huge red flag for me.

I had a colleague I was working on a proposal with insist forcefully that all the robots in his lab were "she". It was weird and a little creepy, and so I asked about it.

(Another female colleague's robots were all "she" because they were named after female science fiction writers. Themed names are common.)

Instead of some rational, theme-related reason, he said "Because with the amount of time I spend in the lab, they'd better be!"

I pointed out that that was gross and offensive. He asked why, and I explained that he was implying that women are things and that it's not okay for him to emphasize their gender to me, a woman, since it is effectively saying that in his mind I rank at the same level as a robot in his lab.

He couldn't get over being called out and refused to work on the proposal with me.

Ick.

@jon_ellis
They significantly turned this praise down when they initially released gpt5. I had front row seats to a lot of peoples' fawning chatbot waifus suddenly turning into significantly more scolding (but correct) shrews.
Sometimes I like to warm my dark little heart by reading all their wounded, disappointed reviews back in August.

So yes, I agree that this was definitely by design.
@graydon @futurebird