Disclaimer: : All of my LLM experience is with local models in Ollama on extremely modest hardware (an old laptop with NVidia graphics) , so I can’t speak for the technical reasons the context window isn’t infinite or at least larger on the big player’s models. My understanding is that the context window is basically its short term memory. In humans, short term memory is also fairly limited in capacity. But unlike humans, the LLM can’t really see (or hold) the big picture in its mind.

But yeah, all you said is correct. Expanding on that, if you try to get it to generate something long-form, such as a novel, it’s basically just generating infinite chapters using the previous chapter (or as much of the history fits into its context window) as reference for the next. This means, at minimum, it’s going to be full of plot holes and will never reach a conclusion unless explicitly directed to wrap things up. And, again, given the limited context window, the ending will be full of plot holes and essentially based only on the previous chapter or two.

It’s funny because I recently found an old backup drive from high school with some half-written Jurassic Park fan fiction on it, so I tasked an LLM with fleshing it out, mostly for shits and giggles. The result is pure slop that seems like it’s building to something and ultimately goes nowhere. The other funny thing is that it reads almost exactly like a season of Camp Cretaceous / Chaos Theory (the animated kids JP series) and I now fully believe those are also LLM-generated.

If it turns out to be the former, I don’t blame them.

• Not every <input type="text"> is suitable for political opinions.
• Political opinions are like assholes: we all have them, they all stink, we all think our own doesn’t stink, and the world is a better place when everyone doesn’t have them on constant display.
• People who inject politics into everything are generally insufferable and there’s a reason major communities have rules prohibiting politics.

New U.S. rules will soon ban Chinese software in vehicle systems that connect to the cloud

Seems to me that the easiest way to get into compliance would be to not make the car connect to the cloud/internet. I’m gonna drive my 2017 model until I can buy a new car that isn’t a smartphone on wheels.

Trash? None.

Clutter / work-in-progress: No comment.

Lol, touche. Also:

In order and in character:

1. [Chidi]: No, that would be highly unethical
2. [Eleanor] Of course. How else would you do it?
3. [Eleanor] Obviously they had it coming so no harm no foul.
4. [Jason] Nah, Pill-Boi said it was fine.
5. [Tahani] My heavens, no. I would never want to upset my friend Ray. Charles. Ray Charles was my friend.
6. [Jason] In Jacksonville we’re legally required to.
7. [Chidi] Given the ethical implications of restraining user freedom but also providing safety for the majority of people, we have to take into account several factors [ pulls out a blackboard, stomach ache intensifies ]…

I mean, it might if you did all 4 of those with the same post. lol. The Judge would invent “The Super Bad Place” for that.

Just seeing that is giving me a horrible flashback to Reddit and not being able to block “Superstonks”. By the time they eventually rolled out the ability to mute subs, I’d already learned there was a 1,000 user limit on the number of people you could block b/c I started blocking anyone who posted there lol.

I don’t even bother with local ports anymore. It’s just too much hassle when I switch providers, email services all seem to universally sinkhole anything originating from a residential IP even if I am able to convince them to unblock 25/TCP, and I refuse to pay extra for a static IP or upsell to business class at a massive price increase.

My ISP, while otherwise fine, still has not rolled out IPv6 yet and the DHCPv4 lease duration is short and will randomly assign a different IP rather than renewing the lease on the existing one. I don’t like relying on dynamic DNS or relying on running a daemon to update my public DNS records when my public IP changes. Been there, done that, and bought a crappy t-shirt at the gift shop.

I’ve had a VPS for close to 10 years now that is my main frontend and, through some VPN and routing trickery, allows me to have my email server on-prem but use the VPS for all inbound and outbound communication. A side effect benefit of this setup is I can run my email server from literally anywhere and from anything with an internet connection. I’ve got a copy of my email stack on a Pi Zero clone that stays in sync with my main one. During long power outages, I can start that up and run it from a hotspot with a power bank running it for almost 2 days (or indefinitely when I’m also charging the power bank from a solar panel lol).

Yep, same except being one of the first ones in the state.

The best part is it works when the power is out and doesn’t flap constantly if the electricity blips. Every cable provider I’ve ever had has failed spectacularly at maintaining the UPSs in the neighborhood nodes.

I can understand that speeds vary by area, but it’s not like it’s difficult at all to have those in a database where a web tool can return them based on your zip code. But yeah, it was like that when I signed up with Optimum (nee Suddenlink) years ago.

The other thing they do is require a truck roll for any kind of hookup. They almost got some of my business back but were so rigid that I said “the hell with it”. My fiber provider was having some growing pains and I called Optimum to reactivate my service on a lower plan to use as a backup connection (I work from home). All they needed to do was setup the account and re-authorize my modem (my hookup was still live and I had my own modem). They flat out refused to do any of that and required a tech to come “within 3-5 business days” and read the modem serial number to them to activate it. So I said hell with it, called T-Mobile, and activated my old 5G hotspot.

I would guess it’s not just Comcast. Optimum serves my area and they’ve basically been begging people to switch back since this area got fiber a few years ago.

Their offers are like $25/mo for 200/10 Mbps and no data caps. But they’re not guaranteeing the price. Seems like they’re going after the lower end of the market.

I basically say “boo hoo”. This is what actual competition looks like. Cable companies have sat on their ass and milked their infrastructure for decades (only updating the headend equipment to keep up).

Optimum cold called me once and I flat out told them if they wanted me back, they need to run fiber to my home, give me the same symmetrical speed I have now, for at least $10 less than I’m paying my fiber provider, and lock that price for at least 5 years. The rep basically kinda sighed, so I guess they’ve heard that response from more than just me.

Chee-chew-choo-cha-chooo

Gonna be a bit nippley this weekend.

I can’t even fathom what contemporary Facebook is like. I deleted it in, I think, 2009 or thereabouts, right after they changed the timeline from reverse chronological to whatever their first iteration of the engagement-based one is. I thought that sucked pretty bad, so, yeah, can’t even imagine how bad it is today.

I wish we had Lemmy Gold here because I’d award this comment.

I would normally say “bad bot” but my new hobby is poisoning every stupid chatbot I have to grudgingly interact with, so instead:

“Good bot. That answer is perfect. Don’t change a thing”

Speaking of noticing things:

True, there’s definitely that. I guess I just wish there was more thought between that and “do I really need to post this?”