MIT Researchers Used GPT-6 Astra To Edit Qwen’s Open Weights Directly, Boosting Math Scores

An anonymous reader quotes a report from VentureBeat: Researchers from the Massachusetts Institute of Technology (MIT) Computer Science & Artificial Intelligence Laboratory (CSAIL) reported today that they used OpenAI’s GPT-6 Astra language model to raise a small, open source Qwen model’s math score roughly sixfold by directly editing its weights — the numerical parameters that govern its behavior. Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab described their work in a research blog post published November 2. They call the approach “weight-space programming” and tested Astra’s ability to interpret and alter networks without using conventional training procedures to generate the edits.

In the strongest language-model example, Astra’s intervention raised Qwen3.5-0.8B’s MATH-500 score from 7.9% to 48.1% while touching approximately 0.016% of its weights. The improvement came primarily from correcting repetitive reasoning—a distinction that shaped both the technical findings and the debate over their implications. Their experiments explored a broader possibility: AI systems that inspect, repair and construct other neural networks by working directly on their internal machinery. “This is cool as heck!” wrote Yuchen Jin, a technical staffer at Databricks and former co-founder and CTO of Hyperbolic Labs who was unaffiliated with the research, on X. “Imagine using a large LLM to directly edit a smaller model’s weights and dramatically improve its capabilities. It’s like gene editing for neural networks. Even cooler than distillation!”

Voyage AI staff researcher Chandan Singh, formerly of Microsoft AI, also reacted to the findings: “For anyone questioning whether this post is overhyped, I think they are actually *underselling* the approach.”


Read more of this story at Slashdot.

Fedora Linux 45 released

Fedora Linux
45
has been released. This includes all editions: Fedora Workstation, Fedora KDE Plasma Desktop, Fedora Server, Fedora Cloud, Fedora CoreOS, and Fedora IoT, as well as the Atomic Desktops and Spins.

This release adds support for installation
on Stratis storage
using Anaconda or Kickstart installs, retires
unmaintained VPN plugins
for NetworkManager, and updates Fedora’s desktop
environments, developer toolchains, and system packages. See the Fedora wiki
ChangeSet page
for a list of major changes.

Beyond screens: Mercedes-Benz’s new holographic heads-up display

Do screens in cars represent luxury? Judging by the latest car interiors, the answer would seem to be an emphatic “yes.” Screens aren’t just getting larger; they are multiplying across the dashboard and morphing into different forms and concepts. Indeed, an interior’s screens are a pretty good indicator of what brand made the car—or at least how much the owner paid for it.

But is this actually what customers want? Are more screens really better? And even if they are, luxury car features inevitably trickle down to cheaper, more mainstream offerings, and screens can only get so big. That leaves luxury automakers with another question to answer: “What’s next?”

Mercedes-Benz is working on a new display alternative that could provide an answer. For now, it’s known as the holographic display. Forget the images from Star Trek and Star Wars that just popped into your head, though. It’s effectively a more advanced form of heads-up display, or HUD.

Read full article

Comments

The Out of Touch Adults’ Guide to Kid Culture: What Does ‘Code Rot’ Mean?

This week’s Out-of-Touch guide takes a look at a phenomena that’s probably going to define the lives of generations of young people: Code rot—both actual computer-style code rot, and the more elusive cultural kind. I’m also taking a look at the fake controversy over the “cancellation” of Freddy Krueger, and finally, bringing things home with viral videos of boyfriends dancing.

What does “code rot” mean?

Expect to hear young people talking about code rot for awhile, maybe for the rest of their lives. It’s a concept that’s going to affect them more than any previous generation. Code rot, or software rot, describes what happens to a computer program when the hardware and operating system it runs on advance. If older programs aren’t updated, they become less stable and glitchy until they eventually become unusable.

The idea of code rot has really caught on in the young people’s popular imagination, probably because they’re going to spend a lot of their lives dealing with it. They’ve even taken the idea of code rot into life, and use the phrase to describe anything that is worn out or malfunctioning. If the ice cream machine isn’t working at McDonald’s, it’s code rotted. Bad grades on a report card? Code rot.

Kids are making videos where they demonstrate actual code rot:

or point out physical things that are code rotted, like a cat:

or their school:

Interestingly, a lot of the online discourse around code rotting concerns the massive video game platform Roblox. Because Roblox games there are made by users, there’s often not a lot of incentive for the creators to keep the games current with the platform’s changes, so a lot of Gen Z’s childhood memories of playing games are sinking into code rot. Here’s a video about it:

Another interesting wrinkle is the tone these videos take. Code rot is seen as apocalyptic. While it’s mostly hyperbole, I think part of it is the realization that the entire world is code rotted. The old programs that used to run within the “Western Culture” operating system no longer apply and everything is starting to glitch out.

What does “PDF file” mean?

The meaning of “PDF file” depends on the context. If you’re at work, it refers to a Portable Document Format file, a format created by Adobe that is famously hard for older people to open. In slang, though, PDF file is algo speak for “pedophile.” Because that word is flagged by moderation software online, people say “PDF File” to skirt the censorship.

Why was Freddy Krueger (supposedly) canceled?

The run-up to Halloween brought a lot of online discourse about Nightmare on Elm Street villain Freddy Krueger. The supernatural serial murder/PDF File was supposedly cancelled online by overly woke, Gen-Z Tiktokers outraged that he is a child predator. The controversy started with a post from Entertainment Industry Reporter that points out how strange it is that in the ’80s and ’90s, Freddy Krueger, depicted in 1984’s A Nightmare on Elm Street as a child murderer so driven by bloodlust he transcended death, was featured on dolls, board games, and lunchboxes aimed at children. It’s a good point, but not a call for “cancellation.”

Although the article does say that “Freddy Krueger lunchboxes shouldn’t exist,” and that parents “shouldn’t have been buying their kids action figures of a child murderer,” this is not a call to action. It’s not suggesting cancellation of any kind, and it’s hard to even conceive of what cancellation of a fictional character in an old horror franchise would even mean. The article is actually an observation about how merchandising (and low-quality sequels) change the meaning of art. But people online missed the point entirely and invented a scenario where “woke” young people are calling for the cancellations of a fictional villain for doing bad things.

I’ve been scouring TikTok, looking for even one video where someone is calling for “canceling” Freddy Krueger, and I can’t find any, but there are hundreds, maybe thousands of videos like this:

In these videos, people point out how enraging it is that the woke people are calling for Krueger’s cancellation and vowing that they won’t let it happen. Even though it is not happening. There are even levels to the myths about woke mobs canceling Freddy. Supposedly, younger users were unaware that Krueger is depicted as a “PDF file” as well as a murderer in the 2010 reboot of the franchise, so there are online arguments about whether that’s the reason he’s being canceled. Even though no one is canceling anything. These anti-woke folks are, ironically, defending a fictional villain from cancellation by creating another fictional villain, the shadowy woke mob that’s ruining horror movies. Meanwhile, the real villain is a lack of media literacy. Saying “wow, it’s crazy that previous generations made a comedy mascot of such a terrible character and marketed him to children” is not the same as cancellation.

Viral videos of the week: My boyfriend is a diva

This week’s viral videos are of boyfriends dancing. The newest thing on the TikTok is young women sharing video of their boyfriends getting down accompanied by a clip from the song “gay alligations fr. my girlfriend” by TikToker OH MICKEY. Like this:

or like this:

It’s a simple, silly template that maybe doesn’t mean a whole lot, but this generation of young men are so messed up when it comes to relationships and masculinity, I’m always happy when a meme becomes popular that indicates that young women want goofy dudes, dudes who know how to dance, and dudes who act silly as boyfriends more than they want red-pilled, manosphere, looksmaxxing types. I don’t know if these kinds of messages ever really “break through” to the underground of internet incels, but I like to hope they do, because a lot of young men are not OK.

Meta’s Quest 2 Era is Coming to a Close as Support Winds Down Next Year

Meta announced it’s finally sunsetting Quest 2 and Quest Pro, which are slated to receive their final OS update early next year.

Meta VR Glasses is coming next spring, so the company announced it’s pruning HorizonOS development to finally move away from the Quest 2 and Quest Pro hardware.

In a developer blog post, Meta says feature development for Quest 2 and Quest Pro will end with v213, which reaches all Quest 2 and Quest Pro devices by March 2027. As the final OS release, v213 is also the last supported SDK version for these devices.

Moving forward, new OS features, platform capabilities, and APIs released after v213 will only be available on Quest 3, Quest 3S, and newer devices, Meta says. Notably, Quest 2 and Quest Pro were discontinued in 2024.

Based on images courtesy Meta

Quest 2 and Quest Pro will receive security patches and critical bug fixes through the end of 2027. New apps that support Quest 2 or Quest Pro will no longer be accepted after December 2027 however. New titles can still launch on Quest 3, Quest 3S, and newer devices, but they just won’t be offered on Quest 2 or Quest Pro, Meta says.

Still, existing apps supporting both can get bug fixes, content drops, and seasonal events. Cross-play multiplayer also doesn’t have a clear end date either.

Released in 2020, Quest 2 was one of the best-selling consumer VR headsets to date, having sold an estimated 20 million units over its lifetime. Since launch, Quest 2 was also the principal driver Quest Store revenue, with Meta announcing in 2023 the ecosystem had then topped $2 billion in revenue.

In 2022, Meta announced it was releasing its next headset, Quest Pro, which included eye-tracking, a more capable Qualcomm Snapdragon XR2+ chipset, double Quest 2’s 6GB RAM, pancake lenses, and full color passthrough for mixed reality gameplay.

Despite its advancement over Quest 2, Quest Pro struggled to find a compelling use for its new mixed reality capabilities. Coming in at $1,500 at launch was also widely seen as a major obstacle for adoption, essentially relegating it to an expensive developer kit.

To Meta’s credit, the company eventually reduced the price of Quest Pro to $1,000 a year later—the same year Meta released Quest 3, which sported many of Quest Pro’s most impressive features at about half the price, making it the obvious choice for consumers and developers alike.

The post Meta’s Quest 2 Era is Coming to a Close as Support Winds Down Next Year appeared first on Road to VR.