Month: March 2025

Gemini hackers can deliver more potent attacks with a helping hand from… Gemini

Hacking LLMs has always been more art than science. A new attack on Gemini could change that.

In the growing canon of AI security, the indirect prompt injection has emerged as the most powerful means for attackers to hack large language models such as OpenAI’s GPT-3 and GPT-4 or Microsoft’s Copilot. By exploiting a model's inability to distinguish between, on the one hand, developer-defined prompts and, on the other, text in external content LLMs interact with, indirect prompt injections are remarkably effective at invoking harmful or otherwise unintended actions. Examples include divulging end users’ confidential contacts or emails and delivering falsified answers that have the potential to corrupt the integrity of important calculations.

Despite the power of prompt injections, attackers face a fundamental challenge in using them: The inner workings of so-called closed-weights models such as GPT, Anthropic’s Claude, and Google’s Gemini are closely held secrets. Developers of such proprietary platforms tightly restrict access to the underlying code and training data that make them work and, in the process, make them black boxes to external users. As a result, devising working prompt injections requires labor- and time-intensive trial and error through redundant manual effort.

Algorithmically generated hacks

For the first time, academic researchers have devised a means to create computer-generated prompt injections against Gemini that have much higher success rates than manually crafted ones. The new method abuses fine-tuning, a feature offered by some closed-weights models for training them to work on large amounts of private or specialized data, such as a law firm’s legal case files, patient files or research managed by a medical facility, or architectural blueprints. Google makes its fine-tuning for Gemini’s API available free of charge.

Read full article

Comments

Rocket Report: Stoke is stoked; sovereignty is the buzzword in Europe

“The idea that we will be able to do it through America … I think is very, very doubtful.”

Welcome to Edition 7.37 of the Rocket Report! It's been interesting to watch how quickly European officials have embraced ensuring they have a space launch capability independent of other countries. A few years ago, European government satellites regularly launched on Russian Soyuz rockets, and more recently on SpaceX Falcon 9 rockets from the United States. Russia is now non grata in European government circles, and the Trump administration is widening the trans-Atlantic rift. European leaders have cited the Trump administration and its close association with Elon Musk, CEO of SpaceX, as prime reasons to support sovereign access to space, a capability currently offered only by Arianespace. If European nations can reform how they treat their commercial space companies, there's enough ambition, know-how, and money in Europe to foster a competitive launch industry.

As always, we welcome reader submissions. If you don't want to miss an issue, please subscribe using the box below (the form will not appear on AMP-enabled versions of the site). Each report will include information on small-, medium-, and heavy-lift rockets as well as a quick look ahead at the next three launches on the calendar.

Isar Aerospace aims for weekend launch. A German startup named Isar Aerospace is will try to launch its first rocket Saturday, aiming to become the first in a wave of new European launch companies to reach orbit, Ars reports. The Spectrum rocket consists of two stages, stands about 92 feet (28 meters) tall, and can haul payloads up to 1 metric ton (2,200 pounds) into low-Earth orbit. Based in Munich, Isar was founded by three university graduate students in 2018. Isar scrubbed a launch attempt Monday due to unfavorable winds at the launch site in Norway.

Read full article

Comments