Cheap AI “video scraping” can now extract data from any screen recording

Researcher feeds screen recordings into Gemini to extract accurate information with ease.

Recently, AI researcher Simon Willison wanted to add up his charges from using a cloud service, but the payment values and dates he needed were scattered among a dozen separate emails. Inputting them manually would have been tedious, so he turned to a technique he calls "video scraping," which involves feeding a screen recording video into an AI model, similar to ChatGPT, for data extraction purposes.

What he discovered seems simple on its surface, but the quality of the result has deeper implications for the future of AI assistants, which may soon be able to see and interact with what we're doing on our computer screens.

"The other day I found myself needing to add up some numeric values that were scattered across twelve different emails," Willison wrote in a detailed post on his blog. He recorded a 35-second video scrolling through the relevant emails, then fed that video into Google's AI Studio tool, which allows people to experiment with several versions of Google's Gemini 1.5 Pro and Gemini 1.5 Flash AI models.

Read full article

Comments

The Sisterhood faces a powerful foe in Dune: Prophecy trailer

“I see the corruption in your heart the same way I see the blood trailing your every step.”

Dune: Prophecy will premiere on HBO and Max on November 17, 2024.

New York Comic-Con kicked off today and among the highlights was an HBO panel devoted to the platform's forthcoming new series, Dune: Prophecy—including the release of a two-and-a-half-minute trailer.

As previously reported, the series was announced in 2019, with director Denis Villeneuve serving as an executive producer and Alison Schapker (Alias, Fringe, Altered Carbon) serving as showrunner. It's a prequel series inspired by the novel Sisterhood of Dune, written by Brian Herbert and Kevin J. Anderson, exploring the origins of the Bene Gesserit.  The first season will have six episodes, and it's unclear how closely the series will adhere to the source material. Per the official premise:

Set 10,000 years before the ascension of Paul Atreides, Dune: Prophecy follows two Harkonnen sisters as they combat forces that threaten the future of humankind, and establish the fabled sect that will become known as the Bene Gesserit.

Emily Watson co-stars as Valya Harkonnen, leader of the Sisterhood, with Olivia Williams playing her sister, Tula Harkonnen. Mark Strong plays Emperor Javicco Corrino, while Jodhi May plays Empress Natalya, and Sarah-Sofie Boussnina plays Princess Ynez.

Read full article

Comments

Lilbits: Ploopy TrackPad is here, Intel Core 3 N350 is coming soon, and Winamp deletes its GitHub

Ploopy has been designing open source trackballs for the past five years, giving potential customers a choice between building their own or buying one that comes fully (or partially) assembled. Now the company has released a Ploopy TrackPad. It’s…

Ploopy has been designing open source trackballs for the past five years, giving potential customers a choice between building their own or buying one that comes fully (or partially) assembled. Now the company has released a Ploopy TrackPad. It’s available for purchase as a DIY kit for $100 Canadian (about $73 USD), or as a […]

The post Lilbits: Ploopy TrackPad is here, Intel Core 3 N350 is coming soon, and Winamp deletes its GitHub appeared first on Liliputing.

Redbox easily reverse-engineered to reveal customers’ names, zip codes, rentals

The bankrupt company may not see any consequences.

Since Redbox went bankrupt, many have wondered what will happen to those red kiosks and DVDs. Another question worth examining is: What will happen to all the data stored inside the Redboxes?

Redbox parent company Chicken Soup for the Soul filed for Chapter 7 bankruptcy in June and is in the process of liquidating its assets. Meanwhile, stores with Redboxes are eager to remove the obsolete hardware. And tinkerers have reported getting their hands on Redbox kiosks and doing all sorts of things with them, including running Doom.

But Redboxes falling into technologists' hands can also result in the uncovering of customer data from kiosks' hard drives. As spotted by Lowpass today, programmer and expert reverse engineer Foone Turing reported via Mastodon that she was able to retrieve records for 2,471 transactions from the disk image of a Redbox hard drive. Turing told Ars Technica that she got the image from a Discord channel:

Read full article

Comments

How the Malleus maleficarum fueled the witch trial craze

Invention of printing press, influence of nearby cities created perfect conditions for social contagion.

Between 1400 and 1775, a significant upsurge of witch trials swept across early-modern Europe, resulting in the execution of an estimated 40,000–60,000 accused witches. Historians and social scientists have long studied this period in hopes of learning more about how large-scale social changes occur. Some have pointed to the invention of the printing press and the publication of witch-hunting manuals—most notably the highly influential Malleus maleficarum—as a major factor, making it easier for the witch-hunting hysteria to spread across the continent.

The abrupt emergence of the craze and its rapid spread, resulting in a pronounced shift in social behaviors—namely, the often brutal persecution of suspected witches—is consistent with a theory of social change dubbed "ideational diffusion," according to a new paper published in the journal Theory and Society. There is the introduction of new ideas, reinforced by social networks, that eventually take root and lead to widespread behavioral changes in a society.

The authors had already been thinking about cultural change and the driving forces by which it occurs, including social contagion—especially large cultural shifts like the Reformation and the Counter-Reformation, for example. One co-author, Steve Pfaff, a sociologist at Chapman University, was working on a project about witch trials in Scotland and was particularly interested in the role the Malleus maleficarum might have played.

Read full article

Comments

US vaccinations fall again as more parents refuse lifesaving shots for kids

US becomes more vulnerable to outbreaks at vaccination rates fall into 92 percent range.

Measles, whopping cough, polio, tetanus—devastating and sometimes deadly diseases await comebacks in the US as more and more parents are declining routine childhood vaccines that have proved safe and effective.

The vaccination rates among kindergartners have fallen once again, dipping into the range of 92 percent in the 2023–2024 school year, down from about 93 percent the previous school year and 95 percent in 2019–2020. That's according to an analysis of the latest vaccination data published today by the Centers for Disease Control and Prevention.

The analysis also found that vaccination exemptions rose to an all-time high of 3.3 percent, up from 3 percent in the previous school year. The rise in exemptions is nearly entirely driven by non-medical exemptions—in other words, religious or philosophical exemptions. Only 0.2 percent of all vaccination exemptions are medically justified.

Read full article

Comments

Here’s how SIM swap in alleged bitcoin pump-and-dump scheme worked

False information posted to official SEC account caused spike in the currency.

US officials charged a man with compromising the official Twitter/X account of the Securities and Exchange Commission for purposes of posting false information that caused the price of bitcoin to spike.

The January attack, federal prosecutors said, started with a SIM swap, a form of fraud that takes control of a cell phone number by assuming the identity of the person the number belongs to. The attacker then uses the false identity to induce an employee of the cellular carrier to move the phone number off the current Subscriber Identity Module card, a small chip that connects a device to a specific carrier account. Then, the attacker has the number transferred to a new SIM card, usually under the pretense that the fraudulent account holder has just obtained a new device.

Not the SEC announcement you think it is

The number at issue in the SIM swap, an indictment unsealed on Thursday said, was used to provide two-factor authentication for the SEC X account, which authorized commission personnel to post official communications. One of the people connected to the conspiracy then used the 2FA code to compromise the X account to tweet false information that caused the price of a single bitcoin to increase by $1,000.

Read full article

Comments

Yuzuki Avaota-A1 is a $55 single-board PC with 8 ARM Cortex-A55 CPU cores and an embedded RISC-V core

The Yuzuki Avaota-A1 is a single-board PC that stands out for a few reasons. One is that it’s based on an entirely open source design – the board is now available for purchase for $55, but it was first introduced earlier this year, and you …

The Yuzuki Avaota-A1 is a single-board PC that stands out for a few reasons. One is that it’s based on an entirely open source design – the board is now available for purchase for $55, but it was first introduced earlier this year, and you can find schematics and documentation at the Avaota website. Another unusual […]

The post Yuzuki Avaota-A1 is a $55 single-board PC with 8 ARM Cortex-A55 CPU cores and an embedded RISC-V core appeared first on Liliputing.

It’s increasingly unlikely that humans will fly around the Moon next year

It’s not just Orion’s heat shield; the mission’s ground systems are running out of time.

Don't book your tickets for the launch of NASA's Artemis II mission next year just yet.

We have had reason to doubt the official September 2025 launch date for the mission, the first crewed flight into deep space in more than five decades, for a while now. This is principally because NASA is continuing to mull the implications of damage to the Orion spacecraft's heat shield from the Artemis I mission nearly two years ago.

However, it turns out that there are now other problems with holding to this date as well.

Read full article

Comments

Qualcomm discontinues Snapdragon Dev Kit mini PC, promises to refund orders

The Snapdragon Dev Kit for Windows is a mini PC with a Qualcomm Snapdragon X Elite (X1E-001DE) processor that went up for pre-order this summer for $899. Now, just a few months later, Qualcomm has pulled the plug on the little computer. According to Je…

The Snapdragon Dev Kit for Windows is a mini PC with a Qualcomm Snapdragon X Elite (X1E-001DE) processor that went up for pre-order this summer for $899. Now, just a few months later, Qualcomm has pulled the plug on the little computer. According to Jeff Geerling and xda-developers, customers who ordered one from Arrow Electronics are […]

The post Qualcomm discontinues Snapdragon Dev Kit mini PC, promises to refund orders appeared first on Liliputing.