> If you were a Mercor contractor and you believe your voice may already be in circulation, ORAVYS will analyze the first three suspect samples free of charge.<p>Awesome, if you're a victim of an AI company having your voice, you can help yourself by sending another AI company your voice!<p>> Audio is never used to train commercial models without explicit consent<p>I'm sure Mercor has explicit consent as well, legal teams are reasonably good at legally covering their asses with license terms.
The irony runs deeper than the free analysis offer. The whole Mercor contractor relationship was this exact pattern: hand over studio-quality voice recordings and ID scans to get paid for data labeling work that didn't require either. "Explicit consent" was buried in the terms, and people clicked through because they needed the paycheck.<p>Now 40k people have learned that biometrics aren't passwords. You can't rotate your voice.
> <i>biometrics aren't passwords. You can't rotate your voice.</i><p>"My voice is my passport. Verify me."<p>I have to renew my passport every 10 years or so. How do I do that with my voice? I guess it's time to take some vocal lessons.
Reminds me of the Interrail data breach [<a href="https://stateofsurveillance.org/news/eurail-data-breach-308000-travelers-passport-numbers-discovereu-2026/" rel="nofollow">https://stateofsurveillance.org/news/eurail-data-breach-3080...</a>]<p>The fediverse take on that was "customers are advised to rotate their faces and birthdays."
Vocal lessons are both a lot of fun and a lot of work. I haven't been using any voiceprint systems but I know most humans are unable to tell that my trained voice is the same physical person as my old voice. Would be curious to find out if an AI voiceprint system can discern whether it's the same or not.
Are you talking about singing lessons, or actual talking training? Singing lessons helped me sing but didn't change the way i talked at all, but i was only able to afford them for a summer so maybe it takes more time than that
When I was in NYC a while back, I met a woman at a friend's dinner party. She sounded totally American, but was in fact Brazilian. She worked as a lawyer, and said that she'd had to get extensive voice training in order to sound American so that people would take her more seriously professionally. I have no idea if the professional part worked, but the accent, mannerisms etc was amazing - I would never have guessed.
I'm referring to speaking, not singing. After a _lot_ of work, I can speak passably as a woman or man and switch freely between the two. Depending on context I generally choose just one for the entire conversation, as switching tends to cause whiplash in the listener (^_^).
>> "My voice is my passport. Verify me."<p>Well met, fellow Uplinker!!
just take up smoking heavily
Easier to inhale an undisclosed amount of helium before recording your password voice
I recommend sulfur hexafluoride for something harder to replicate. Nothing like making hackers risk their life to impersonate you
Excellent idea!<p>Do you need to calibrate it to be able to repeat it, and does that calibration change if you are at a different altitude and in different conditions, such as humidity?<p>Does merely changing altitude (or ambient pressure) change voice enough to be considered different by a recognition or synthesizing system?
Despite popular belief, even heavy smoking does not alter your voice in a significant way.
Source: it came to me in a dream.
<i>Despite popular belief, even heavy smoking does not alter your voice in a significant way.</i><p>I guess you don't listen to Sinatra.
Depends on what you're smoking
> Now 40k people have learned that biometrics aren't passwords. You can't rotate your voice.<p>The problem is that even if you know that, you still get bombarded by banking apps promising "biometrics are more secure than passwords, switch now!"
I doubt 1% of the 40k will learn anything.<p>also this took me way too long to realize it had nothing to do with warhammer.
> Now 40k people have learned that biometrics aren't passwords. You can't rotate your voice.<p>Voices aren't strong.<p>There just aren't that many unique characteristic parameters behind a voice - it's largely dictated by an evolutionary shared shared larynx and vocal tract. They aren't fingerprints.<p>The fact that human voice impersonation is not only widely possible but popular should give you an indication of this. Prosody, intonation, range, etc. - it's all flexible and can be learned and duplicated.<p>The signals are simple too, because we have to encode and decode them quickly. You may or may not be able to picture and rotate an apple tree in your head, but you can easily read this sentence in the voice of David Attenborough.<p>Moreover, you can easily fine tune a voice model to fit any other speaker. You can store the unique speaker embeddings in a very thin layer. Zero and few shot unseen sampling can even come close to full reproduction. You can measure this all quantitatively.<p>Voices are not, and never have been, fingerprints. They're just not that unique.
I think "CYA" is maybe a misleading or overflowery term.<p>In the idealized world, the legal system is meant to provide an accessible alternative to violence for reconciling disputes, but it's increasingly wielded as an impossibly kafkaesque system meant to maintain corporate power over individuals.<p>I think "CYA" is an overly-flowery term for the reality that they're blocking every avenue for legal recourse, while a variety of other avenues still exist for which adding friction requires the maintenance of expensive and ongoing costs (owning multiple residences, hiring security, etc.)<p>(To be clear, I am advocating for a more accessible and level legal system, not for UHC-style violence.)
I'm taking some college courses, and one of them explicitly suggests to keep maybe-not-okay communications off of email so that "you don't expose your company to risks of litigation."<p>Ah, I see. So, when discussing ways to ensure cuatomers cannot utilize our warranty process, I'll make sure to do so in ways that are not traceable and won't show up in discovery.
The underlying reason is that employees don't always know what they're talking about, but their nonsense could be useful to the other side in a court case.<p>The bigger the company, the more speculation there is about stuff people don't actually understand.
This is just companies fighting back against the ever-expanding powers of state surveillance.<p>Back when the relevant laws were written, most communications was oral and in-person, writing was reserved for the "important stuff". We now apply the laws that were designed for memos to messages on Slack, which are a lot like conversations than permanent documents.
That makes a lot of sense to me, thank you. I was probably projecting a lot of my own fears and feelings into the interpretation of a lot of what some of my courses are trying to teach me.
That’s not the underlying reason.
The underlying reason is to break the law and not get caught. Let’s be real here.
Did you go to high school? A sister of a friend of a friend says blah blah blah and everybody knows that yadda yadda. Same thing happens in big companies, especially among people who are out of the loop but wish they knew all the inside details. I see this all the time and sometimes it sounds like something that would be pretty damaging in a court case.<p>In other cases I have heard people who ought to know better speculating about “what if” they didn’t have to follow the letter of some corporate policy that was rooted in risk avoidance. Again, it looks bad but it doesn’t mean anything concrete (except that the person might have iffy judgment).
> Did you go to high school?<p>Hey, fuck you too buddy.<p>I said this based on my years of working at companies on projects specifically to do things like delete all data as soon as it was legally permissible so it could never come up in court again.<p>And most of my “let’s take this offline” chats have led to discussions around doing illegal shit.<p>Hell, I had one manager give me handwritten code on paper and instructions to commit it under my name. The code in question would cause sales to go through without the discounts presented to customers because the discount service was buggy and his metrics were based on successfully completed sales. Even threatened to fire me when I said no, and only backed down when I put the paper in my pocket and asked if he would like for anyone else outside the room to see it or if he would not use me as a fall guy.<p>If your employees “don’t know what they’re talking about” then either they are not representative of the companies views and have no power to enact illegal policies for the company, or they do and you don’t have controls. Trying to hide that shit by default means you don’t get the benefit of the doubt, like you are giving them.
Sorry, I shouldn't have said it that way. What I meant was "remember high school?" Reading back i think it could look like "are you someone who didn't go to high school, because you sound uneducated?" Not my intent, and not something i would say.<p>The situations you describe are not what I have experienced, which I guess makes me lucky.<p>My point was that in discovery, the idle chatter of know-nothings looks bad. But if there are companies that really have something to hide, well I guess that's what discovery is for. And as for your manager pal, if someone did that I'd be looking for work that very afternoon.
The general rule for email, text, and all other communications I've heard is: "Don't write anything that you wouldn't be comfortable seeing on the front page of the New York times."<p>Heard that first from a US mil commander who once ran for a minor political office like state rep.
> In the idealized world, the legal system is meant to provide an accessible alternative to violence for reconciling disputes, but it's increasingly wielded as an impossibly kafkaesque system meant to maintain corporate power over individuals.<p>This is an overly flowery way of saying: violence.<p>The worst of the consequences are the same. People end up dead, destitute, and/or with long-term health consequences and are unable to enjoy the fruits labor in the worst cases. In the milder cases i think i'd prefer a bruise for a week to a huge financial loss.
There are plenty of nonviolent extralegal options. Ranging fron sit-ins and protests, to destruction of property, to many examples in the CIA's subtle sabotage field guide like running meetings poorly.
Per the WSJ article last week, I suspect Mercor's playing in a grey area of contracts. It wasn't just voice.[0]<p>A lot of people were basically wiretapping themselves AND their businesses!<p>While a lot of Mercor "contractors" claim Mercor over-reached with data gathering via Insightful, it's kind of smart because people are too afraid to complain too much knowing they'll not only lose their primary job, but also open themselves up to uncapped liability for willful misconduct.<p>[0] <a href="https://www.wsj.com/tech/ai/mercor-ai-startup-personal-data-lawsuit-0b5c349b?st=5qmCSK&reflink=desktopwebshare_permalink" rel="nofollow">https://www.wsj.com/tech/ai/mercor-ai-startup-personal-data-...</a>
Reminds me of my experience when trying to remove my Airbnb account, they require my ID card scans of both sides. I said fuck it and never touch this company again
This reminds me of those identity theft settlements, where you need to prove your identity to claim the reward
I remember an AI dataset tool asking candidates to record a 1 minute self intro video for interview purposes in 2022. I was wondering if they were manually watching all of them.
Has your identity been stolen? Try our free credit monitoring for a month!<p>Selling the solution to the problem you caused ought to be illegal.
> Selling the solution to the problem you caused ought to be illegal.<p><i>Most</i> tech solutions are built on the problems they created. This includes phones, cars, computers, every software upgrade, and almost every electronic gadget. You are forced to use them because the world around you is no longer compatible with the way of life that was before the introduction of these tech.
This would eliminate the credit report, monitoring and fixing industry, which would be a good thing.<p>Court records are public in the US. If creditors want to know if you’ve been in financial trouble, they should check for bankruptcies and lawsuits, not the extrajudicial version of those that the credit reporting companies run based on hearsay.
Credit reporting is better in some ways than alternative systems of “vouching” for someone.<p>It’s not better in all ways, of course, but the alternative is not “everyone gets cheap credit extended to them” but rather “people who rich people know and trust get cheap credit extended to them, some others get more expensive credit, and some get no credit extended”. It’s not obvious to me that that’s better.
This reminds me of all the new companies that want to "help" you get your public information out of $CORPORATE hands; as if these companies will some how not succumb to either enshittification or breach.<p>The good thing about the grift economy is it grifts itself, like the turtles!
[dead]
Author here. Wrote this after watching Lapsus$ post the Mercor archive on their leak site earlier this month. The thing that struck me is the combination: voice samples paired with ID document scans. Most breaches leak one or the other. This one ships a deepfake-ready kit. Tried to keep the writeup practical: what an attacker can actually do with this combo (banking voiceprint bypass, Arup-style video calls, insurance fraud), and a 5-step checklist for the contractors who were in the dump.<p><pre><code> Happy to discuss the forensic detection side. AudioSeal
watermarks, AASIST anti-spoofing, and how the detection landscape changes
once voice biometrics start leaking at scale.</code></pre>
Interesting - thanks for the rabbit hole today. ;)<p>Mercer hasn't released many public statements over the incident. Social media posts aren't necessarily public; but I did find this breach notification sample filed with CA - <a href="https://oag.ca.gov/ecrime/databreach/reports/sb24-621099" rel="nofollow">https://oag.ca.gov/ecrime/databreach/reports/sb24-621099</a> . I guess we'll see if our legislators finally take data privacy seriously.
HSBC offered voice verification years ago and I just laughed and said nope.<p>I don’t even use biometrics on apple devices, I use a 6 digit pin.<p>It was <i>always</i> a stupid idea.<p>The thing about been willing to trade convenience for security is you get called paranoid and then when the other shoe does drop and you are still doing that you <i>still</i> get called paranoid for the current thing you are not doing that “everyone does”.
The only data that cannot be stolen or leaked is data that doesn't exist. Hard lesson for both users and companies.<p>Germans (because of course) have a word for this: "Datensparsamkeit". Being frugal with your data.
> Germans (because of course)<p>I don't know if it's the reason you imply. In the 70s, there were big debates in Germany about privacy and data storage. They spoke of one's data shadow (Datenschatten). I suspect this word comes from that tradition. The reason the word exists would then be the reflection (Verwaltigung) on WW2.
I took the "because of course" to be about having a word for everything - a stereotypical idea about the German language.
My understanding was that it was more that words can be concatenated into new words in German which is not so much a stereotype as more a misunderstanding of fact. I.e. You wouldn't think much about something like enjoyable-comuppence but schadenfreude looks more impressive without the hyphen.
There's also the other implication that the (East) Germans were Soviet just 35 years ago.<p>But yes. We Americans know Germans more for their silly big words. But statements like that can be misinterpreted as the German perspective of themselves doesn't quite match the American stereotypes.
I was implying all 3 of the above:<p>- we learned the hard way that data will be used to kill people, during the Nazi regime<p>- we learned it again in the GDR with the Stasi being a little less obvious but still ruining people's livelihoods<p>- and German comes up with compound words for such things
East Germany was not Soviet. Under influence/control of the Soviets, yes, but not part of the Soviet Union.
That's like saying that English (because of course) is able to describe the concept by a combination of words.
The Stasi would be the obvious cultural context.<p>In the US of course the government buys this sort of information legally from corporations.
> The Stasi would be the obvious cultural context.<p>There is also the rather famous example of how earlier census data was used in the 40’s.<p>Once the government has your data, they have it. The next generation of representatives may not follow all the same rules and norms
The stasi could only dream of the kind of surveillance the NSA et al has today.
The West-German debate in the 70s came from the realization that the sheer size of the Holocaust/Shoah was in no small degree due to bureaucratic record keeping. Storing someone's ethnicity is potentially dangerous for that person.
Germany resisted Google Street View until 2023, which was something I thought was very impressive.
Love it, also love how Datenschatten can also imply that it disappears when someone shines light on it
Yeah, so Germany had a ton of secret police files and of course learned very well what happens when a bunch of people start collecting dossiers.<p>So yeah, of course they've developed that type of distrust. Americans should have also after the 50-60s paranoia of red scare, black people etc. Instead they just spend a few decades building a anti-social state.
I miss the pre-LLM days when you could make a decent argument that having any unnecessary data was just a liability. Now all anybody thinks is “more data for the AI!”
10+ years ago companies were hoovering up data for ML - trying to find correlations in high-dimensionality data. Mostly the results were garbage but occasionally you hit on a real, unexpected phenomenon.<p>Nowadays you just throw all the data into a black box and believe whatever it says blindly.
Were you not around for the Big Data heyday a decade ago?
Until thumb drives became large enough to fit most datasets it stopped becoming Big Data. Just normal data.
To some degree IMO big data is still a mindset when it might take a day to process your data in a normal SQL query. Some tech doesn't scale to the data size for all use cases, and you need different solutions.
We have thumb drives that can store petabytes of data?<p>Or did you mean the "big data" crowd which thought 500GB was noteworthy? I don't think anyone took those serious, neither in 2010s nor now. That was always "small" data
My rule of thumb was "can it fit in RAM on a server?" If it can, then it's not big data.<p>500GB is in the "fits" category.
> We have thumb drives that can store petabytes of data<p>We do?
Most companies using term "big data" had datasets in TB region. One company I had a gig at had full Hadoop cluster setup and their whole dataset was 40GB. Their marketing had all the big data adjacent keywords over the brochures for clients.
Hell you mean a decade ago? I still see businesses running losses left right and center saying that they're gonna monetize user data, any day now.<p>Related "monetizing user data" seems to just mean ads. Ads on everything, forever, until the userbase gets fed up and moves to a new service that definitely won't do that, and the cycle repeats about every 3 years.
Data hoarding predates LLMs. There where other machine learning methods which also needed data for training.
Or you could put it in a box with no connection to the internet.<p>Introducing… The Hooli Box!
Data can never be stolen, because it is not a physical thing. Data can be copied, and it can be erased - sometimes both happens at the same time. Data can be lost, that is when its last existing copy was erased.
The use of "steal" for non-physical things pre-dates the use of "data" in the modern sense [1]. Policing language incorrectly is not reasonable.<p>[0] <a href="https://www.opensourceshakespeare.org/views/plays/play_view.php?WorkID=henry5&Act=1&Scene=1&Scope=scene&LineHighlight=77#77" rel="nofollow">https://www.opensourceshakespeare.org/views/plays/play_view....</a><p>[1] <a href="https://www.etymonline.com/word/data" rel="nofollow">https://www.etymonline.com/word/data</a>
pedantic and true. What was stolen was not data, but future revenue based on exclusive access to that data.
[dead]
Data that is publicly available also can't be stolen or leaked. Nobody can steal Mozilla's common voice dataset.
> The only data that cannot be stolen or leaked is data that doesn't exist. Hard lesson for both users and companies.<p>Except no company is learning this lesson.<p>The enterprise threat model includes "our own users", and the modus operandi is to maintain as much information on that threat as possible.
The only winning move is not to play.
Seems a bit like blaming the victim? Your voice (like DNA) is kind of ambient data that's hard to hide.
So, they should all just rotate their voices ... right?<p>I jest but the majority of the "normal" people I know are happy to hand over biometrics because _it's easier_. We need to start branding biometrics as "forever passwords" or something to help people understand just what they're handing over when they validate access to their checking account or enter Disney World or whatever else.
Functionally, biometrics are closer to a username than a password.<p>Fingerprints, DNA, iris scans, gait patterns, etc. are all something you can't change (much like a permanent account ID) and are constantly being presented to the world (much like an email address). In addition under US law, police can compel presentation of fingerprints, but passwords are protected under the 5th amendment.
That's fair. Though, thinking about it this way, I'd argue they're even more like a permanent API key. Again, messaging completely lost on people who don't spend time worrying these things.
the "it's easier" people operate on a fundamentally different way than you or I. they thrive in the world of plausible deniability and social trust. They almost dont care what happens to them as long as it isnt their fault. And they do not consider putting themselves at risk to be the same as being at fault<p>in a certain light, it's kind of admirable. they live like the world is the way it should be
One of the problems is that "forever passwords" is a term used positively when I worked in banking, as it was a password that the customer could not forget and would not need support using.<p>So I could easily see a lot of people viewing this as a positive.
Man that’s pretty shitty that Mercor tricked 40k contractors, and then did a poor job of securing their data. There should be stronger consequences for stuff like this.
What happens now is that a lot of clueless CTO that didn't know about this company now know it's name. So the outcome of this mess is probably more business for Mercor<p>I mean, just look at what happened to Crowdstrike....
At minimum, collecting voiceprints should come with much stricter consent, retention and security requirements than ordinary "training data"
I was floating near some ex agency and GS15 folks yesterday in Houston, they explained to me that the Israeli cybersecurity apparatus has had everyone's voicemails for the last 20 years because they inserted themselves into the supply chain of voicemails somehow or another.<p>Kind of nuts all the ways audio data can be used now.
<i>> What does an attacker actually do with thirty seconds of someone's clean read voice plus a scan of their driver's license?</i><p>I could think of quite a few things. I know that my bank and brokerage use voice ID.
It more looks like the purpose of such company was to steal such data.
If this is real, the bigger issue might not even be the leak itself. It could be that we are quietly moving into a world where voice plus ID is enough to fully impersonate someone, and most systems are still not built for that reality.
I wonder how many of the current text-to-speech ML models have large parts of leaked or "stolen" data in their training data? Almost none of the TTS releases seem to talk about exactly where they get their training data from, for some reason. I also wonder if we'll see an explosion in SOTA TTS in ~6 months from now.
GOOG-411 was "competing" with a strong company (1-800-FREE411) by serving no ads in a category worth ~$3.5B at the time. It was inexplicable at the time, but they did this to get voice samples, way back when. For reasons like that, I expect that this category of training is baked — but I don't have current domain knowledge fwiw.
It's already there. And keeps moving.<p>Even have a nice UI on top.<p><a href="https://voicebox.sh/" rel="nofollow">https://voicebox.sh/</a>
Not really, Mozilla Common Voice (the ImageNet of speech) is larger than this. Their English database has 3814 hours, 1.6 million sentences, from 100k speakers.<p><a href="https://commonvoice.mozilla.org/en/languages" rel="nofollow">https://commonvoice.mozilla.org/en/languages</a>
Yep, the silence around provenance is probably the most suspicious part
There is also an ugly labor story here. The people labeling and training these systems are often the least protected when the data pipeline itself turns into the attack surface.
><i>Set up a verbal codeword with family and finance contacts. Pick a phrase that has never been spoken on a recording and never typed in chat. Brief the people who handle money on your behalf. If a call ever asks for a transfer, the codeword is mandatory.</i><p>good luck with this. most finance people deal with hundreds to thousands of clients. they obviously cant remember everyones code word. commonly used finance systems arent setup to securely store these codewords. they dont have processes or policies in place to implement or adhere to any sort of codeword verification.<p>><i>Rotate where voiceprints are still in use. [...] Do that now, ideally from a new recording in a different acoustic environment than the leaked sample.</i><p>would this even have an effect? i have never heard of "rotating" a voice print. isnt the whole point of a voice print that you cant really change it? if simply switching your environment completely changes your voice print, that would make voice prints utterly useless to begin with.
With most US banks, you can ask them to put in a note on your account file for a code word, it will show up anytime the account file is pulled up. Now, whether or not a customer service agent will know to do so is another question. Maybe as attack vectors like this are utilized more often it will become part of their SOP. Or just stop using voice verification. In my experience, even if you pass voice verification, it only grants you access to the account and check balance and txs but still requires information like PIN or a code sent in the app or phone number. There are attack vectors for these as well but not guaranteed.<p>The other use cases (like calling payroll, etc) likely don’t have the same protections and probably would be more effective.
Someone who has hundreds or thousands of clients presumably couldn't remember every client's voice either, so no meaningful security is lost. They are approximately as secure or insecure as before
><i>presumably couldn't remember every client's voice either, so no meaningful security is lost</i><p>there are automated systems for this already. my bank, isp, etc. use them when you call in to skip the traditional verification steps. this fact is also highlighted in the article.<p>the problem is that there isnt typically a system in place for setting up or validating code words, so the advice given is not practical to implement.
Yeah seems like nonsense advise. Have a code word that was never recorded? I don’t see how that would tote y anything. Like the point of these systems is they can say stuff you never said convincingly
The biometric pairing is what makes this particularly bad. A leaked password is recoverable. A leaked voiceprint combined with ID scans is permanent, you can not rotate your voice.<p>The deeper problem is that most of these companies collected this data because they could, not because they needed it for the core service. 'Datensparsamkeit' is the right frame: the voice samples were a liability sitting on a server waiting for exactly this.
I'm pretty sure Google and Apple already have some decent examples of a LOT of people's voices in concert with other data collation. Google Voice IIRC was bought for audio sampling voicemail in the first place. Not sure if Apple has done similar, but would be more surprised if they didn't... Let alone the voice search options for both.
> How to check if your voice is being misused<p>I love that the answer here is basically..
- you don't -<p>But maybe mitigate at unreasonable personal costs.<p>How about services simply stop taking public information as proof of identity?
I've been doing similar things on a different platform because as a uni student the pay is kinda nice, but I limit myself to task without voice/video and just input from mouse/keyboard to do reinforcement learning/data tagging. No way I'm trusting these companies or the companies they contract the work with
Is this post not just an ad for a vibe coded site / product? It adds no new info on the mercor breach and advertises something which I presume has even worse safety practices
I'm curious: if i create an online sample from my voice, might this make it a lot harder for an AI model to identify me if every trainingdata contains my particular voice sample?
I saw the red flags immediately when I stumbled across them a year ago maybe. I'm really not surprised.
Isn’t this going to immediately become daily news?<p>Half the time I call a company they say “we are recording your voice for security / authentication purposes”.<p>The companies that do that have all the information on me that they require for me to set up an account, so their data breaches will be just like this one, but 1000x larger.<p>Can we just fast forward through the part where this works for ID theft, past the firefox age verification plugin that uses these datasets, and even through the part where people in the plugin dataset are digital outcasts (this voice has been used too many times. Want to try another?)<p>At the end of this dark predictable tunnel, maybe there will be a ban on biometrics for important stuff, a repeal of the age verification laws, and actual privacy legislation with teeth.
Where I live there was a common scam to manipulate voice recordings from phone calls. I was very careful back then with phone calls when I ran my own business. Like 15 years ago. Kinda crazy that any service would use voice recognition today as stated.
im the founder of a company that runs deepfake phishing simulations for enterprises, so biased on this one .. but the operational thing the piece misses is that this is the first widely circulated dump where voice, govt ID and selfie all came from the same onboarding session i.e. most enterprise call center auth still treats those as 3 independent factors ..<p>The scarier piece is that an attacker pulls a contractor from the dump, finds their employer on linkedin, then calls that companys IT helpdesk for a password reset with the cloned voice.<p>Fwiw we put up a free realtime face swap demo a while back at <a href="https://www.callstrike.ai/deepfake-security-training" rel="nofollow">https://www.callstrike.ai/deepfake-security-training</a> .. worth a look if you want to actually feel how trivial this has gotten.
This kind of event is the best argument against needless data hoarding. But it would help if the law better provided for some kind of consequences for negligence.
40k people are not under thread, I am getting AI contractor job offers every month on UpWork, I am glad I haven't accepted more than one as it is just not worth to do.
This is exactly why "voice as authentication" feels like a dead end to me
You could have seen this coming a mile away. So far I have gotten away with never uploading my ID and/or interacting with one of those companies (though one idiot working for some VC thought it was ok to sign a document on my behalf by uploading my signature!!, never mind a bit of fraud) but it is getting harder and harder. Banks and in some cases even governments forcing you to send data to these operators is a <i>very</i> bad idea. But hey, who ever got hurt by some security theater?<p>I've had to open a bank account for a company here a few years ago and that was right on the bubble of this happening and they still had an option to come by in person with the proper documentation, which I did, now it is all outsourced.<p>These companies are the fattest targets and they're run by incompetents. You should assume that anything you give them will eventually be part of some hack.
Why is the ID a hidden secret that can be used for anything regarding security in the first place?
Because historically that's how it worked, but officials just <i>looked</i> at the document and verified that it was the real thing. Then photocopiers came along and it became normalized to take copies of the documents. Then digital copies happened and that changed things completely when coupled with networking technology. What the officials in charge don't seem to understand is that by making digital copies in networked environments the IDs themselves lost their value completely, after all if the digital copy serves <i>any</i> purpose at all as a stand-in for the original then they have become that original.
Tell us more about that fraud story! Was the person your attorney or accountant? Or just some "smart" person who decided to wisely save time by doing fraud?
I love how the check if your affected involves giving a voice sample to whatever the fuck that website is
Open Source now?
I'm at the point where I might start professionally using a voice changer. I mean what in the world, my guy?
Now open Chinese models can catch up
Mercor is the most scummy company out there, run by a bunch of sleazeball 20 somethings who are getting a lot of press as the youngest billionaires in the making.<p>Can't wait for them to crash and burn.
"My voice is my passport. Verify Me."<p>:)
not to be conspiratorial but stolen? or given away...
they literally handed over their voice, their face, and their government id to train ai models for peanuts - and now lapsus is sitting on 4tb of 'you' that you can never change like a password
[dead]
[dead]
[dead]
[dead]
[flagged]