If this weren’t Deutsche Bahn, I’d say it’s a cyber attack. Given that this is Deutsche Bahn, though, it may just as well be a maintenance issue.
That's what happens when you ignore critical infrastructure for three decades.<p>Of course, if the government were to correct the mistakes of the past, it would get worse for another decade. The necessary repairs would cause a lot more delays, and voters would then say "Were giving them so much extra money, and it gets worse? Unacceptable!". So I fear we'll continue to have these problems forever.
> <i>when you ignore critical infrastructure for three decades</i><p>To be fair, Deutsche Bahn is currently spending “€107bn between 2025 and 2029” on infrastructure upgrades [1].<p>[1] <a href="https://www.ft.com/content/db75e347-b13b-4753-8130-6301bb55c040?syn-25a6b1a6=1" rel="nofollow">https://www.ft.com/content/db75e347-b13b-4753-8130-6301bb55c...</a>
Though I think they are not spending it sustainably. There is one train line and one lightrail line between my city and the next big city. They want to do things to the train line, blocking it for half a friggin year, and they make that announcement as if they do not give a damn about anyone, who relies on that line. Everyone will have to squeeze into the lightrail trains, which take longer. Often whole carriages are mephitic and unusable, when certain people have made them their temporary homes.<p>If things were done with an eye to the future, we would see things like extra lines, so that when things need to be renewed/maintained train service is not completely and utterly fucked for half a year for thousands of people, who want or need to take the train for daily commute. It is in my eyes utterly ridiculous, that we rely on a single track and are fucked, when literally anything at all needs to be done. Instant 100% train service disruption. This is Deutsche Bahn reliability.<p>Of course that would cost more ... It's cost accumulated by decades of neglect, and now they don't want to spend that money on the citizen, but rather pay biiiig juicy bonuses for management levels at Deutsche Bahn. Predatory capitalism at its best.<p>And that's not all. Their software and app sucks ass too.
that could have been a lot cheaper of they would have spent in the past (their spending seems to have been very low)
They need to spend at least 3x that and they need to bring redundant workforce to fix Germany. It is completely broken now.
For DB, this type of outage is referred to as "Tuesday".
Probably someone forgot to renew the TLS certificate.
You may not be far off. Word is that it's a failed software update.
My 100 bucks are on an expired certificate in the trust chain. the same kind of issue that took down almost all Verifone payment terminals in Germany in 2022.
For context, in case people are less familiar with German politics:<p>DB is in a misbegotten state of privatization, started in the 90ies. The government spun it out into a private company but still owns 100% of it. They were trying to pump it up so they could sell it for good money. They did that by skimping on everything including maintenance, to try and make the numbers look good.<p>Except they never got to whatever magic numbers they wanted before the maintenance debt came rearing its ugly head and now everything is royally screwed. And because it's a private company, there's a whole bunch of barriers limiting how much they can even subsidize the thing at this point.<p>Not sure if this is better or worse than the UK's Network Rail story, but at the end of the day the only thing that will solve this is if they re-nationalize the tracks & infrastructure. What kind of an idiot thought including that in the privatization is a good idea is beyond me. It's not like you can build a 2nd railway network in order to get free market & competition. (For comparison, imagine privatizing the entire road network, village street to Autobahn.)
Well, the EU insists that track & train operations are separate. (ironically the UK _is_ combining passenger operations and track somewhat back together, which is only possible because of brexit).<p>The bigger issue tbh is the enormous cost inflation in civil engineering in general. This seems to be a problem everywhere. There's no doubt some of this is caused by material cost increases, labour shortages etc, but I'd say the huge amounts of regulation added over the years is really a core driver of this.
The one good thing is that they failed to take it private. Imagine how bad it would be with the current maintenance backlog and no public funding.
> <i>Not sure if this is better or worse than the UK's Network Rail story</i><p>“About 72 per cent of Deutsche Bahn’s intercity trains arrived within 10 minutes of their scheduled arrival time in the year to January 2025, compared with 78 per cent of British long-distance trains, according to the FT analysis.<p>Any interaction with the German rail network is also one of the biggest factors affecting the punctuality of long-distance rail travel in Central Europe” [1].<p>[1] <a href="https://www.ft.com/content/d3b6e6b5-eddb-4230-b866-932d284cef9c?syn-25a6b1a6=1" rel="nofollow">https://www.ft.com/content/d3b6e6b5-eddb-4230-b866-932d284ce...</a>
The UK's railway network was only privately owned from 1994 to 2002 though, everything after that is already under the umbrella of re-nationalisation, which didn't go super well either (my knowledge about that is rather vague). Not sure how useful 2025 numbers are in this context.<p>[ed.: to be clear - AFAIK they are in the same state currently, private company but 100% government owned. But there's a huge distinction in that the UK has <i>made the decision to move back in the direction of nationalisation</i>. In Germany, <i>some</i> people still pretend this is somehow fine and just needs to get cleaned up before the privatization can continue.]
> Not sure if this is better or worse than the UK's Network Rail story, but at the end of the day the only thing that will solve this is if they re-nationalize the tracks & infrastructure. What kind of an idiot thought including that in the privatization is a good idea is beyond me. It's not like you can build a 2nd railway network in order to get free market & competition. (For comparison, imagine privatizing the entire road network, village street to Autobahn.)<p>If you privatize the infrastructure and trains together you can at least compare one region against another, even if they're not directly competing. Trying to operate the trains separately from the tracks was a disaster in the UK and lead pretty directly to two mass casualty incidents.
Governments can be just as bad at infrastructure investments.<p>That being said, I get the sense it's a German cultural problem. I used to travel to Germany quite frequently and was always surprised at the poor quality of much of the infrastructure, including private. The cell phone networks and internet speeds were all awful. As recently as 6 years ago my phone dropped to edge as soon as I left the city and within the major cities I had terrible performance. I'm not kidding when I say that I often had near dialup speeds, despite having full LTE bars. Maybe this has improved since.<p>As for rail, for Europe, the rail lines should probably be run as a cooperative with the rail companies paying dues.
What is surprising is that GSM-R is 2g. Does not 2g have many security issues?
Could also be a russian firembomber gig worker getting brushed under mnt carpet of societal stability. Anything to keep this powderkeg of parallel societies going ..
Same thing happened in Poland and it was confirmed that Russians did it.
Do you have a link?<p>Was it similar to what we’re seeing now (nationwide, radio related)?
<a href="https://hackaday.com/2023/08/29/polish-railways-fall-victim-to-cheap-radio-attack/" rel="nofollow">https://hackaday.com/2023/08/29/polish-railways-fall-victim-...</a><p>tl;dr: Trains can be stopped by a transmitting a simple, documented tone sequence over analog radio.
Ah, good, not the same thing then.<p>Honestly, DB are perfectly capable of clusterf*cking their GSM-R without help from Russia.
> it was confirmed that Russians did it.<p>>> It’s believed the perpetrators of the attack were supporters of the Russian war effort, as the stop signals were also joined by broadcasts of the Russian national anthem and a speech from Russian President Vladimir Putin. The attacks have some significance to the invasion of Ukraine, as Poland has been a hub for crucial weapons deliveries supporting the defence of Ukraine.<p>Yes, yes, it's a code of honour not to use the someone' else national anthem, sure. Especially if you need to bolster the population support for some ongoing cause.
These are effective targets for hybrid warfare for that very reason, plausible deniability
You mean neglect?
and/or incompetence
[dead]
It's russian hybrid warfare against Germany. Since invasion of Ukraine there have been numerous cable cuttings on train tracks, several train derailments, some fires.<p>It has become so bad that police helicopters are regularly patrolling train routes at night to spot sabotage as early as possible. People complain about the flight noise at night which was not there before.<p>So as a person working in cyber security, I'd put this into the sabotage bucket.
There was also a very peculiar train crash in the UK just a few days ago. A train hit a stationary train. That shouldn't really happen in this day and age. Sabotage was the first thing that came to my mind.<p><a href="https://www.bbc.co.uk/news/articles/c4gy60gg6k5o" rel="nofollow">https://www.bbc.co.uk/news/articles/c4gy60gg6k5o</a>
Yes, and just yesterday a passenger train was routed into the path of a freight train due to some points failure. It does make you wonder. <a href="https://www.railmagazine.com/news/points-failure-results-in-near-miss-on-midland-main-line" rel="nofollow">https://www.railmagazine.com/news/points-failure-results-in-...</a>
Maybe. OP isn't saying it's necessarily malicious interference though.
Not a stretch to imagine that it is though. Germany has some very effective radical vandals who make statements by interrupting infrastructure.
The UK buys most of their trains from Deutsche Bahn (German Rail) and just brands them differently.<p>British person living in Berlin.
Deutsche Bahn doesn't manufacture rolling stock. They buy it from Siemens, Stadler, Talgo, Alstom etc...<p>Edit: AFAIK, some of it - mainly high-speed trains - is designed according to DB specs and subsequently offered under a new name (and with changes) to other train companies. For example DB ICE 3 (manufactured by Siemens) / Siemens Velaro.
Incorrect. They wouldn't fit in the tiny UK loading gauge (profile). UK trains are indeed variants of continental models, but made to custom size, and many (most?) of them in the UK.
> The UK buys most of their trains from Deutsche Bahn (German Rail) and just brands them differently.<p>This is totally incorrect.<p>We buy our trains from French/Swiss/German/Spanish/Belgian manufacturers, or build them ourselves in eg Derby.<p>We do not buy our trains from DB.
There was a GSM-R outage in the UK last month ago too [0]<p>[0] <a href="https://www.railforums.co.uk/threads/nationwide-gsmr-outage-19-05.302336/" rel="nofollow">https://www.railforums.co.uk/threads/nationwide-gsmr-outage-...</a>
Word on the german bahn reddit seems to be that a buggy software update is the cause. Remains to be seen if this is the real cause
"IT Outage: No train service nationwide. Due to a nationwide outage of the GSMR digital rail radio system, all trains are being held at stations. We are working around the clock to resolve the issue.<p>Our technicians are working around the clock to resolve the outage.<p>Please continue to check your travel connection immediately before departure using the travel information service at bahn.de, the DB Navigator app, or by calling the travel information hotline at 030/2970."<p><a href="https://www.bahn.de/service/fahrplaene/aktuell" rel="nofollow">https://www.bahn.de/service/fahrplaene/aktuell</a>
It's a GSM-R issue. See Tagesschau (German): <a href="https://www.tagesschau.de/inland/gesellschaft/deutsche-bahn-stoerung-zugfunk-100.html" rel="nofollow">https://www.tagesschau.de/inland/gesellschaft/deutsche-bahn-...</a>
I wish someone would do a deep-dive post mortem once everything is sorted out.
>This special mobile communication standard is designed to make communication fail-safe<p>Mmm, nope.
It did fail safe though?<p>Interference led to the network stopping, not trains just racing towards each other due to bogus line authorities. That is, by definition, fail-safe
That seems like a fail-safe <i>interpretation</i> of communication: if there is no communication, stop the train. GSM-R is much more than line authorities.<p>>GSM-R is a secure platform for voice and data communication between railway operational staff, including drivers, dispatchers, shunting team members, train engineers, and station controllers.<p>Designing the communication network itself in such a way that the <i>entire thing</i> can apparently fail, doesn't sound "fail-safe" to me. (Though its failure may trigger fail-safes in higher-level systems.)<p>But perhaps this is being overstated in the vague reporting, and it's only a regional failure.
If nothing works, eveything is safe, no?
Trains are being started up again (staggered because the current draw of so many accelerating trains could cause problems) since about 10 minutes past midnight, 30 minutes ago.
The fallback for GSM-R is the normal GSM network, but according to informed guesses I've read, the handsets still need to authenticate using their GSM-R credentials (it's just normal GSM roaming), and that's failing too.
Any HNer blocked in a DB train who can share with us the experience?
I’m sitting in an ICE in Munich that was supposed to leave a few minutes before I saw this story on HN. First the conductor announced a 30 minute delay because the radio wasn’t working, and then they bumped it to 2 hours. They didn’t say it was a systemwide problem.
I would get out and look for a hotel before all of them get sold out. Probably tomorrow too.
Had a very similar experience in Munich years ago. That time it was because a train engine on fire on the tracks leading out of the station...
In Erfurt since 2,5 hours. Out of office train driver keeps us updated from chats with fellow drivers (their sources say it is due to software update), radio is fixed now and trains processed one after another (starting with super fast ones - Munich > Berlin, e.g. - so the tracks get emptied quickly). Other interesting observations: when our train stopped, all hotels were already fully booked, as were coach tickets (Flixbus) that would run in the early morning. Crazy how fast people react to shocks.
Yeah, I experienced that a few times in airports with massive disturbance. You could see all the hotels getting fully booked almost live, then when you eventually arrive somewhere with a booking you still have to wait an hour due to how long the queue at the hotel reception is. Always a crazy experience
I am a daily user of S-Bahn. I know 2 alternative routes from every single station from home to work. I even started to memorize their departure times. DB prepares you for the worst.
I was at a conference in Frankfurt, traveling back to Amsterdam with my cofounder and got stuck in Oberhausen. We have an early flight tomorrow and there's no trains in NL due to a strike tomorrow morning, so we decided to take an uber home.<p>At first the delay was 30 minutes. Then 2 hours. After 1h30 with zero updates we decided to bail. Just checked and nothing is moving yet, so we made the right call.
So a 2h ride? Was it easy to find a driver?
Yeah, definitely. Hope you can get to your plane on time and that you can expense the uber trip, that’s a pretty long ride from what I see on gmap
We departed around 30-45 min late from Basel sbb (in Switzerland) in a night train that goes through Germany.<p>They told us about the communication issues but what surprised me is that they told us that the Deutsch bahn replaced the locomotive with one of their (that was near the border I guess) so we could depart.
The same as usual I suppose: stopped at a station in a tiny village, without any information. Train staff will provide water, but that's about it.
It doesn’t surprise me at all. Deutsche Bahn got so bad in the recent years that Switzerland started turning some German trains around at Basel (border) to protect its own timetable from DB delays.
Downdetector shows parallel disruption spikes, similar pattern as end of last year, not as widespread yet.
<a href="https://downdetector.com" rel="nofollow">https://downdetector.com</a>
The jet lag team must be in Germany again. Sam, you being deuschbahnned?
Same problem happened two years ago. You'd think that would be enough time to figure out a failsafe routine
Interesting, I just took an OBB train today from Zurich to Amsterdam, which passes through a lot of Germany.
A truly chaotic week in Europe, alongside the UK train crash and the unprecedented heat wave.
It could be chaos on Dutch rail too the coming day. Trimmed down schedule on some of the busiest routes (due to the current heatwave). Add to that a labor union strike on Wednesday June 24 (that's today local time as I write this).<p>Although NL rail travelers are usually quite good at anticipating, and adjust their schedule. So might just be a quieter-than-usual day.
Downdetector shows parallel disruption spikes, similar pattern as end of last year, not as widespread yet.<p><a href="https://downdetector.com" rel="nofollow">https://downdetector.com</a>
Anyone else watch Season 2 of Hijack?
I wonder how they managed to tell trains to stop.
Stop signals. For legacy train control systems, these still work visually and via wires. ETCS (starting with Level 2) does use GSM-R, but everything is fail-safe: No active communication, no movement authority, so the "virtual signal" display in the cab will pretty quickly also show "stop".
Deutsche Bahn trains stop themselves all the time, no need to tell them
Signalling still works, so you can let the trains continue to a safe place like a station and then not let them leave until the radio issue is resolved
Is that news? Sounds like status quo.
It's the heat.<p>Some system somewhere in need of cooling.<p>Does not get it, because <i>BAHN</i>.<p>Crapping out.<p>Cascades of disbelief.<p>R2D2-like cybernetic seizures.<p>Endless commuter pleasures.<p>No mischief at all.<p>Just bad techno-thrall...
Can passengers tell, I thought German trains were always disrupted!
Is it just me or is the webpage broken with a redirect loop between:<p>* <a href="https://www.bluewin.ch/en/news/german-train-service-suspended-due-to-radio-interference-li.3295297" rel="nofollow">https://www.bluewin.ch/en/news/german-train-service-suspende...</a><p>* <a href="https://www.bluewin.ch/en/news/german-rail-service-suspended-due-to-radio-interference-li.3295297" rel="nofollow">https://www.bluewin.ch/en/news/german-rail-service-suspended...</a>
Honestly can’t tell the difference between this and a regular day r/dbsucks
AP source: <a href="https://apnews.com/article/germany-trains-halted-communications-radio-problem-deutsche-bahn-e8fd970b2d889f3ae7ce03322d5c726b" rel="nofollow">https://apnews.com/article/germany-trains-halted-communicati...</a>
Happened before at a smaller scale, crazy high redundancies in GSM-R mean this is likely sabotage:<p><a href="https://en.wikipedia.org/wiki/October_2022_German_railway_attack" rel="nofollow">https://en.wikipedia.org/wiki/October_2022_German_railway_at...</a><p><a href="https://en.wikipedia.org/wiki/GSM-R" rel="nofollow">https://en.wikipedia.org/wiki/GSM-R</a>
I wouldn't be surprised if it turns out to be incompetence at this point.
If you know anything at all about the Deutsche Bahn, you'll know that it's most likely self-sabotage, in other words, incompetence.
Current suspicion on the German rails reddit is a software update gone wrong.<p>My personal suspicion, GSM-R is 90s GSM, they'll likely have a fried HLR & VLR because in any GSM network these are fundamental, without them you can't even get roaming from public phone networks working as there is no way for the public network to authenticate GSM-R subscribers.
Duplicate: <a href="https://news.ycombinator.com/item?id=48651552">https://news.ycombinator.com/item?id=48651552</a>
Gee I wonder which country could be behind it
It's either that or starlink, some railroads in Germany go through areas without any mobile network signal. Think about how crazy that is in 2026 when everything expects everyone to be online 24/7/365.
They aren’t using starlink for safety critical comms
It's my understanding that most rail/rail collisions are the result of poor communication.
The railroads have their own mobile network, GSM-R, it's in the article...