A network crash grounded every flight in the US, only the third time in history

zohaibahd

Posts: 1,029   +23
Staff
Ripple effect: Most airport meltdowns start with a storm or a single airline's IT going sideways. On Friday, it was the network underneath US air traffic control itself. The FAA halted every departure in the country for more than four hours after that network crashed, reportedly right after a software update.

On Friday alone, more than 4,700 flights were canceled and around 10,000 delayed, according to Flightradar24 data cited by Reuters. It's only the third nationwide ground stop in US history, after 9/11 and the 2023 NOTAM outage.

Oddly enough, that one also began with maintenance work, when a contractor accidentally deleted files while syncing two databases.

The network in question is the FAA Telecommunications Infrastructure, or FTI, which defense contractor L3Harris runs for the agency. It ties every tower, radar site and control center in the country together, carrying voice, radar, weather and flight data between them. So when it went down, it hit all of the Air Route Traffic Control Centers at once – the facilities that guide planes at cruising altitude.

Multiple sources told CBS News that an update to FTI forced a reboot that crashed the system. At an evening White House briefing, Transportation Secretary Sean Duffy said the routers "got overloaded with data" and started spitting out inconsistent readings, so the FAA shut things down. At the same briefing, Homeland Security Secretary Markwayne Mullin said new security patches added to the older system appeared to overwhelm its routers.

Those mismatched readings are likely why the FAA went nationwide instead of working around a few broken centers. A dead radio link is easy for a controller to spot. But a router quietly passing along bad radar or flight data makes it hard to trust anything on the screen. Duffy said controllers never lost communications or radar entirely, though, so the more than 3,000 flights already airborne could still land safely.

Officials have since ruled out a cyberattack and the FAA's new AI traffic tool. Still, the aging telecom backbone was already a known weak spot. A Government Accountability Office report from September found that only about half of the FAA's 5,170 copper lines from the 1960s had been swapped for fiber by May, warning that the agency was "buying delivery speed at the risk of... potential disruptions."

The FAA has already tapped AT&T to build the network that replaces FTI by the end of 2028, as part of the same overhaul that's finally retiring floppy disks. In the meantime, cancellations are expected to spill well into the weekend, though Duffy expects schedules to recover before the Thanksgiving rush.

Permalink to story:

 
Microsoft's Outlook major meltdown and then very next day all flights get grounded all because of "system errors"?

Do we really want to believe those were no attacks of some sort by terrorists groups or A.I itself?

 
Not every flight was grounded. The FAA order went out at 3:54pm EST. At 5:47pm EST Starship flight 15 launched from Texas. At 8:15pm EST, the FAA ended the nationwide ground stop.

Starship’s upper stage reached orbit 26 minutes after launch. Its booster was diverted automatically from landing due to not perfect GNC conditions (guidance, navigation, and control). It exploded after expending all fuel just above the water and just offshore. The upper stage is still orbiting Earth and will attempt a landing in Texas at 4:17pm EST today.
 
They should have used AI to plan, simulate and oversee the update.
I'm also wondering about mundane steps like initial testing, staged rollout, choosing a low traffic time like middle of the night. And who provided these security patches and why was only the FAA adversely impacted by them?
 
So they are not telling the full story ...

They are using TDM...

""Time-Division Multiplexing (TDM) in telecommunications is a method that transmits multiple independent signals over a single common path by dividing the signal stream into fixed, alternating time slots.""
Key Characteristics of TDM

• How it works: Instead of splitting the frequency (like Frequency Division Multiplexing), TDM takes turns giving each sub-channel full access to the transmission medium for a very short, fixed duration in a round-robin cycle.
• Applications: Traditionally used in legacy digital telephony (such as T1/E1 channel banks, ISDN, and SONET/SDH optical networks) as well as older wireless systems like GSM (TDMA).
• Migration to IP: Modern telecommunications networks are actively phasing out legacy TDM hardware in favor of packet-based IP, Ethernet, and Session Initiation Protocol (SIP) trunking or Circuit Emulation Services (CEM / TDMoP) due to lower operating costs and higher bandwidth efficiency.
....


f###ing round robin token ring network essentially..

A SINGLE POINT OF FAILURE RUNS ALL COMMUNICATIONS BETWEEN TOWERS/PLANES/CONTROLLERS
 
Microsoft's Outlook major meltdown and then very next day all flights get grounded all because of "system errors"?

Do we really want to believe those were no attacks of some sort by terrorists groups or A.I itself?
Do you have any evidence to back up your conspiracy theories? Why is it so hard to believe that a system made before Microsoft even existed might be a bit temptemental in its old age?
So they are not telling the full story ...

They are using TDM...

""Time-Division Multiplexing (TDM) in telecommunications is a method that transmits multiple independent signals over a single common path by dividing the signal stream into fixed, alternating time slots.""
Key Characteristics of TDM

• How it works: Instead of splitting the frequency (like Frequency Division Multiplexing), TDM takes turns giving each sub-channel full access to the transmission medium for a very short, fixed duration in a round-robin cycle.
• Applications: Traditionally used in legacy digital telephony (such as T1/E1 channel banks, ISDN, and SONET/SDH optical networks) as well as older wireless systems like GSM (TDMA).
• Migration to IP: Modern telecommunications networks are actively phasing out legacy TDM hardware in favor of packet-based IP, Ethernet, and Session Initiation Protocol (SIP) trunking or Circuit Emulation Services (CEM / TDMoP) due to lower operating costs and higher bandwidth efficiency.
....


f###ing round robin token ring network essentially..

A SINGLE POINT OF FAILURE RUNS ALL COMMUNICATIONS BETWEEN TOWERS/PLANES/CONTROLLERS
The whole system is blatantly obsolete and should have been replaced decades ago.
 
Guys, our leaders are on this with their superior skills. Lets check in on them? Sean Duffy was a (checks notes) umm... a lumberjack, and Markwayne Mullin, was, yep, there it is... a plumber. While I have great respect for those trade crafts? I am not sure they translate to this current problem.
 
The real Republican party has been replaced with a load of z-list TV celebrities and maniacs and so we are treated to one shambolic clusterfvck after another. The sooner this insane administration is out the door and hopefully the Republicans can clear all these maniacs out and offer a viable, decent and reasoned opposition the better.
 
I'm also wondering about mundane steps like initial testing, staged rollout, choosing a low traffic time like middle of the night. And who provided these security patches and why was only the FAA adversely impacted by them?
Yes, of course, I guess everyone's wondering about it. My point is, an AI -assisted analysis would have revealed the possible failures. A properly done human -only analysis would have done the same, I guess. It was just a sloppy job.
 
If this happened on Biden's or Obama's watch, Trump would have demanded their lynchings and the Transport secretary would have been tied up in congressional and senate hearings for the rest of his life. Duffy is another mor0n appointed by Chump that is too stupid to know he's even stupid.
 
Back