Live

Tech news, freshly booted.

Computing

Two network routers flooded the FAA's systems and grounded US flights for more than four hours

Friday's nationwide ground stop has been traced to newly installed routers in Arkansas and Texas that swamped an aging air traffic network. The router maker says its devices worked as configured, and the government is asking Congress for $50 billion.

A pair of network routers caused Friday's nationwide halt to US flights, according to US officials. Transportation Secretary Sean Duffy says new equipment at FAA sites in Arkansas and Texas flooded the air traffic control network with traffic, leaving controllers with unstable radar and communications data and forcing the FAA to stop departures across the country.

What happened

Air traffic control centers began seeing unstable radar and communications data at 3:36 p.m. Eastern on Friday, November 13, The Next Web reports. Tech Times says the ground stop was issued at 3:54 p.m., with about 3,500 aircraft in the air, and it was lifted at 8:15 p.m.

The disruption spilled into the weekend. Counts differ by source: The Next Web cites FlightAware data reported by Reuters showing about 9,200 US cancellations on Friday and more than 6,400 on Saturday, while Tech Times cites Flightradar24's figure of more than 4,700 Friday cancellations. American Airlines said on Monday it expected a largely normal schedule.

How a router stopped the flights

The trouble started during an upgrade at a remote FAA radio site in El Dorado, Arkansas, where contractor L3Harris was replacing old copper lines with fiber-optic cable. According to Duffy, the new router there sent more than 1,000 connection attempts every four to five seconds to other routers. That disrupted radio links and radar feeds at 17 of the FAA's 22 en route centers.

At the same time, a router at a radar facility in Amarillo, Texas, which had been upgraded weeks earlier, began flooding the network too. The Philadelphia Inquirer quotes aviation experts who think the new equipment sent far more data than older parts of the system could cope with. Tech Times reports that officials believe a feature that broadcast data more widely than needed was to blame, and that it has been switched off at both sites.

The Arkansas router was made by Juniper Networks, now owned by Hewlett Packard Enterprise. HPE says the device worked as the installer configured it and didn't fail. L3Harris says it is supporting the investigation and has completed more than 70% of its copper-to-fiber work.

The investigation

Both routers are at an L3Harris lab in Florida, where FAA staff and FBI agents are working to rule out a cyberattack, The Next Web reports. FAA Administrator Bryan Bedford said there's "zero evidence" of anything AI-related, and Homeland Security Secretary Markwayne Mullin said nothing so far points to a cyberattack. The open question is whether the router was installed or configured wrongly or was faulty. Duffy said he doesn't believe anyone sabotaged the network.

Duffy told CNBC the stop cost the US economy billions of dollars. He said work at big sites is usually done at night, but this upgrade ran during the day because nobody expected it to affect the system. The government will review how and when upgrades are carried out.

Why it matters

The FAA is in the middle of replacing decades-old equipment, and this incident shows how fragile that changeover can be: one new device behaving differently from what older equipment expects can spread failures across the network. He wants Congress to approve $50 billion for a new air traffic control network, up from an earlier $30 billion request. Democrats Rick Larsen and Andre Carson say the department has spent only $1 billion of the $12.5 billion Congress approved last year. Duffy says Congress put strict limits on that money.

For travelers, the ground stop has been lifted and airlines are recovering; American Airlines expected a largely normal schedule on Monday. Until investigators finish, though, nobody has said exactly what went wrong or how future upgrades will be protected against the same failure.

Sources

This story is based on reporting from these outlets. Read them for the full picture:

More from The Bootline