Dangerous Complexity: What To Do About the Complex Problem of Complexity?

Standard

Air-travel has become safer than ever and that due, in large part, to the increase in automated systems in the cockpit. However, with this advanced technology there comes a downside and the downside being that an otherwise perfectly functional aircraft (I.e., mechanically sound) with competent operators, can be lost because of a small electronic glitch somewhere in the system.

This issue was discussed, at length in response to the crash of Air France flight 447, an Airbus A330, in 2009, when an issue with an airspeed indicator and automated systems led to pilot confusion—which, in the end, resulted in a plunge into the ocean and the loss of all 228 people on board. The pilots were ultimately responsible for not responding in the correct way (they were in a stall and needed to push the nose down to recover lift) and yet the reason for their failure is as complex as the automated systems that were there to help them manage the cockpit.

It is this problem with advanced electronics that is summarized as a “systemic problem with complexity” in the quote below:

One of the more common questions asked in cockpits today is “What’s it doing now?” Robert’s “We don’t understand anything!” was an extreme version of the same. Sarter said, “We now have this systemic problem with complexity, and it does not involve just one manufacturer. I could easily list 10 or more incidents from either manufacturer where the problem was related to automation and confusion. Complexity means you have a large number of subcomponents and they interact in sometimes unexpected ways. Pilots don’t know, because they haven’t experienced the fringe conditions that are built into the system. I was once in a room with five engineers who had been involved in building a particular airplane, and I started asking, ‘Well, how does this or that work?’ And they could not agree on the answers. So I was thinking, If these five engineers cannot agree, the poor pilot, if he ever encounters that particular situation . . . well, good luck.” (“Should Airplanes Be Flying Themselves?,” The Human Factor)

More recently this problem of complexity has come back into focus after a couple disasters involving Boeing 737 MAX 8 and 9 aircraft. Initial reports have suggested that at an automated system on the aircraft has malfunctioned—pushing the nose down at low altitudes on take-offs as if responding to a stall—and with catastrophic consequences.

It could very well be something as simple as one sensor going haywire. It could very well be that everything else on the aircraft is functioning properly except this one small part. If that is the case, it certainly not something that should bring down an aircraft and would not have in years past when there was an actual direct mechanical linkage between pilot and control surfaces. But, now, since automated systems can override pilot inputs and take away some of the intuitive ‘feel’ of things in a cockpit, the possibility is very real that the pilots simply did not have enough time to sift through the possibilities of what was going wrong enough to diagnose the issue, switch to a manual mode, and prevent disaster.

The FAA, following after the lead of China and the Europeans, has decided to ground the entire fleet of Boeing 737 MAX 8 and 9 aircraft pending the results of the investigations. This move on the part of regulators will probably be a big inconvenience for air travelers. Nevertheless, after two incidents, and hundreds dead, it is better to take the precaution and get to the bottom of the issue.

https://platform.twitter.com/widgets.js

President Trump’s off-the-cuff Twitter response, basically stating “the complexity creates danger,” was met with the usual ridicule from those who hate the man and apparently do not understand hyperbole. (It ironic that some, who likely see themselves as sophisticated, have yet to see that through Trump’s putting-it-in-simple-layman’s-terms shtick.) However, technically incorrect is not the same as totally wrong and there is absolutely nothing ridiculous about the general point being made—there are unique (and unforeseeable) problems that come with complex systems.

The “keep it simple, stupid” mantra (aka: KISS principle) is not without merit in an age where our technology is advancing beyond our ability to control it. If a minor glitch in a system can lead to a major disaster, that is dangerous complexity and a real problem that needs to be addressed. Furthermore, if something as simple as flight can be made incomprehensible, even for a trained professional crew, then imagine the risk when a system is too complicated for humans alone to operate—say, for example, a nuclear power plant?

Systems too complex for humans to operate?

On the topic of dangerous complexity, I’m reminded of the meltdown of reactor two at Three Mile Island and the series of small human errors leading up to the big event. A few men, who held the fate of a wide swath of central Pennsylvania in their hands, made a few blunders in diagnosing the issue with serious consequences.

Human operators aren’t even able to comprehend the enormous (and awful) potential of their errors in such circumstances—they cannot fear to the same magnitude or to the proportion of the possible fallout of their actions—let alone have the ability to respond correctly to the cascade of blaring alarms when things did start to go south:

Perrow concluded that the failure at Three Mile Island was a consequence of the system’s immense complexity. Such modern high-risk systems, he realized, were prone to failures however well they were managed. It was inevitable that they would eventually suffer what he termed a ‘normal accident’. Therefore, he suggested, we might do better to contemplate a radical redesign, or if that was not possible, to abandon such technology entirely. (“In retrospect: Normal accidents“. Nature.)

The system accident (also called the “normal” accident by Yale sociologist, Charles Perrow, who wrote a book on the topic) is when a series of minor things go wrong together or combine in an unexpected way and eventually lead to a cataclysmic failure. This “unanticipated interaction of multiple factors” is what happened at Three Mile Island. It is called ‘normal’ because people, put in these immensely complex situations, revert to their normal routines and (like a pilot who has the nose of his aircraft inexplicably pitch down on routine take off) they lose (or just plain lack) the “narrative thread” necessary to properly respond to an emerging crisis situation.

Such was the case at Three Mile Island. It was not gross misconduct on the part of one person nor a terrible flaw in the design of the reactor itself, but rather it was a series of minor issues that led to operator confusion and number of small of mistakes that soon snowballed into something gravely serious. The accident was a result of the complexity of the system, our difficulty predicting how various factors can interact in ways that lead to failure and is something we can expect as systems become more and more complex.

And increased automation does not eliminate this problem. No, quite the opposite, it compounds the problem by adding another layer of management that clouds our ability to understand what is going on before it is too late. In other words, with automation, not only do you have the possibility of mechanical failure and human error, but you also have the potential for the automation itself failing and failing in a way that leaves the human operators too perplexed to sort through the mess of layered systems and unable respond in time. As the list of interactions between various systems grows so does the risk of a complex failure.

[As a footnote, nuclear energy is cleaner, safer and far more reliable than wind and solar farms. And, in the same way, that it is safer to fly than to drive, despite perceptions to the contrary, the dangers of nuclear are simply more obvious to the casual observer than the alternatives. So, again, with the fierce opposition to nuclear power by those who are unwittingly promoting less effective and more dangerous solutions, the human capacity to make good decisions when faced with the ambiguous problems created by the interaction of various complex systems does certainly come into question.]

Has modern life become dangerously complex?

There is no question that technological advancement has greatly benefited this generation in many ways and few would really be willing to give up modern convenience. That said, this change has not come without a cost. I had to think of that reality over the past few weeks while doing a major overhaul of how we manage information at the office and considering how quickly years of work could vanish into thin air. Yes, I suppose that paper files, like the Library of Alexandria burned, are always susceptible to flames or other destructive forces of nature. But, at least fire (unlike the infamous “blue screen of death“) is a somewhat predictable phenomenon.

Does anyone know why the Bluetooth in my car syncs up sometimes and not always?

Or why plugging my Android phone into the charger causes my calls in Facebook Messenger to hiccup (I.e., disconnects and reconnects multiple times) sometimes but not always?

I’m sure there is a reason hidden somewhere in the code, a failed interaction between several components in the system, but it would take an expert to get to the bottom of the issue. That’s quite a bit different from the times when the problem was the rain and the solution was cutting down a few trees to create a shelter. That was also true in the early days of machines as well—a somewhat mechanically inclined person could maintain and repair their own automobiles. However, the complicating factor of modern electronics has put this do-it-yourself option out of reach for all but the most dedicated mechanics.

Life for this generation has also become exponentially more complex than it was for prior generations when travel was as fast as your horse and you were watching your crops grow rather than checking your Facebook feed updates every other minute. It is very easy to be overwhelmed, as individuals, by information overload. The common man is increasingly over his head in dealing with the technological onslaught. We have become increasingly dependent on technology that we cannot understand ourselves and fails spontaneously, without warning, at seemingly the most inopportune times.

Advanced modern technology represents a paradigm shift as much as the invention of the automobile was a revolution for personal transportation. We have gone from analog to digital—a change that has opened a whole new realm of possibilities and also comes with a new set of vulnerabilities as well that go beyond the occasional annoyance of a computer crash. We really have no idea how the complexity of the current system will fare against the next Carrington Event (a solar storm that caused widespread damage and disruptions to the electric grid in 1859—a time of very basic and sturdy technology) nor are we able to foresee the many other potential glitches that could crash the entire system.

It is easy to be lulled into thinking everything will be okay because it has been so far. But that is a false security in a time of complex systems that are extremely sensitive and vulnerable. As when a pilot of a sophisticated airliner fails to comprehend the inputs or like the flustered operators of a nuclear reactor when the alarm bells ring, our civilization may be unable to respond when the complex systems we now rely on fail in an unexpected way that we could not predict. It is not completely unlikely that a relatively small glitch could crash the entire system and lead to a collapse of the current civilization. That is the danger of complexity, having systems that are well beyond our ability to fix should they fail in the right way at the wrong time.

The last human invention will be too complex to control and could be our demise…

Computers far exceed the human capacity to process information. We’ve come a long way from Deep Blue versus Garry Kasparov in the 90s and the gap between man and machine continues to grow wider after our best representatives were surpassed. Yet, while vastly faster in their abilities, computers have long only been able to do what they were programmed to do and thus their intelligence is limited by the abilities of their human programmers.

However, we are on the cusp of development of this technology and the implications far beyond the finite capacity of the human mind to grasp. We could very soon couple the processing speed of a computer with a problem-solving ability similar to that of a human. Except, unlike us, limited by our brain size and relatively slow processing speed, this “machine learning” invention (a video on the progress so far) could continue to expand its own intellectual abilities.

Machine learning is a massive paradigm shift from the programmed computers we currently use. It would lead to super-intelligence beyond our ability to fathom (literally) and, any more than a monkey can control us, could not be stopped. Imagine something that is always a hundred steps beyond any scenario we could imagine and has less in common with us (in terms of raw intelligence) than we do with an ant—would it have any reason not to treat us better than bacteria?

There was a time when I would not have believed that artificial intelligence was possible in my lifetime and a time after that when I would’ve thought it is something we could control. That was naive, artificial intelligence would, at very least, be unpredictable and almost totally unstoppable once the ball got rolling. It could see us as a curiosity, solve cancer simply because it could in a few nanoseconds—or it could kill us off for basically the same reason. Hopefully, in the latter case, it would see our extermination as not being worth the effort and be on to far greater things.

It remains to be seen whether artificial intelligence will solve all of our problems or see us as a problem and remove us from the equation. This is why very intelligent men, who love science and technological advancement, like Elon Musk, are fearful. Like the atomic age, it is a Pandora’s box that, once opened, cannot be closed again. But unlike a fission bomb that is dependent on human operators, this is a technology that could shape a destiny for itself—an invention that could quite possibly make us obsolete, hardly even worth a footnote in history, as it expanded across our planet and into the universe.

Whatever the case, we will soon have an answer…

Neural nets, the key component to artificial super-intelligence, are already here…

In fact, it is in your smartphone, it enables facial recognition and language translation. It also helps you pick a movie on Amazon by predicting what might interest you based on your prior choices.

Artificial intelligence technology could be our future. It could be that last invention that can finally manage all of these dangerous complex systems that modern convenience is so dependent upon and allow us to return to our simple pleasures. Or it could be a dangerous complexity in and of itself, something impossible to control, indifferent to our suffering and basically (from a human perspective) the greatest evil we ever face in the moments before it ensures our extinction.

Artificial super-intelligence will be complexity beyond our control, a dangerous complexity, and comes with risks that are humanly unimaginable. It could either solve all of our problems in dealing with disease and the complexity of our current technology—or it could make our woes exponentially greater and erase our civilization from the universe in the same way we apply an antibiotic to a pathogen. It is not ridiculous or absurd to think a little about the consequences before flipping the “on” switch of our last invention.

Should we think about simplifying our lives?

It is important, while we still reign supreme as the most inventive, intelligent and complex creatures on this planet, that we consider where our current trajectory will lead. Technological advancement has offered us unique advantages over previous generations but has also exposed us to unique stresses and incredible risks as well. Through technology, we have gained the ability to go to the moon and also to destroy all life on this planet with the push of a button.

Our technologies have always come as two-edged swords, with a good side and bad side. Discovering how to use fire, for example, provided us with warmth on a winter night and eventually internal combustion engines, but has often escaped our containment, destroyed our properties, cost countless lives, and creates air pollution. Rocks, likewise, became useful tools in our hands, they increased our productivity in dramatic fashion, but then also became a means to bash in the skulls of other humans as a weapon. For every positive development, there seems to be corresponding negative consequences and automation has proved to be no different.

The dramatic changes of the past century will likely seem small by comparison to what is coming next and there really is no way to be adequately prepared. Normal people can barely keep up with the increased complexity of our time as it is, we are already being manipulated by our own devices—scammers use our technology against us (soon spoof callers, using neuron networks, will be able to perfectly mimic your voice or that of a loved one for any nefarious purpose they can imagine) and it is likely big corporations will continue to do the same. Most of us will only fall further behind as our human weakness is easily used against us by the use of computer algorithms and artificial intelligence.

It would be nice to have the option to reconsider our decisions of the past few decades. Alas, this flight has already departed, we have no choice but to continue forward, hope for the best, and prepare for the worse. We really do need to consider, with the benefits, the potential cost of our increased dependence on complex systems and automation. And there is good reason to think (as individuals and also a civilization) about the value of simplifying our lives. It is not regressive or wrong to hold back a little on complexity and go with what is simple, tried and true.

Advertisements

Salvation from the Dark Cave — 5 Parallels Between the Rescue in Thailand and Spiritual Transformation

Standard

When I first heard the news about the Wild Boars, a youth soccer team, having gone missing in Thailand, I assumed these twelve boys along with their young coach were hopelessly lost in the flooded cave system and probably already dead or likely would be before anyone reached them. It had been over a week since they had disappeared and there seemed to be little hope of finding them alive.

For that reason, I was very happy to read the news of their being discovered by two British divers who were aiding the rescue efforts. Somehow, despite their ordeal of having to flee deeper into the cave to avoid the rising flood waters and having been trapped in the pitch blackness without food or light for over a week, these players and their coach were still alive. And what a great relief it must’ve been for them to see a person from the outside emerge from those murky waters that had entombed them.

However, that moment of joy was soon replaced by a new fear when considering the perilous journey they now had to face in order to make their escape. The divers who found them were some of the best in the world and many of these boys didn’t even know how to swim—let alone swim in conditions that experts described as extremely dangerous and conditions that tragically did cost one of their rescuers his life.

The question became one of could these boys be saved without a miracle?

This World Is A Dark Cave

We, unlike those boys who had been outside the cave, have never been beyond this world. While we can imagine that there could be something beyond, we are truly bound by what we can touch, taste, see or perceive in our minds. For many reality only extends as far as they are able to fathom. And yet science has discovered spectrums of light beyond our vision and philosophy has long challenged us to go beyond even ourselves, our rational minds, in our thinking.

Greek philosopher Plato imagined a scenario, the Allegory of the Cave, in which we were all born bound in a cave where most are chained where they can only see a shadow of greater reality projected onto the wall in front of them and some of these life-long prisoners are eventually freed. Those freed, we discover, have great difficulty explaining this greater perspective to those still bound. This scenario is pretty much describing our own perception of reality in a nutshell.

Some desire to look beyond the shadows and find a measure of freedom. However, there are many others who are content to live with the shadows and in denial. They are bound by religion, ensnared by the entertainment industry, distracted the pursuit of wealth, blinded by the daily grind or unable to see for any number of reasons and never realize that they are in a cave and chained to a wall and only seeing shadows of something greater.

There are also those who have realized they are trapped in a cave and yet also see the waters, have probed the escape routes from this reality and have understood the true impossibility of their predicament. They have lost hope. They are depressed and living in despair because they know that they are trapped and there’s nothing they can do about it.

Jesus Emerged From the Murky Waters

Those Thai boys and their coach had to know that they were doomed without divine intervention or outside help. During the rainy season (that started early and caught them by surprise) lasts into October and they only had supplies for an afternoon. The coach seems to have did his best to look after the boys, withholding rations from himself to give them a better chance of survival, and yet what he could provide was never going to save them from death in the darkness.

Even a strong swimmer had no chance to escape the under water labyrinth that separated them from the outside world. To find another path or dig their way out was impossible given their lack of necessary tools and provisions. Their resources (besides the water they could lick off the walls) were already exhausted. Even their oxygen supply was starting to dwindle and would disappear long before the flood waters would recede. They only had their prayers and hope for a rescue mission to hold back despair—without a savior were doomed.

That is essentially the story for all of humanity and the background for the Gospel of Jesus Christ. We are born, our forefathers having wandered deep into a cave of sin and our escape from this blocked by the waters of death. This whole world, the entire universe, in fact, is bound by physics to eventually run out of energy and our descendants, no matter how technologically advanced, will not escape that. This is a reality that can cause an intelligent forward-thinking person to wonder what is the point of living if death is all the future holds.

Drawing by Manatsawin Mungsungnoen

If one can imagine how welcomed a sight those British cave divers were for the boys and coach trapped in complete darkness and facing imminent death, then they can also imagine the feeling of elation that the disciples of Jesus felt having seen him after his emergence from the murky waters of death—His resurrected body, their resurrected hopes, and proof positive of his claim that there is eternal life for those who follow after Him.

We Must Take the Plunge of Faith

The happiness about those lost being found was soon replaced with a big question about how to get them from the cave to freedom. How could this half starved group of youngsters and their coach (who was even worse for the wear after selflessly giving his rations to the boys) get out of their subterranean prison?

Many options were discussed and ruled out one by one. There simply was not enough time for other solutions when oxygen levels began to drop, with the fullness of the monsoon season about to begin, and the consensus became clear: They would need to dive out like their saviors or die in the cave. This was something that had been impossible for them before, it was something extremely dangerous even for a veteran cave diver, and would be absolutely terrifying for someone claustrophobic. None of them were swimmers, let alone in any physical condition to match the world class athletes who found them, and I’m sure their fears could keep them paralyzed.

Where does one find the faith to do the impossible?

That was my question a few years ago.

You jump in, that’s how…

We Cannot Save Ourselves

The truth is, while we must take the plunge under the murky waters and swim for all we are worth, the journey out of the cave is not one we are able to do on our own strength. Like the rescue in Thailand took the coordinated effort of many men and women, we cannot possibly complete our journey to freedom without a community or the help of others. Rather we need to partake of the provisions left for us by those who have followed after Christ. We need to firmly grasp the guiding rope of the written and spoken tradition that the Church (2 Thessalonians 2:15) has left for us. And must also submit to those ordained to lead us to safety and who are responsible for leading us to salvation:

Have confidence in your leaders and submit to their authority, because they keep watch over you as those who must give an account. Do this so that their work will be a joy, not a burden, for that would be of no benefit to you. (Hebrews 13:17 NIV)

We live in an age where purported authorities are questioned, and rightly, for their abuses. There are many self-proclaimed (and self-promoting) religious experts who claim to have spiritual knowledge and have yet to truly take the plunge of faith themselves. These false teachers. They are ordained only by themselves, by their own arrogance, and are whom Jesus describes as being blind guides. You can know them by their fruits:

“Watch out for false prophets. They come to you in sheep’s clothing, but inwardly they are ferocious wolves. By their fruit you will recognize them. Do people pick grapes from thornbushes, or figs from thistles? Likewise, every good tree bears good fruit, but a bad tree bears bad fruit. A good tree cannot bear bad fruit, and a bad tree cannot bear good fruit. Every tree that does not bear good fruit is cut down and thrown into the fire. Thus, by their fruit you will recognize them. (Matthew 7:15‭-‬20 NIV)

Be sure that those who lead you have a true connection to the world beyond. Do they shine a light that pushes back against the darkness? Do they bring you nourishment and spiritual air? For those trapped in the cave in Thailand, it is clear who came from the outside and why they are there. The rescuers come with provisions, they administered first aid to those in need and built the trust of the boys to follow their lead and instructions.

These teachers, without a doubt, played a critical role in the salvation of those trapped in the cave and we too need those who have experience beyond our own to provide calm and guide us through the fog, currents, and confusion of life.

We Must Die to Save Others

As I entered the church building on Sunday the final act of the rescue mission started. The Gospel text was, interestingly enough, about some friends of a paralytic and their faith that carried him to Jesus:

Jesus stepped into a boat, crossed over and came to his own town. Some men brought to him a paralyzed man, lying on a mat. When Jesus saw their faith, he said to the man, “Take heart, son; your sins are forgiven.” (Matthew 9:1‭-‬2 NIV)

The account goes on with Jesus first addressing the naysayers and critics for their evil thoughts before going on to fully heal this man. But this detail about Jesus seeing the faith of these men is something I had missed before. It was their carrying him, like the divers leading the boys out of the hopeless depths, that led to this man being forgiven and freed from his paralysis. It is our job to carry each other back to Christ and that is the purpose of a Christian community and the Church. It is our faith that leads to the healing of others.

Like these men carrying their friend or the “buddy system” of experienced divers leading the young boys through the darkness to the light, we too must serve a role in the salvation of others. The Christian mission is to participate in the salvation of others in much the same way as those, who came from around the world and volunteered to risk their own lives—not for financial gain, not for their own biological children and not compelled by force. They simply saw a need, a desperate need, and became the solution.

Sgt Major Saman Kunan

Many have sacrificed time and volunteered their talents to aid in the search and rescue effort in Thailand. But one man, Sgt Major Saman Kunan, a retired Thai Navy diver, gave his own life so those boys could be saved. This hero, after delivering oxygen canisters needed for the daring escape, ran out of oxygen himself and perished.

And that is the responsibility of all Christians. We are to find lost sheep, feed them, heal their wounds, lead them out of harm’s way, and even give our lives for them. We are to be Christ in every sense of the word and that means dying to ourselves and saving the lost from their dark cave.

We need to be faithful to those who are lost without a hope.