Three Strikes [✓]

Jumping At Shadows

Chapter Forty-Six: Jumping At Shadows

|...|...|...|

Anchorhead Bay, Erusea.
October 1st, 2019.
2200hrs.

|...|...|...|

The EASA transport had held up well when under attack, though that was the least of Schroeder's concerns as the brief allies they'd made in those Osean fighters withdrew from the area in the opposite direction of their plane. The drone escorts were gone, having gone against their orders as if they were human pilots making a calculated decision. Even going so far as to call more allies to their aid before that Osean F-22 pilot made quick work of them. Now they continued onward, completely defenseless and Schroeder's ego more than a little bruised.

The drones' behavior was unexpected, having completely ignored all attempts to control them from within the aircraft. But despite the fruits of their labor now being nothing more than pieces of scrap and ash, Simon seemed overall pleased with what would have been a successful performance from the AI under any regular circumstances. He was clearly exhausted, but still smiling. "Did you see that, Dr. Schroeder? Autonomous mode was fully functional! They're incredible..."

Schroeder didn't acknowledge him right away, silently removing his glasses to wipe the sweat off his face and clean the now cloudy lenses. His gaze remained focused on them in the dull lighting, though he was aware of Simon looking at him the entire time. At last he took a deep breath. "It's not enough to be merely functional. There has to be a time when it should not function...but the question is when? At one point can they not be allowed to make decisions based on numbers and vague orders?"

"What do you mean?" Simon's tone had changed, and when Schroeder looked up at him he found that his protégé's expression had faltered to one reminiscent of childish if he was a kid that had just had his entire world shattered by a simple statement.

"Their purpose is to create a clean and efficient war, where unnecessary casualties are a thing of the past. A perfect soldier..." Schroeder said, though he was beginning to think things were too far gone for their original purpose to still stand. He had intended to create something good, or at least his superiors that handed the project over to him had told him it was good. But that Osean pilot had been right. Whoever created something without humanity to solve problems connected to the very thing they lacked was a fool. "But if at every turn they're fighting their commanders' authority and making unauthorized decisions during sorties, what's their purpose? If they attack friendlies like this based solely on what they perceive to be an enemy, what stops them from going after Erusean pilots? Or worse yet, civilians..."

"But at least we've proven their autonomy can work and function. What are they supposed to do if their commanders are taken out and they need to continue their operations?" Simon asked him, a question made out of genuine curiosity as opposed to one intended to start a fight.

"And what if they decide their commanders' orders should be overridden? That a populated area should be wiped out to continue their allies' advancement? Or that their allies are expendable compared to them?" Schroeder asked him, and there was no answer to any of his questions. No, they could not create a weapon they could not control with the purpose of ending wars. New, endless wars would instead be waged and diplomacy would quickly become a thing of the past. "Their autonomy is centered on self-preservation and broad interpretations of 'hostile' and 'enemy'."

"Then what's the solution?" Simon asked him, becoming slightly more confrontational now. "What alternatives are there, aside from setting back their technology about ten years and scrapping all of our progress? We could make them better or...or find a way to give them a moral compass. Something so that all of this isn't a waste!"