Let me start this argument by narrating a couple of stories:
Story 1: This happened several decades ago when I was an engineering student. With my friends, we had gone to visit a sanctuary for lions in a protected forest near Shivamogga, in Karnataka. We could see a pride of lions at a distance with a couple of cubs in there as well. But someone in the group started making sounds and teasing the lions. And before we knew what was happening, one of the female lioness rushed menacingly towards us. And even before we could process it, the male lion let out a huge roar and charged right at us! If it were not for the fence separating us, I would not be here narrating this story! :) When the lions charged at us, some of the people in our group ran away in fear, and some like me, were too petrified to even move a limb. Both lions charged at the fence several times The lions kept charging at the fence and roaring ferociously at us for a while. Then, they must have looked at the petrified faces of the remaining people, and just like that, got bored, and went back to tend to their cubs.
Story 2: I was seeing a video promotional recently from a Bangalore based startup that makes kamikaze (suicide) drones. These drones can pick up a face from a crowd and pursue them and take them down by using themselves as the ammunition. According to the creators, once one of their drones have targeted someone, there is no escape for them. They can be pursued through dense crowd as well as foliage, and if they go into a building, the drones loiter outside until they come back, without getting bored.
Without getting bored!
This one statement got me thinking about how is an AI predator different from a natural predator?
All living beings including us, are autonomous agents like how AI is becoming these days. We take decisions on our own and pursue goals by planning and strategising and acting rationally towards utility maximisation. We adapt to external feedback and refine our strategies to achieve our goals. All of these are now done using AI.
But the one thing that AI does not do (cannot do?) is become bored. Is this a feature.. or a bug?
Is our ability to get bored with pursuing our goals, a shortcoming and a weakness, or is it pointing to something more fundamental about how we are structured?
*~*~*~*~*~*
For a few years now, I have been working on a new model of agency that I call "beings" rather than "agents". I've written a few ideas about this in this blog itself and a search for the tag, Theory of Being would bring up a few of them. We also have a formal, mathematical model of beings that we have published in peer-reviewed journals and conferences.
Be it lions, or even us for that matter, we are not exactly autonomous agents-- we are "systems of being" or "beings" for short. How is a being different from an agent? And what significance does this difference hold for the design of AI?
An agent is an entity that autonomously pursues a goal. The goal that an agent pursues is typically external to the agent, and the agent has to operate in uncertain environments and adapt to the way the environment responds to its actions, to keep it progressing towards its goal.
In contrast, a being is an entity that has multiple dimensions to its existence that may interact among themselves to give it an internal state of stability or harmony. A being tends to "be" or stay in its stable state, and any perturbation from its stable state is responded to by the being in a way that it can come back to its stable state.
A being interacts with the external world when its internal harmony is perturbed and it seeks to restore its inner harmony by achieving an external objective. The external goal is not the end target itself-- it is just a means for achieving an internal goal. For instance, natural predators attack only if their inner harmony is perturbed by things like hunger, fear, irritation, etc. The goal for a being is always internal-- not external.
Beings get "bored" and give up on external goals not because they are lazy or weak or somehow inadequate or imperfect, but because it no longer makes rational sense to pursue the external goal to restore the inner harmony.
The the lion episode from earlier, once we had been petrified enough by the roars of the lions, it was clear even to the lions that we puny humans will not be bothering them anymore, and they gave up on their goal to attack us.
This is where an autonomous agent, especially an AI agent differs fundamentally from natural autonomy. Artificial autonomy is driven by external goals. AI agents have no sense of internal harmony that they are trying to preserve. They only pursue an external goal.
That is why a "suicide" drone is nothing special-- they don't need any special training or conditioning to commit "suicide" as part of their attack. They don't need to be persuaded to give up their "lives".
Conflict among beings is more than just the external fight that is visible. There are typically underlying factors that upset the sense of harmony or well-being of the beings involved, that has lead to the conflict. A lasting solution to the conflict lies not in winning the external conflict itself, but in addressing the causes of the internal disharmony that is leading to these external crises.
A number of ethical issues can be understood better when we use the "being" framework that focuses on internal disharmony, instead of an agentic framework that focuses on external goals. Many times for example, a thief who is caught stealing would be merely trying to mitigate his internal disharmony like hunger or some other form of family exigency. Similarly, sometimes soldiers fighting on opposite sides get to see the human nature of the other and refuse to fight. Most famously, this was witnessed in World War I, where an informal, tacit understanding of non-aggression emerged spontaneously between opposing soldiers in static, quiet sectors along the Western Front. To avoid suspicion from high-ranking officers and headquarters, troops could not simply stop shooting. Instead, they ritualised their weapons fire to show compliance with orders while intentionally causing zero casualties. Rather than active resistance, it was a practical coping mechanism born out of prolonged proximity, shared misery, and the mutual desire to survive.