Showing posts with label research. Show all posts
Showing posts with label research. Show all posts

13 July, 2026

Insights - 2: Weaving a Bharatiya approach to academics

Manju (name changed) is a high school student in a small village in a remote corner of Karnataka. I knew him from when he was just a 4 year old kid. 

A couple of years ago, I and my family members met him again after several years, and were amazed at what he has become. He is in high school now, and was showing us a toy tractor he had built from cardboard boxes and bottle caps. What was amazing was not just the structure of the toy that resembled a real tractor. It was also powered by two motors-- one for the wheels, and another stepper motor for controlling the plough. He had also created a small control panel with which we could control the movement of the tractor, as well as the plough behind! 

We were seriously impressed with his engineering skills and strongly encouraged his parents (who were low income farmers with very little schooling themselves), to get him to study and go to college. 

Fast forward a couple of years. Manju no longer lives with his parents after having had a showdown with them regarding his low marks in school and not having performed up to expectations in school making his prospects of entering college, dim. He has run away to his grand-parents place and cannot face his father. 

I was aghast when I heard this. And even more aghast (with a sense of deja vu) when the dad said that Manju was not all that bright a kid, unlike his elder brother who is so enterprising and dashing. 

*~*~*~*~*

The above episode is in a nutshell, the epitome of the serious pathology that afflicts our formal education today. Formal education in India today is a nightmare for anyone who have their own creative potential and can think independently. The system systematically dispirits individuals to make them into insecure automatons with certificates, who can then be exploited employed in some form of compliant service. 

We keep talking about our "demographic dividend" and keep lamenting why Indians are not innovative or creative, and ask how do Indians excel abroad when they struggle in India itself? 

But hardly anyone seems to be interested in systematically analysing the pathologies that afflict our formal education system and do something about it. 

The formal education system in India, is an efficient system of deracination. Through relentless conditioning and pontification, it makes us dissociate the knowledge that we learn, from our sense of individual personhood based on lived experience and original thought. With several years of schooling, where students are measured on narrow metrics that have little or no relevance to the world around them, they end up learning to live almost completely within their minds with no sense of ownership or belongingness to the reality around them. 

Which is the reason why, in many of our "elite" and "premier" institutions, it feels like we are in a different country altogether. Some of these elite institutions have existed for several decades now, where they impart advanced training and conceptual insights to their students. Yet, outside the campus, the city would have remained as backwards as it were when these institutions started. Very few of the "elite" students engage with the city council or the municipality or the community around them. One would imagine that the entry of an elite academic institution, will change the social ecosystem around it too. Yet, (with some exceptions in recent years), it has hardly been the case. 

Knowledge systems in our formal education today is a direct import from the West. Right in kindergarten, we learnt about summer vacations where people go on picnics to "soak up the sun" and eat plum cakes. Never mind that we had never seen a plum cake before-- and I'm not sure I have seen one even now, and "soaking up the sun" in our summers would be a really bad idea! (Nowadays it is a bad idea even in Europe!) And all the way into higher education several decades later, we learnt about "market basket analysis" without having seen a single supermarket store (at that time), and at work where I remember having written a device driver for a CD changer device just from a textual description of what is a CD changer, and without even having seen such a device! 

Even as researchers, we find today that our work is valued only so much as some major community in the US or Europe values it. No amount of logical arguments or evidence or proofs would serve to convey the importance of any original idea we have developed. All argumentation about originality will be seen as lame excuses, with the only evidence of research quality is to be recognised by some "worldwide" community that is directed by institutions in Europe or US. When we do manage to convey the importance of our original idea, in order to be granted our degrees, we are then expected to work it out to the minutest detail, including implementation and deployment-- a process that would have taken decades even in the Western world. 

(In one of my courses, I include John Nash's seminal paper about the existence of Nash equilibria in finite non-cooperative games, that lead him to eventually win the Nobel prize in economics. I make it a point to note that the first version of this paper had no equations at all in it! It just provided an idea that a result in algebraic topology can be directly applied here. Fat chance in India today that we can ever publish an idea at this preliminary stage and expect to be taken seriously!). 

And whenever I have argued for a need for a Bharatiya approach to academics and research, I usually get a pushback saying that the age old wisdom of Vedas and Upanishads are not relevant today, and that "science is universal" and there is no such thing called "Bharatiya approach" to science. 

I refute both these arguments as follows: 

  • By Bharatiya approach, I am not necessarily advocating returning to our education system from thousands of years ago (although it is a good idea in itself, to study our ancient knowledge systematically from today's hindsight-- without the contemptuous interpretations accorded to them by colonial interpreters). I only mean that we need to stop blindly copying either Europe or US or China or Japan or whatever else, and address our challenges with original thought and implement solutions that address our challenges directly (rather than implementing a solution for some other country first and let it "trickle down" decades later).
  • Second, the outcome of science may be universal knowledge, but the path to science is highly rooted in socio-cultural-political landscape of the population practising it. To quote Heisenberg, "What we observe is not nature itself-- but nature exposed to our method of inquiry." And there is definitely an original Bharatiya approach to the method of inquiry. When we change the method of inquiry, the universality of our discoveries will not change. Only what we end up discovering will change, and the outcomes of such discoveries will be more directly relevant to our lived experience.

*~*~*~*~*

So what would such a Bharatiya approach be like? I hesitate to offer specific structures and processes, because one, Bharat is way too complex to be described by one specific structure or process; and two, given the way we operate today, whatever specific structure or process we bring in, the system will quickly overfit to the metrics rendering the whole exercise meaningless. 

Instead, I am going to propose the following dimensions that we need to think through, for bringing about effective change: 

Resilience: One of the most important changes we need to bring about is make the education system more resilient. Today, a student's entire future is dependent on "cracking" one exam with stratospheric marks, that pretty much mean nothing in terms of what skills or insights they actually have. Our teenagers cannot afford to fall ill, or get tired, or pursue some creative activity, or take a break. If they do any of these, their future is gone-- not just in terms of jobs or money, but also in terms of basic dignity of existence. Our system is that brittle. 

In my own case, for the crime of having been interested in science as an end in itself during my high school (and having my own science lab at home, and having built my own ham radio, etc.) and not focusing on my exams instead, I am still paying the price in terms of greatly attenuated opportunities and having to receive a lot of contempt and derision. We are way too brittle, and if we wish to really address our mental health crisis, we need to start building resilience into the system, rather than removing ceiling fans from student hostels so that students cannot hang themselves! 

Capability: The second dimension that we need to work on is a holistic sense of "capability" (to use the term in the sense of Amartya Sen's "capability" approach). Capability is an abstract term that refers to how easy is it for someone to build the lives they want, and act meaningfully. Capability includes, but is not limited to the technical and scientific knowledge we learn in college. It has several more dimensions like managing health, wealth, culture, people, uncertainty, risk, etc. 

We often say that college education should be "job oriented" and we reduce it even further, to focus just on what companies coming for placement are looking for. However, in a more fundamental sense, what we are all insecure about is not "job" per se, but "livelihood". For most of the country, jobs are still hard to come by. And even for the "elite" ones today, thanks to disruptions caused by AI, a "job" is no longer a guarantee for "livelihood". 

When we address livelihood instead of jobs, we see that we will need to impart many more skills to our students. Most importantly, jobs require our students to compete for a small number of positions, while livelihood requires them to collaborate and promote teamwork to improve our chances of earning. Livelihood training requires us to teach how to identify problems, how to find what the market needs, how to manage costs, how to manage uncertainty, how to build networks, etc. A job oriented approach to education makes us more competitive and insecure, while a livelihood oriented approach makes us more capable as well as resilient. 

Creative agency: The real outcome of education is how we are ourselves transformed as a result of our learning journey. To promote this, we need to encourage originality of thought and action-- or our creative agency. In most of our curriculum, we only teach from books and get students to understand what knowledge others have built. We hardly ever get students to create their own knowledge. 

Knowledge creation is a very hard process. It is not as easy as it sounds. We easily form opinions-- but an opinion is not knowledge. The most important skill to learn for knowledge creation, is objectivity-- or separating the creation from the creator. Whatever we create will be subject to a lot of failures and criticism, and it is very important for us to learn how to direct the criticism to the idea (even if the critic aims it at us), and improve our creation, rather than respond to it as an assault. 

Sovereignty: Finally, if we really need to bring about Viksit Bharat, protecting and upholding sovereignty in all its dimensions is of utmost importance. Today, we are increasingly becoming dependent on technologies that are developed and even controlled from outside India (GPS, AI, Semiconductors, social media, mobile phones, etc.) And for a large part, it is our own former students who have been instrumental in developing these technologies, that are sold back to us at a premium, and which can be turned off by some external party, anytime. 

In recent times, there are some very encouraging efforts to move development of key technologies to within the country. But without ground level changes in our education and research ecosystem, it is very hard to really bring traction to these initiatives within the country-- and, like in the case of automobiles or mobile phones, we may just end up as another assembly line unit for technologies that are conceived, designed and developed outside the country. 

The above would be what I would call the foundations of a Bharatiya approach to our formal education. Indian Knowledge Systems (IKS) are definitely very important and should be introduced as a subject or even as an entire discipline of study in our formal education. But our indigenous approach to education should be based on original thought rooted in today's reality. 

01 July, 2026

Insights - 1: The social value of academic research

This is the first in a series of posts on my lessons learnt from being in an academic environment that promotes a research mindset, and also as an administrator having tried my hand at nurturing and strengthening such an environment. 

*~*~*~*~*

Conventionally, the term "research" was associated with universities and academia, while "industry" was all about production, manufacturing, construction, and business. This is because, research is the process of creating new knowledge, and up until the mid 20th century, knowledge was seen as the exclusive forte of academia and universities. 

But this stereotype started changing by the mid 20th century. For example, many foundational concepts that make up a textbook in Computer Science today-- like automata theory and finite state machines, have their roots in industrial research labs like Bell labs, Xerox PARC, etc. 

Ever since the end of the second world war, industries have steadily acquired more and more knowledge processing capabilities. Today, even the conventional industries invest more in knowledge processing than in the actual mechanics of construction or manufacturing. An EV car manufacturer for example, need not learn about internal combustion engines at all, but needs to learn about software engineering for safety critical systems. 

The role of knowledge processing in industries have become so much, that some people even argue that universities are not needed anymore, and that (especially with the onset of AI) universities are broken, and not relevant anymore. 

There are also several corporate entities starting their own universities stressing on the "industry focused" nature of their syllabus and research activities. 

*~*~*~*~*

In this post, I would like to characterise the social value of what we conventionally know as academic research-- knowledge building activities involving more of books and thinking and debating, and less of programming, GPUs and AI. 

Firstly, let me address the misconception that academic research is "theoretical" in nature, while industry research is "applied". I think this framing is incorrect. Several theoretical results have come out of industrial research, and a lot of academic research address practical issues. 

Yet another misconception is that academic research is somehow "blue sky" in nature-- in that, these are knowledge pursuits as an end in itself, pursued just for the aesthetic beauty of the underlying mathematics. Maybe so, but I find this argument too often being used to evade accountability. "Just give us money and leave us alone" is what this argument seems to say, which after being an administrator, I find it hard to digest. 

This post is hence, about the social value of academic research. If society is to support industry or academia, there needs to be a value proposition that we offer to society. As academics, we have to now ask that if knowledge generation is greatly facilitated by the better levels of wealth and resources available in the industry, does academic research have any social value at all? 

Similarly, when we say that AI can replace education altogether, and industry can offer more resources than an academic environment ever could, does conventional universities hold any social value at all? 

At least in the current way we are interpreting the role of universities-- as institutions providing skilled personnel to the industry-- our answer may well be that universities will be obsolete soon, and the society will not miss anything. 

*~*~*~*~*

I would however, like to argue just the opposite. Knowledge processing may have entered the forte of industry and business in a big way in the 21st century, but there is a characteristic difference between how knowledge is processed in the industry and in the university (and no-- it is not applied versus theory). 

Here is my understanding about research in the industry and research in academia: 

Industrial research builds social capability, while academic research (needs to) builds social resilience. 

Industrial research often starts with engineering or business challenges, builds new technologies to address these challenges and sometimes goes further to build a new science that lays the conceptual foundations for the technology. The end result of this is that some form of social capability is enhanced. As a result of industrial research, we typically end up doing something better, faster, at a larger scale, with lesser time and resources, etc. Sometimes the capability advances are so huge, that it ends up "disrupting" the existing way of doing things and bringing in qualitative changes in the way we did things. For instance, the Internet made information flow so fast and so much more capable, that it did not just create faster telephones and telegraphs, or better radios-- it entirely reinvented the way we process information and organise societies. 

This kind of research includes both applied and theoretical elements. Many of these could also lead to "blue sky" endeavours that are pursued just for the beauty inherent in these research questions. But all of these primarily are driven by the zest to enhance capabilities. 

Academic research on the other hand, had served and will continue to serve, a very different purpose. Academic research is not (should not be) based on what we produce-- but on what we become as a result of the research journey. Academia is fundamentally about building people-- not building knowledge or technology. The outcome of an academic research journey is (should be) greater wisdom, greater awareness, greater philosophical depth in people's everyday conduct. 

This could eventually result in better technologies and greater capability, when these people come together and build industries. 

Academia builds new knowledge not as an end in itself-- but as a means to build and empower people. It is the way that the people transform when they build new knowledge, which is the key outcome of academia rather than the knowledge itself. The collective outcome from such an endeavour is social resilience.

Social resilience is the ability of a society to absorb shocks and disruptions, and reinvent itself to bounce back stronger. Every increase in capability eventually leads to a critical juncture that results in a paradigmatic change in the way society operates. In such cases, it is our resilience that keeps us from falling into chaos and emerging stronger from the disruption. 

Today, AI is disrupting the workforce like never before. There are very real possibilities of large-scale job losses and threats to individual privacy as well as national sovereignty by AI. But advancements in AI continue nevertheless. Will this disruption lead to widespread chaos and strife in our society, or will we as a society absorb this shock and reinvent ourselves, will be a function of how resilient our education has made us.

Social resilience is possible when the individuals operating in it are resilient themselves, and have the depth and capability to reimagine their lives and to reorganise their activities every so often. This comes from the philosophical depth from which they operate. If their ability to generate new knowledge is contingent upon them having access to huge resources and latest technology, they may be capable of specific things, but not exactly resilient as individuals. 

*~*~*~*~*

Let me explain further with an example. 

With great advances in AI, there is now a big concern about AI Ethics and Responsible AI. But the way this topic is being discussed today, has two broad categories. 

The first line of thought directly looks at the way AI is built and used today, and builds relevant structures around it to make it safer and act ethically. These could involve building guardrails, RLHF, hard (constitutional) constraints, sandboxing, etc. 

The other approach is to address the question philosophically, asking what do we mean by ethics itself? Is it doing something that conforms to expected norms (deontology)? Or is ethics about acting for the greater good (utilitarianism)? Or acting in a way that is mindful of consequences (consequentialism)? Or upholding some desirable characteristic (virtue)? This line of inquiry also asks whether acting ethically is necessarily in conflict with acting rationally to maximise self interest? Is ethics subjective or can there be an objective definition of AI ethics? Can one person's ethical AI be an evil nemesis when seen from another person's perspective? Can a machine be truly ethical or does it only reflect the ethical considerations inherent in its training? 

The two approaches are characteristically different. The former approach is addressing an immediate question. It is addressing the question of AI ethics primarily with a motivation to avoid getting hit by lawsuits. And any solution that can deflect the blame away from the AI is good enough for the business. The latter however, tries to understand the concept of ethics analytically and asks architectural questions about AI and tries to understand the meaning of a term like "ethics" that was once reserved for human conduct, to be now applied to machines. 

I remember some time ago in a research presentation, a member of the audience expressed concerns about the seriously intrusive nature of the technology being presented and its potential to be misused. For this, the speaker had only responded by saying that these experiments have passed IRB review (ethics board) and hence, it is legitimate. What struck me in this response was that the response did not address any of the specific concerns of future misuse of this technology being developed. It just responded to protect the current activity from scrutiny. The IRB only clears the current, proposed activity, and does not usually delve into its future implications. This episode in my opinion, is a clear marker that distinguishes industrial research (that wants a solution or a patch shipped out fast) versus an academic research pursuit (that wants to understand the deeper, underlying implications). 

*~*~*~*~*

Worldwide, we are failing to understand this subtlety, and are increasingly bringing the industrial research framing to evaluate academic research. 

I have seen several cases across many institutions, where some highly motivated PhD students would be juggling their research, job, and family all at once. But many of them burn out or drop out in between, even after working very hard and after paying significant tuition, simply because their PhD has an unwritten rule that it requires an "A*" paper to get them to graduate! 

What I see is not a failed PhD student or even low quality research. What I see is an individual who was resilient and motivated, but whose spirit was broken because the system failed to recognise the resilience and focused only on the output. As I see it, if this person understood the importance of setting aside time and effort for creating knowledge despite their daily grind and demands from work and family, then even a small success in this process helps them to reinforce their resilience, which would contribute constructively to society in important ways. 

But by not recognising this, and by framing research quality through a fairly narrow, and mostly meaningless lens, we are systematically tearing apart the only institution in society where resilience is built. 

13 May, 2018

Ruminations

Recently, a well-known researcher in my area of work, died an untimely death. He was just 42. While we were recovering from the shock of the sudden news, a colleague pointed to a news story that said the he had most likely taken his own life -- by jumping off from the terrace of his apartment building.

And while we were still reeling from this even more troubling news, another colleague of mine found his online blog post, where he had written about his fight with depression -- and had ended the post with a note of optimism that depression can be overcome.

It was particularly poignant to read this, and I think something snapped inside me. It was too much for me to remain silent.

Depression is a problem that is not new to me at all. I've written extensively about it on this very blog, including my own experiences as well as my analysis of what is the cause of such high rates of depression in our society. And like any other post on depression, I've hopefully ended my posts on a positive note, that life is worth living after all.

But clearly, in his case, depression seems to have won the battle. And it is not reassuring at all.

One of the reasons for my "coming out" publicly with my struggle with depression is that I see this as an endemic social problem afflicting our society. It is not just my problem, and my writings are not just for me to feel better. I have cited stats and formal studies to show that levels of depression and suicide are very high (compared to the global average), especially in south India. And also that the primary causes for depression are social in nature -- not physical.

My writings are meant to be an appeal to our society in general, to put a stop to this social "auto-immune disorder" and to recognise the latent trauma and insecurity that is driving and amplifying such problems. My writings are meant to be a fervent appeal to central elements of our society -- like parents, teachers, political leaders, bosses, line managers, industry leaders, religious leaders, etc. -- to please stop psychological assaults on those in a weaker position than them, using euphemisms like humility, discipline, chastity, submission, etc. It is literally killing people.

Most importantly, my writings are meant as an appeal to the next generation -- including my students -- to become aware of their own sense of insecurity and fear that is driving them. Becoming aware of these emotions is the first step towards overcoming them.

I have seen layers and layers of defences among our student population, who not only distrust the "system" and any person whom they associate with the "system", but have also learned to cynically play the system.

When going through other blog posts from this person, one thing stuck me as kind of odd. Most of his other posts were about the "outcomes" of his research. They were not about the research itself -- but its outcomes. They talked about the conference or journal where it was published, the impact factors of these venues, the bibliometrics of his work (h-index, i10 index, etc.), the peer review process, etc. I could not see any post that talked about the research itself -- the ideas that he was pursuing, the significance of those ideas, the new perspectives he is bringing to the table, the implications and possibilities of an idea becoming a reality.. stuff like that.

If my hunch is right, then I think I know why depression won the battle in this case. According to his posts, he first started experiencing depression in the year 2013. While for me, my first major visible tryst with depression was during my student days in the 1990s. And with more exploration, it was not hard for me to figure out that I'd been coping with trauma ever since kindergarten.

And the problem that was causing the trauma was also clear. The education system continuously asked for just two things -- compliance and outcomes. It wanted us to be docile, passive and compliant "good" children, and wanted us to generate superlative outcomes after superlative outcomes. The more we complied, and the better we performed, the more expectations we had to shoulder.

The system was not at all interested in how we were developing as individuals. It was not at all interested in what we were thinking, or what kinds of challenges we were facing while growing up. Nobody talked to us about adolescence or puberty. The changes in our body and mind in our teenage years was a matter of deep shame and guilt, for us. We read Archie comics on the sly, with a feeling of guilt, when we knew we should be studying for that board exam or entrance exam. We often bragged to one another about how much we studied -- the least was 10 hours every day (outside of school hours). I remember this one friend of mine, who used to keep a log of what time he went to sleep and what time he got up, and ensured that he never slept for more than 4 hours every night, so that he may be well prepared for his exams.

In high school, we often heard of some student or the other committing suicide, for having got less than what they expected in their exams. "Dull" students were often thrashed physically by their parents after their exams. And parents and teachers, often extolled the virtue of "fear" that younger generation should have towards elders and towards God ("God fearing" meant someone with good virtues). 

The same culture continues to this day, and in many ways it has become worse. I have somehow survived so far, that too in academics -- that is still ruled by prestige, pedigree and medals. I do not know what is keeping me going. Perhaps it is my undying curiosity to learn what is causing something. Every time I have been hit by something, while others have run away from it, I have naively tried to get hit again, to see what is causing it to happen:
There have been several times for instance, where I have been subject to rampant slander and derogatory gossip. And I'd also seen some very high-achieving individuals around me, get completely destroyed by such kinds of slander. But so far, what I have done is to only act even more provocatively and elicit more such gossip to try and understand how it works. This has given me rich data about the psychology underlying social cognition, the role of "narratives," and how it shapes our collective worldview. It has also led me to develop a formal model of what is an opinion, and the different ways in which opinions can come together to result in different forms of collective phenomena.

We have applied this understanding to model the dynamics of social media, political movements and economic battles.

Studying slander and gossip has also helped me understand the difference between "private" information and "secure" information. It has also helped me narrow down the question of information utility to four primary factors.

The study of narratives has also helped me understand predatory and non-predatory (sustainability) dynamics of social cognition. Predatory approaches to social cognition model knowledge creation as a "convergent" process. All parties involved in the process have to converge to one narrative. Some elements of "fairness" are introduced to provide a semblance of balance. However, on the whole, it would be amply clear that prevailing power asymmetry would be the primary factor that governs the final shape that the knowledge takes.

For instance, on Wikipedia, every topic has to have one page that all different perspectives have to agree upon. To keep the process "fair" some rules are introduced, like NPOV (neutral point of view), NOR (no original research), VS (verifiable source), etc. However, it is amply clear that the model is biased towards a Western worldview that has had a tradition of formal book-keeping and recording of research. Consider an article about (say) the Mahabharata, which has been kept alive for thousands of years in India, by a tradition of story-telling. None of these stories would be considered a credible, scholarly source, while a "research" article published in a Western journal about the Mahabharata, based on flawed colonial theories of Indian history, would be considered more credible.

Such kinds of questions have prompted us to explore non-predatory models of knowledge representation, where multiple narratives can co-exist without necessarily having to blend into one another in a semantic melting pot. This question also has implications on managing a large country like India, that has ample amounts of innate diversity. We cannot have a pan-Indian "melting pot" (like for example, having everyone speak in Hindi), without causing severe cultural damage. Yet at the same time, we have to nurture and develop the sense of Oneness underlying the diversity such that the disparate cultures exist separately, yet interoperate seamlessly.

Inspired by such thoughts, we have developed a knowledge model in our lab, called Many Worlds on a Frame (MWF), which we have in turn, applied to several problems like knowledge integration, privacy preserving transactions, decentralised access control, etc.

While we have published much of our work, I really do not know the impact factors of the venues where we published, nor have we kept track of the citations. We have not really tried to play the research networking game of increasing citations and impact either.

Whenever faced with a dilemma of working towards greater impact, or working towards greater insight, we have always favoured insight over impact.

I have seen that working towards impact is primarily driven by a sense of insecurity, and it only ends up increasing the insecurity. Working towards insight on the other hand, gives us more insight into the insecure and fragile nature of our lives and careers, and ironically, this insight helps us manage our insecurities better.

Much as we like to be objective, and separate ourselves from our ideas, it is amply clear that the original ideas we develop are an extension of our selves. We develop it in an objective fashion, because we care about the quality of the idea. But that does not refute the fact that ultimately we see ourselves in the ideas that we develop.

To live in a system that judges solely based on our outcomes and quantifiable factors, makes us vulnerable to getting assaulted at every step. It is a matter of time before depression gets the better of us, if we start implicitly believing that our outcomes and metrics somehow define our worth, as a person. 

21 September, 2012

Challenges in expanding the pie

In this country, we face an acute problem of saturation. Just about anything has intense competition. Scarcity (natural or artificial) is rampant and it is not uncommon to see people fight desperately over stakes that are trivial when compared globally.

And hence, about a decade and half ago, when I started my career, I adopted a personal philosophy: expand the pie, don't fight for a share of it.

It was evident (to me) that unless we make the available pie bigger, any amount of competitiveness is eventually going to hit a barrier. And being literally resourceless and broke, the only option available to me for helping in expanding the pie, is to take up a career in applied research.

Several years down the line, looking back at a very turbulent journey so far, it is time to reflect.

Firstly, do I regret anything? Absolutely not! It has been an absolutely invigorating journey and even successful in bits and pieces. Second, do I think that "expand the pie" belief was untrue? Absolutely not, again. Time and again we keep seeing news stories of us getting into saturation mode (fuel, power, garbage, jobs, traffic, etc.) and unless we build a vast culture of pie expanding enthusiasts, we only stand to face huge crises in the future.

But then, expanding the pie is easier said than done. We cannot start looking at ways of expanding the pie after we are hit by a crisis. We should be well prepared long before. The best times to prepare for war are in times of peace, as the saying goes.

Here are some of my experiences and lessons learned in trying to expand the pie:

You will encounter vested interests 

We have all the technology required for providing voice telephony using the Internet as the backbone and reduce international telephone tariffs to a small fraction of what they are today. Yet, that does not happen.

When we expand the pie and create a new solution that threatens to obsolete some existing technology, expect to get your idea killed. Expanding the pie is way more involved than just creating new technology.

And before ranting against huge telecom corporations, ask yourself what would you do if you have painstakingly built a company over several decades, which employs hundreds of thousands of people and you are suddenly faced with the prospect of a disruptive new idea that can make your company collapse in no time?

Beware of the fear of the unknown 

Expanding the pie necessarily means venturing into the unknown. We may think we are adults, but we don't realize that we are adults only when we are in familiar mental territory. The moment we are in the unknown, our primal fears surface in ways that we cannot even fathom.

I have not seen a single researcher worth his salt, who has not been paranoid at some time or the other. Scientists may appear emotionless, and indeed you may even find several of them advocating dispassionate and objective thought. But, the process of development of science is anything but dispassionate and objective.

Also, the way people react to the unknown is very unpredictable. They may suddenly become unusually defensive or offensive, get into a closet and refuse to communicate, take big decisive actions rather on an impulse, and so on.

Your intentions will be misinterpreted 

Come to think of it -- the herd is moving in one direction and fiercely fighting over that little piece of bread, and here you are walking away in a different direction...

Of course, your intentions will be misinterpreted. You will be seen with suspicion, your integrity will be questioned, people will put up safety nets against you, call you weird, will secretly want to see you dead, and what not.

Expect it. At least then, you will not be hurt too much when you encounter it.

Remember the Gandhi quote without the last line

Remember this saying?

First they laugh at you
Then they ignore you
Then they fight you 
Then you win..!

Remember that well, except the last line. Replace it with, "And then you claim victory..!"

When you expand the pie, you will not necessarily get a share of it.

Gandhi himself did not live long enough to really see the independent India that he fought so hard to bring about.

When you develop good ideas that successfully question status quo -- it will eventually get adopted. But you will most likely not be in the picture there (even if you are alive and kicking..)

Expect to be muscled around, handed ridiculously one-sided contracts to sign, being told that your ideas are obvious and trivial, being sweet-talked while your students and coworkers are getting poached, the list goes on..

Be aware. Don't compromise. Be ready to lose what you have and always remember that your real wealth is within you -- your ability to think and develop ideas. Keep working on that ability and see to it that it never gets sidelined in all such worldly nonsense.

Agents and Beings

Let me start this argument by narrating a couple of stories:  Story 1:  This happened several decades ago when I was an engineering student....