top of page
Search

Beyond the Data: My Case for Human-Centered AI Governance

  • Writer: piya mitra
    piya mitra
  • Aug 11
  • 6 min read

I live in Silicon Valley, where technological change often feels immediate. New models appear, capabilities expand, and conversations quickly move from what is possible today to what might be possible tomorrow. There is an energy here that I find exciting. It is difficult not to be inspired by the creativity, ambition, and speed with which new ideas are built.

But living so close to the center of technological innovation has also made me think more deeply about something else: Who are we building all of this for?

The answer cannot only be the people who already understand the technology, have easy access to it, or live in the places where these systems are being designed. The world is much larger than Silicon Valley, and much of what has shaped my thinking about artificial intelligence has come from outside it.

Travel has always changed the way I see the world. Over the years, I have spent time in communities with very different relationships to technology, infrastructure, education, opportunity, and institutions. I have worked with children, families, educators, community organizations, and people whose everyday realities can look very different from the environment I return to in California.

Those experiences have stayed with me as I have become more involved in AI governance.

When we talk about artificial intelligence, we often talk about scale. We talk about millions of users, billions of parameters, global deployment, efficiency, productivity, and adoption. But humanity does not experience the world at scale. We experience it individually.

Every person has a childhood, a family, a history, a culture, an economic reality, a language, a set of relationships, and a way of understanding the world. Each person carries memories, fears, aspirations, contradictions, and experiences that may never appear neatly in a dataset.

That is where my human-centered approach to AI begins.

It did not begin with studying AI regulation or learning governance frameworks. It began much earlier, through years of working with communities.

Working with children taught me very quickly that two children of the same age, sitting in the same classroom, can experience the world in completely different ways. Travel taught me that something considered ordinary in one culture may carry an entirely different meaning in another. Community work taught me that trust, vulnerability, access, and power are rarely distributed equally.

Those experiences taught me something that now feels even more important in the age of artificial intelligence: diversity is not a statistical problem to solve. It is the reality of humanity.

Humanity Is Not Just Data

AI systems depend on data. They identify patterns, calculate probabilities, make classifications, and generate predictions from information that can be processed computationally. That is part of what makes these systems useful.

But a representation of a human being is not the same thing as the human being.

Humanity is not just data.

It is joy and grief, laughter and tears, love and fear. It is memory and hope. It is resilience, disappointment, aspiration, contradiction, instinct, and emotion. Human beings are imperfect. We are contextual and sometimes irrational. We change our minds. We react differently depending on who we are with, what we have experienced, and what is happening around us.

We are messy.

I do not see that messiness as something technology should eliminate. It is part of what makes us human.

A dataset cannot fully capture a childhood. It cannot completely explain a relationship, a migration, a loss, a culture, a family history, or the circumstances that led someone to make a particular decision. Two people may look almost identical when represented by a set of variables and still be living completely different lives.

Yet increasingly, AI systems may help determine whether someone receives an opportunity, is selected for an interview, receives medical attention, is approved for credit, gains access to a service, or is flagged as a risk.

When the consequences become that significant, the difference between a data point and a human life matters.

We should be cautious about translating human complexity into standardized categories simply because those categories are easier for machines to process. Human beings should not have to become less complex so that machines can understand us. AI must learn to operate responsibly within the complexity of being human.

The People Behind the Data

When discussions about AI become dominated by benchmarks, capabilities, model performance, and scale, I find myself thinking about people I have met over the years.

I think about children laughing together while creating art. I think about teachers trying to open new possibilities for their students. I think about women I have met in communities far from my own. I think about parents, elders, and families navigating circumstances that could never be completely understood through a collection of variables.

I think about people who may someday be affected by an AI system without ever knowing that an algorithm played a role in a decision about them.

Some may not know that such a decision can be challenged. Some may not understand how the system works. Some may live in places where technological literacy is limited or where access to institutions capable of correcting an automated mistake is difficult.

They cannot simply be treated as an abstract user population.

They are people.

Each person has a story that began long before an AI system encountered their data and will continue long after that system produces an output about them.

This is the part of AI that interests me most.

Why Governance Matters

AI governance can sound highly technical. We talk about risk classifications, impact assessments, controls, monitoring, documentation, human oversight, standards, and regulation. All of those mechanisms matter.

But beneath them is a very human question:

What happens to the person when the system gets it wrong?

A model can perform extremely well overall and still fail an individual. A system can operate exactly as it was designed and still produce an outcome that is unfair. An automated process can make an organization more efficient while making it much harder for the person affected to understand what happened or to challenge the decision.

Even the idea of having a human "in the loop" can become meaningless if that person does not have the authority, information, or confidence to question what the system is recommending.

For me, meaningful human oversight means more than simply placing a person somewhere in an automated workflow. It means that someone can understand the system's role, challenge its output, override it when necessary, escalate concerns, and stop its use when there is a serious risk of harm.

That is governance.

It is also accountability.

As AI becomes increasingly embedded in healthcare, employment, education, finance, public services, safety, and other areas that shape people's lives, we need to keep asking questions that cannot be answered by technical performance alone.

Whose experience was represented when the system was built? Whose experience may have been missing? What assumptions were made? Who could be harmed if those assumptions are wrong? Can someone affected by the system challenge what has happened to them? And when something does go wrong, who is responsible for making it right?

Those questions are not obstacles to innovation. They are part of responsible innovation.

Capability Is Not the Same as Permission

One principle has become increasingly important to me: just because an AI system can do something does not automatically mean it should.

Technological capability is not the same as social permission.

The fact that a decision can be automated does not mean removing human judgment is always an improvement. The fact that something can be done faster does not necessarily mean it is being done better. Efficiency matters, but it should not automatically take priority over dignity, fairness, agency, privacy, or safety.

The more capable AI becomes, the more important these distinctions will become.

I do not believe the answer is to stop technological progress. I am fascinated by AI and optimistic about many of the ways it can improve human life. But optimism does not require abandoning scrutiny. In fact, I believe technologies become more valuable when people can trust the systems around them.

Trust comes from knowing that there are boundaries. It comes from understanding that someone is accountable. It comes from knowing that a decision can be questioned and that a human being has not disappeared entirely from the process.

Building AI for a Complex Human World

The future of AI cannot be designed only for the most technologically advanced among us.

If these systems are going to become part of global society, they will have to operate across cultures, languages, economic circumstances, histories, political systems, abilities, and ways of living that may be very different from the environments in which the technology was created.

That requires humility.

It requires recognizing that no dataset can fully represent humanity and no model can completely understand the complexity of an individual life.

It also requires us to remember that the goal is not to make humanity easier for machines to categorize. The goal should be to build and govern technology in ways that respect the people it is intended to serve.

That is why I chose AI governance.

Not because I want to stand in the way of innovation, but because I want to help ensure that people remain visible as innovation moves forward.

When I think about the future of artificial intelligence, I do not only think about what the technology will be able to do.

I think about the people standing on the other side of its decisions.

Because beyond every dataset is a person. Beyond every prediction is a life. And as AI becomes more powerful, our responsibility is to make sure we never forget the


 
 
 

Comments


bottom of page