THE KALEIDOSCOPE PROJECT

Community Owned Contextual Deployment Data

  • COMMUNITIES

  • EVIDENCE BASED DECISION MAKING

  • PERSONAL AGENCY

  • PERSONAL AGENCY

  • PERSONAL AGENCY

  • PERSONAL AGENCY

Only 9% of Americans believe AI will do more good than harm, yet it is increasingly embedding itself within society, often in the name of social impact.

The "AI for Good" movement promotes spreading frontier models for "societal benefit" despite limited evidence of meaningful impact, low public desire, and self-admitted claims that already-present harms can escalate.

This top down push from Big Tech involves partnering with "trust based institutions" who choose to look past their mass, non-consensual collection of training data, environmental harms, and contracts in defense, surveillance, and other mechanisms for oppression. This helps improve poor public sentiment and penetrate the market at a time of light regulation while circumventing accountability as downstream communities absorb risks.

The Kaleidoscope Project is an organization that aims to counterbalance this top-down push by researching and facilitating ethically-sourced, community-owned contextual deployment dataset to strengthen evidence-based decision making, strategic cross-functional coalitions, and public agency.

Our pilot research project is mapping the expertise of anyone whose work fits into one of our Kaleidoscope categories? This short survey will help produce a public report at minimum and may be connected to resources to progress your work. [COMING SOON]

The Kaleidoscope Model

While many participate in "AI for Good" in nuanced ways, they generally fall into one of 6 groups defined by the unique leverage and gaps defined by their interventions. Currently,

01

Evidence & Transparency

02

Big Tech Independence

03

Agency & Ownership

04

Surface Collective Input

05

Invest in Foundations

01

Evidence & Transparency

Honest measurement should move on from vague metrics like “Lives Impacted” towards quantifying the “Net Effect” (benefits minus harms) of an AI’s deployment. Numbers can’t fully measure impact so they must be paired with longitudinal, depth-based interviews. Transparency in this measurement and other aspects (e.g., policies, data retention) helps to ensure accountability, lift others and move towards field-wide standards.

02

Big Tech Independence

Partnerships between Big Tech (especially LLM developers) and CSOs require scrutiny. Big Tech gets increased usage from embedding their tools in core social services and an improved reputation from associating with impact, while CSOs risk theirs on widely distrusted tools. That distrust is warranted given opaque data practices and model interpretability, contracts with surveillance/"defense" tech and the unilateral power to change core functionality or pricing at any time.

03

Community Agency & Ownership

There’s an enormous gap between those who decide to build, and especially fund, “AI for Good” and those who interact with it. When AI replaces a person in a service that someone depends on, a choice is forced onto them. While the lack of consent is problematic alone, it’s compounded by undisclosed use, retained data, and the lack of standards around quality. Even our own attempts at comprehensive evidence frameworks can’t encapsulate the nuanced benefits of human interaction. Regardless of how good any builder, funder, or evaluator thinks an AI tool is, the people who will use the tool should have governance power to decide how and whether it’s deployed and clear ownership of their data.

04

Surface Collective Input

A founder’s “lived experience” is important, but it doesn't reflect the diversity within a community. What’s more critical is community input at scale. “Community design” is an established principle in social impact but is often treated as a checkbox or afterthought. True community input should happen before prototyping so they can shape the foundations. This community involvement should be codified into governance mechanisms and evaluation methods so that it can’t be overlooked when inconvenient. 

05

Invest in Foundations

While AI is sold as a leapfrog technology, no AI application stands alone. Most require devices, internet access, and digital literacy. Without these foundations, AI can exacerbate divides within a single community. Before deploying AI, first audit and, if needed, fund the foundations. This includes education about what happens to people’s data and where these tools fail. Investing in these foundations also avoids the “saviorism” trap of deploying a culturally ignorant tool or creating unforeseen maintenance burdens. The right investment should give communities power and capacity to innovate on their own.

How We Work

We partner with philanthropies, governments, or anyone else navigating social impact in the age of AI.

Diligence

Assess "AI for Good" philanthropic investments via comprehensive reports.

Education

Educate your staff or portfolio about all things responsible AI.

Governance

Embed AI responsibly in your organization to improve efficiency while minimizing risk.

AI Evaluations

Measure an AI solution's ability to reach your impact goals with a quantifiable score.

Our Impact

>$15M

de-risked as diligence lead

>$100M

AI funding pool supported

>200 people

taught responsible AI