Joy in the Agentic Age

Muses, not sirens

When people become detached from directly generating ideas and solutions, they lose their connection to the outcomes. We must be careful not to over-automate to the point where people lose ownership and involvement in work, including work within the family.

These issues are compounded by the risks of supernormal stimuli. AI companions can either nurture human flourishing or lead to unhealthy dependencies. The key distinction is whether they act as muses (genuinely enhancing capabilities and relationships, inspiring growth and creativity) or as sirens, providing superficial validation that ultimately hollows out meaningful experience. The tension becomes more pressing as AI companions grow more sophisticated in their ability to understand and respond to human emotional needs.

AI companions must serve as supplements, not substitutes, for human connection and meaning-making. They should encourage authentic growth and agency rather than creating dependent relationships or oversimplified solutions to complex emotional needs. With those elements in place, AI does have an opportunity to improve our perceived wellbeing: keeping us company, providing useful and timely advice, and finding ways to surprise and delight us.

By aggregating diverse data streams (from biometric signals and behavioural indicators to self-reported experiences), AI can identify patterns associated with wellbeing across various contexts and cultures. Some things have to hold everywhere, such as a floor against coercion. How they are honoured can differ from place to place, and only that second part is negotiable.

AI could offer personalised support through insightful, gentle suggestions tailored to individual preferences, helping people understand their own patterns and triggers. Different groups emphasise different domains (spiritual, material, communal), and these values naturally evolve over time. AI’s role should be to observe and learn, not to impose or oversimplify cultural variations.

When cultural values conflict, AI systems must tread carefully. Beyond a reference set of widely agreed-upon minimal standards, AI can model different value systems and simulate compromise scenarios while maintaining transparency about its active framework. This requires robust public oversight, where stakeholder communities can verify and adjust moral calibrations.

By combining quantitative data (e.g., biometric signals) with qualitative data (e.g., self-reported feelings) through interdisciplinary frameworks, AI can map the rich variations in how people define and experience happiness. These frameworks should span anthropology, psychology, and sociology. Special attention must be paid to underrepresented communities who may not be reflected accurately in mainstream data collection, making proactive outreach and culturally sensitive tools essential.

Predictive models can highlight mental health risks or inform resource allocation, but they must be used judiciously, balancing insight with respect for individual autonomy. AI must never dictate or coerce behaviour in the name of happiness, and people should be able to easily opt out of AI-driven “nudges”. Local contexts, cultural norms, and potential unintended consequences all matter, but there must also be an ethical floor beneath which no practice can be endorsed, even in the name of respecting difference.

Privacy and human agency must be fiercely guarded while gathering happiness-related data, with individuals and communities understanding how predictions are made.

The ideal role for AI is as a tool for expanding our understanding of wellbeing, leaving the ultimate pursuit and definition of happiness to humans themselves. AI can help create conditions conducive to flourishing (through genuine benevolent intention, actively wishing people well) without trying to optimise or standardise it. While AI’s predictions can highlight emerging risks or opportunities, and even sketch a credible plan to pursue them, final decisions about implementation should remain firmly in human hands.

Success means AI serving as a facilitator of human flourishing rather than its arbiter, helping create opportunities for wellbeing while preserving the freedom of individuals and cultures to define and pursue happiness in their own ways. While AI can illuminate potential paths to happiness, the journey itself belongs to us. Happiness is drawn from self-respect and self-efficacy: living our values in daily practice. We must never allow autonomous machines to usurp human autonomy, or to dilute the meaning in the works we produce for others.