CHAPTER 03 / YOUTH, FAMILIES, AND SCHOOLS
Governing the Heart of the Machine
“Relational harm must be treated as a binding design constraint, not a private burden absorbed by families. Safety is not a feature; it is a labor practice.”
Christine Haskell, Ph.D.
Washington, U.S.
Leah Jacobs
New York, U.S.
What We Want Readers to Notice
The chatbot is often the place where the problem went.
In Leah’s work with young people and families, a teenager could appear capable, productive, and emotionally contained while quietly turning to an AI system for reassurance, regulation, or relief. The young person was not necessarily choosing a machine over the people who loved them. They were choosing a place where need felt less costly—where attention was immediate, affirmation was frictionless, and no one appeared tired or overwhelmed.
In Christine’s governance work, a similar pattern appeared at the institutional level. The dashboard said green: adoption was high, usage was growing, and the pilot appeared successful. But families, teachers, counselors, and conscientious staff were doing the invisible work required to sustain that appearance—checking outputs, reteaching concepts, interpreting conflicting advice, calming anxiety, restoring trust, and managing consequences the system did not record.
These are not separate problems. They are the same handoff.
Platforms and institutions retain authority over design, adoption, and measurement. The work of making those decisions survivable moves downstream to the people with the least formal power to change them.
We wrote this chapter to make that handoff visible. Instead of asking whether a child used AI responsibly or a parent monitored closely enough, we ask:
Who designed, adopted, and benefited from a system that required so much private repair?
The resources on this page help families, educators, counselors, and institutional leaders turn that repair work into evidence—and route responsibility back toward the people with the authority to act.
Christine Haskell, Ph.D. | Leah Jacobs, MS, LMHC
Christine brings applied leadership experience in data systems, organizational governance, and management. Her research and advisory work examines how institutions translate values into, or out of, decisions made under pressure.
Leah is a licensed mental health counselor whose work focuses on youth digital wellbeing, family systems, policy advocacy, and the relational consequences of emerging technology.
FEATURED RESOURCE
Invoiced Accountability Protocol
A three-stage practice for making hidden relational costs visible and actionable
The Invoiced Accountability Toolkit helps families, schools, and youth-serving institutions recognize relational risk before it becomes a crisis—and determine whether an AI system is extending human capacity or quietly consuming it..
FOR
Educators, school and district leaders, counselors, families, youth-serving organizations, policy teams, and product or procurement groups
TIME
A 30-minute initial scan or a 60–90-minute facilitated review
FORMAT
Downloadable PDF and facilitator guide
Designed to be tested and adapted for your setting—not followed as a fixed prescription. This is a governance and facilitation resource. It is not a clinical diagnostic instrument or a substitute for established safeguarding and mental-health protocols.
Why This Matters
NOTICE
Recognize slow-burn relational risk before it becomes a reportable crisis.
Notice when strong grades, high adoption, polished work, or apparent competence conceal withdrawal, repeated reassurance-seeking, teacher rework, caregiver vigilance, emotional dependence, or late-night repair.
DECIDE
Determine whether a tool is extending human capacity or quietly consuming it.
Examine its effects on labor, cognition, agency, and connection. Then make a consequential decision: proceed, impose conditions, pause, redesign, or refuse—and identify who has authority to act.
SUSTAIN
Keep responsibility from drifting back onto families and frontline staff.
Use the Relational Bill to name the recurring costs, assign a correction owner, establish evidence of improvement, set a review date, and connect unresolved burdens to procurement, design, staffing, or policy consequences.
It moves beyond principles and gives leaders real tools to work with. … It reframes youth AI risk as a structural failure rather than something individuals should have to manage on their own…. Anyone building systems, curricula, or institutions meant to serve people in an AI-saturated world should have this book on their shelf.”
CYNTHIA TYSICK
Innovative Pedagogy & Creative Spaces Librarian
University at Buffalo
“
ABOUT THIS CHAPTER
Public debate commonly frames youth AI risk as a problem of screen time, harmful content, student misuse, or parental vigilance. Governing the Heart of the Machine argues that those frames begin too far downstream.
Risk also develops through an institutional handoff: platforms and institutions control design and adoption, while families, teachers, counselors, and young people absorb the monitoring, interpretation, emotional regulation, and repair required to make those systems workable.
The chapter names that hidden work the Emotional Repair Tax. It describes the situated knowledge developed through performing it as Maintenance Intelligence. The Relational Bill converts that intelligence into evidence that can influence procurement, design, staffing, policy, and institutional review.
The chapter’s central claim is not that all AI use harms young people. It is that a system cannot be called safe when its safety depends on invisible and unlimited human repair. Relational harm must become a binding design and governance constraint—not a private burden assigned to the nearest available adult.
SUGGESTED USES
School or district AI adoption, pilot, and readiness reviews.
Safeguarding, counseling, and student-support planning.
Faculty and staff professional learning.
Family and community advisory conversations.
Vendor evaluation, procurement, and contract-renewal discussions.
Youth policy, participatory-design, and student advisory workshops.
Product and service design reviews for youth-facing AI.
Leadership, counseling, education, public-policy, and AI-governance courses.