New York City

New York City's Child Welfare System Under Scrutiny for Racial Bias and Questionable AI Practices

AI Assisted Icon
Published on June 04, 2025
New York City's Child Welfare System Under Scrutiny for Racial Bias and Questionable AI PracticesSource: Unsplash/ Eyasu Etsub

The fabric of New York City's child welfare system has been called into question, highlighting incidents of suspected racial bias in the city's Administration for Children's Services (ACS) operations. The report reveals a disturbing pattern where Black and Latino families are subjected to more punitive measures, with ACS being seven times more likely to investigate a Black family than a white one, and children of color disproportionally placed in foster care. The Bronx Defenders, a public defender group, has brought attention to several cases where ACS acted prematurely, such as removing a child from a household following an incident deemed accidental by the court, as per Gothamist report.

In similar tone, The Markup's recent investigation unveiled another concerning layer of scrutiny through an artificial intelligence algorithm ACS utilizes to assess harm risks in households; this tool employs factors like neighborhood and a caretaker's mental health in its evaluation, aspects often linked to socioeconomic status, and which could perpetuate systemic biases, since the majority of ACS's interventions target families of color and residents from impoverished neighborhoods—factors that could bias the algorithm right from the start. Despite an internal audit acknowledging possible inherent biases, ACS spokesperson Marisa Kaufman claims measures are in place to mitigate these issues; still, the app's covert existence raises red flags about transparency and fairness in ACS's operations.

Their algorithm, established in 2018, scrutinizes families with a system that uses a staggering 279 variables, without disclosing its application to affected families or their legal representatives. This lack of transparency means individuals like Karlena Hamblin, a Brownsville mother who's been under ACS watch since her pregnancy, are left bewildered and anxious over the prospect of family separation, according to The Markup interview. Her past as a foster child and a single encounter with postpartum depression seem to have entrapped her in a cycle of surveillance and fear in the eyes of the city's child welfare agency, an experience echoed by many others ensnared by the agency's dragnet.

The stories emerging from the underpinnings of New York's child welfare system paint a somber picture of a larger societal problem; algorithmic oversight coupled with human bias forms a Gordian knot that parents, primarily from minority communities, are somehow expected to untangle, while risking to have their children snatched away based on statistics, rather than individual circumstances. A public defender's group, The Bronx Defenders, underscored this issue with cases showing how swiftly ACS could move from spurious complaints to drastic actions, taking children away without necessary judicial approval, as detailed by a Gothamist report.

It's a complex situation compounded by the reality that most calls to ACS are ultimately deemed unfounded, yet the opening of a case can unravel a family's sense of safety, resulting in months-long dread and uncertainty. Jasmine Mitchell, a CUNY film student, underwent this prolonged stress twice with ACS investigations that led nowhere and shared with The Markup her concern over being in a database despite her cases being unfounded, "It feels like there’s this permanence to it even though both of my investigations were unfounded." These findings, from both reports, question the effectiveness and fairness of ACS's protective measures, casting a long shadow over New York City's intentions to genuinely safeguard its youngest residents.