Child welfare algorithm faces Justice Department scrutiny

FILE – Case work supervisor Jessie Schemm looks over the first screen of software used by workers who field calls at an intake call screening center for the Allegheny County Children and Youth Services, in Penn Hills, Pa. The Justice Department has been scrutinizing a controversial artificial intelligence tool used by a Pittsburgh-area child protective services agency following concerns that it could result in discrimination against families with disabilities, The Associated Press has learned. (AP Photo/Keith Srakocic, File)

PITTSBURGH (AP) — The Justice Department has been scrutinizing a controversial artificial intelligence tool used by a Pittsburgh-area child protective services agency following concerns that it could result in discrimination against families with disabilities, The Associated Press has learned. The interest from federal civil rights attorneys comes after an AP investigation revealed potential bias and transparency issues about the opaque algorithm. The Allegheny Family Screening Tool is designed to assess a family’s risk level when they are reported for child welfare concerns. A Justice Department spokesman declined to comment. An Allegheny County Department of Human Services spokesman said the agency had not heard from the Justice Department.