A man who cared for developmentally disabled adults is now charged with abusing them.Milwaukee police believe the man took advantage of at least two women living in a residential facility.The living facility is supposed to be a refuge, a safety net for cognitively disabled adults near 52nd and Burleigh streets, but prosecutors said 32-year-old James Williams violated that trust by repeatedly sexually abusing two women, one of whom is described as functioning at a first-grade level.VIDEO: Man accused of abusing two developmentally disabled womenAccording to court documents, Williams, a caregiver, was fired in September by the owner of Agape Supportive Living Services who accused him of using drugs at work.Two weeks after he was fired, a burglar broke in to Agape, smashing the front door window. Among few items taken was the DVR that records security footage outside the residents' rooms.According to the criminal complaint, Milwaukee police found Williams' fingerprints on the broken window.So now, there's missing evidence. That's part of the challenge for police, but Jennifer Horth with the Association for the Rights of Citizens with Handicaps said there are other challenges, too."If you're working with someone with cognitive disability, they may have limited vocabulary. They may have limited expressive language, so they may understand what you're asking them but being able to process that, but having an explanation or an answer may be challenging," Horth said.It's why Horth said these crimes often go unreported and make the victims so vulnerable."The sort of bell that goes off in your head or my head or most people's heads when they feel like they're in danger or this person isn't trustworthy, that bell might be there, but they have less experience processing what to do when they're feeling like something might not be right," Horth said.The owner of Agape Supportive Living Services said she couldn't comment on the charges.The state Department of Health and Human Services said it is working on a response.