On Thursday, Quitman Police found two girls, ages two and three, dead at the Dogwood Villa Apartments.
Neighbors say they were in separate rooms in their beds.
Police have arrested 19-year-old, Thomas Wayne Liles, for tampering with or fabricating physical evidence.
Police believe he was home at the time of the two deaths.
Witnesses say they saw him throwing away a large item into a nearby dumpster.
"People here, we're all family," said neighbor Selma Bell. "What happened is remorse to all of us here."
Online jail records don't list an attorney for Liles, who was held Friday on a $25,000 bond.
Copyright 2015 Nexstar Broadcasting, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.