The 25-year-old, who can't be named to protect the identity of the victims, was supposed to have a trial last November but it was adjourned after his now former girlfriend changed her statement.
In June 2012, a neighbour claims to have witnessed a man kicking a young boy in Glendale and called police.
The six-year-old boy was found wearing a diaper and had burn marks on his arms and injuries to his eye.
The accused had been in custody for over a year but was released Wednesday with numerous conditions.
He is scheduled to be back in court on July 22 for a preliminary hearing on a total of 19 charges.
Also on HuffPost