You were ABSOLUTELY 100% RIGHT TO CALL THE POLICE; PLS DON'T HESITATE TO DO SO AGAIN. THIS MAN IS AN ABUSER AND COULD BE A SEROUS RISK TO HIS CHILDREN.
Don't be afraid of him; he has no way of knowing who called the police; he's a bully& a coward and can't do anything to you.
It's a good idea to document what he does and contact Social Services to take away the kids if necessary before he abuses them even more. You'll feel guilty if yr silent from fear & innocent children pay the price for yr silence.
So, be brave and do the right thing. Good luck.