Lawyer says getting hate mail over man accused of slapping baby