Judge refuses to toss case against defiant Baton Rouge pastor