Lawmaker loses chairman job after dispute with House speaker