They’re a limited-use item - once they do enough to fulfill their oath, they won’t keep fighting. Also, in the books it wasn’t clear that they could actually cause physical harm.