The server doesn’t need to know or keep track of who’s sending a message to deliver it. If you don’t trust signal to not lie to the court about not collecting such metadata, I can’t convince you otherwise. But there’s a merit in designing your system so that such collection is as hard as possible.