There’s privacy and then there’s user experience. UX on Matrix is awful. Not to mention Matrix collects all the metadata, and the vast majority of it sits on a single server (matrix.org), which is owned by a private company and subject to subpoenas.