i think it makes sense considering they have no real connection to the fade. its why they don’t use magic either.
but I did always find it curious considering the lyrium trade was highly lucrative for them. I guess its because of a lack of the connection to the fade that they can even handle raw lyrium in the first place.