If you're viewing from Kbin, you can only see downvotes from other Kbin users. If a user from another instance downvotes it, it will not show up unless you view the post on the original instance.