People are sent to prison not strictly for reasons of violence, but because we as a society has designated certain crimes to have been painful either physically or materially to those that experienced them.

A hacker or a fraud may not be inflicting physical violence, but that doesn’t mean they are harmless.

Now what you define as violence can change things a bit, but I personally would define it as a physical or a threat of something physical.