The only way to find out is to try, and it’s always a risk going into the unknown; your apprehension is understandable.

But the only way to improve your situation is to change it, and it sounds like your current working situation is pretty bad. Try not to let the fear stop you from moving forwards.

Best of luck finding somethig better!