How many people get injured or killed in car accidents? How many people get badly hurt or killed skiing every year? If you act responsibly, travelling is less risky than driving a car.
Yes, leaving our comfort zones gives most of us that queasy feeling. But worse than that are the regrets you will battle for not doing this step into the Unknown. And do not believe that this decision will be easier if you postpone it: with increasing experience and financial stability, you will have even more to loose… Not to mention that you might have much higher liabilities later on!