In reality, I've found over the years that freelance career is not only satisfying but also safer than full-time job, or really, any full-time job.
If your full-time job barely covers your bills and you have expertise that would allow you to write in a well-paying niche, then perhaps focusing on building your freelancing career and ditching the traditional job makes sense.