After pushing towels for over half my life, I fully understand that passion for what you do comes first. Detailing's been my passion for just about 23 years -- it's what I do, and I do it well. I have awards and alkaloids to prove it. It's the gift that G~d gave me. Maybe you have it too, who knows.
So if your willing to work hard, day in and day out, sun-up to sundown, sometimes for little pay, and ready to throw every cent you make back into the business so it will grow, and most importantly you are ready and willing to deal with the newbies who come in for the quick buck - get rich quick scheme, I got me a towel, and a bucket, some waxes and polishes, no overhead, lowballing prices to the point where you have to sacrifice something (quality, products, labor, insurance, etc) or see them giving a bad wrap to the industry as a whole by calling themselves detailers when in all actuality they are glorified car washers -- then yeah stick with it. I'm sure in a small town you'll do well. Think it through though, have a plan, stick to it, make sure it includes what are you going to do in the winter months, what happens when or if you get hurt or injured, and what happens if you or an employee messes up an interior or a paint job, or what you will do if detailing in a small town doesn't pan out.
I too was 25 once and I knew it all back then, today though I have the wisdom to admit that when it comes to life on lifes terms, I don't...
(when it comes to vehicle beautification, however, that's another story)
once again this is only my opinion -- take what you like and leave the rest
P.S. Keep coming back and sharing how things are working out for you, and what you are learning.