Whether you can avoid teaching YLs depends very much on where you want to work. If you have your heart set on working in Asia, teaching YLs will make up the bulk of your timetable as kids start learning English from as young as 3. In Western Europe the kids tend to be a bit older (8+), but there are still plenty of YLs, especially in countries such as Spain and Portugal. In Eastern Europe the YL:adult ratio is more balanced, but the YLs are still in the majority, e.g., in my school it's a 60:40 split in favour of the YLs. Teaching in the Middle East tends to be more adult-focussed, but you generally need to have two years' experience to land even an entry-level job there.
Note that a newly-qualified teacher who can (or will) only teach one type of student or level isn't a particularly useful teacher. I suspect that if you start your career saying "I don't want to teach YLs, Business English, beginners, exam classes, etc", it'll be a very short career indeed!