I Do understand what u mean.
And this is indeed a feature I will love using!
What I meant was that u have to plan the special day manually. It would be great if the special day could be planned in an event and so be automated as well.
Having the option “Use ‘Special’ template assignment for all days” also available in scheduling by event it is possible to setup an event which schedules only that special day/hour.
This way you are sure your special day is planned at the moment you want, not at the moment you have time to plan manually. U can prepare the special templates at any time you like. Still the scheduler will schedule when the event is running.
My example used earlier perhaps wasn’t the best example to explain. 
Hope u (and Torben) will seriously think about this function. If u sure it won’t be added in the future I hope you would let know as well in a comment here.