I have not had the "talk" with my dad either. What are the reasons you don't want to talk to him about it. What's the worst that can happen?
In my case, I know it would lead to a big fight, and us not talking for a while. He is pretty sick, so I'd hate for him to pass away after something like that.