Shortly after he divorced Patty he left the gurls by themselves, They didnt see him again untill the 3rd Season and even then Prue and Piper werent really happy to see him, they adventually got over it and spent alot of time with him.
Keep in touch with your daughters, you never know when they might need you.