Should I dump him or keep him?

If the week is a big issue, then perhaps you should tell him so and ask him to quit or minimize it or see somebody else. Something like that can be a big difference not to mention that he is about to be a daddy to somebody else's kid.