Ben Affleck spent Christmas with Jennifer Garner amid Jennifer Lopez divorce