Ben Affleck's struggles to clean up his image and save his marriage have friends of the Academy Award-winning actor fearing he could be on the verge of a nervous breakdown.

"Ben's a shadow of his former self - bloated, down and completely torn over what to do," a source told Radar Online.

Even as wife Jennifer Garner has agreed to at least temporarily put off divorce proceedings, sources added the "Gone Girl" star remains torn over whether he can save their family for their three young daughters.

"Jen's been using the delay to try and fix things," a source added. "Ben can't believe she even wants to give him another chance after how he's behaved but she feels she should because of the kids."

Still, word is despite her best efforts, Affleck has continued to withdraw.

After 10 years and three kids, the two split earlier this summer when it was widely reported Affleck had cheated with the couple's young nanny Christine Ouzounian.

Affleck stubbornly denied the allegations and was later rumored to have changed his cellphone number to keep Ouzounian from being able to contact him.

At one point, Ouzounian was rumored to be considering writing a tell-all highlighting all her time and experiences with Affleck.

"Jen's hoping he can pull himself together, but even she admits she's being very optimistic," a source close to Garner said, adding that she's open to pursuing the relationship against the advice of many of those closest to her.

"He's burnt her so many times and her friends are urging her to not give him any more chances," the friend added. "He'll never change and he doesn't deserve it."

More recently, Affleck was reportedly spotted holding hands with actress Sienna Miller on the set of their new film "Live By Night."