Would like some more answers (getting good ones so far) is this a warning sign? of should i stick it out?

Sounds like a bit of fear of commitment mixed with more fear of what has happened with you in the past. He's sticking it out with you and your kids, but is not sure about the future.