Is giving my ex husband physical custody a bad idea?

we are separated and currently split our time with our daughter 40/60. we both have joint legal and physical custody still, and are discussing the issue as we are filling out the divorce papers. Our daughter does live with him, but i thought for legal reasons keeping the physical and legal custody joint would be better than giving him physical custody. i'm very weary of giving him full physical custody because i'm not sure how that will effect me legally later on. What complications could arise in the future if i grant him full physical custody?