If two people in a close relationship grow apart, or if they grow away from each other, they gradually begin to have a less close relationship, usually because they no longer have the same interests and want the same things:
Grown apart meaning & definition 1 of Grown apart.
