Having your own router/access point can’t be stressed enough.
And, you don’t even need their modem. Sure it’s an additional outlay of cash, but buying your own modem gets you a nice upgrade and no worries about someone connecting to the Xfinity access point that’s bundled in their equipment.
This looks like an IRL Far Side comic.