I'm not really sure what you mean OP.
Most people just lead normal lives and swinging is a fun part of our lives like to going to the pub or theatre. There's nothing manage.
I'd say if you can't manage the responsibilities of day to day life while participating in "the lifestyle" (anyone else hate that phrase?), then you might need to do a fair bit of introspection!
Don't let the lifestyle consume you. It's an addition to normal life. If things outside of swinging aren't getting done, you're spending too much time focused on this.
It's the same with any other extracurricular activity like the pub, hobbies etc. It's all about balance.