Fully agree with this. It's a bit like people and their new year résolutions. Full of motivation in the first couple of weeks and then it goes away.One major thing that would be really needed to start somewhere else anew is commitment. It's easy to say now you are committed, but the feeling and energy you have at this moment will be gone in weeks or maybe months from now.
If you have a job, it means almost all of your evenings and weekends are going to be spent on this. Maybe you think this is easier with more people, but it really isn't as it can lead to a lot of disagreement and because of that people signing off. Working with multiple people on a project requires clear agreements on the responsibilities.
Then think of what happens if someone does not do what he or she was expected to do. Not a lot really, it is all unpaid work and people do it in their spare time.
This is already difficult to establish at work and there everybody is paid for what they do. it becomes much more difficult once it needs to be done in your spare time.
But before you get to all that, you need to agree on the vision of this new place. Who are you making it for and what do you want to achieve?
I'm not trying to scare you in any way But getting the vision down and finding people that are really committed to make that vision work and understand what it takes to get there, would be essential in making it work.
As I said, I'm happy to help build up the site up, organising, configuration of tools and add ons. But I can't commit to long term.