In my opinion, this would make the game much less strategic and much less interesting. One of the decisions you have to grapple with is how many meeples to commit to the board, and how many to keep in reserve for future point scoring opportunities. Each feature must be evaluated not only in terms of how many points it will get you, but how long it ties up your meeple for.
However, if it makes the game more fun for you and your group, go for it!
However, if it makes the game more fun for you and your group, go for it!