The distributions that you reinvest in new shares are the cost (or as the IRS calls it, the "basis") for those shares.
You need to keep track of your basis so that you can calculate the gain or loss when you ultimately sell your mutual fund shares.