I have a Georgia Belle Peach tree That I planted last spring at about 5 ft.

About a month ago, it had about 20 to 30 peaches...seemilngly healthy and growing. Now, there are only 3 or 4 peaches left. I see no signs pests or disease. The tree is healthy and growing, but won't hold the fruit. Any ideas of what's going on ?