Giants Grove Why you loot chest

So when The last time I was at Giants Grove I just took the Hammer from the Giants and ran. My bad I did not loot the chest and get the missing special item right next too it