Bad luck and those who have some negative intentions with you will count the number of grains first before that happens. So the more grains you pour, that's how much they will count too! Generally, the idea is to be away from bad things to happen in life, this is why most of the locals are doing it when they visit a pagoda.
