You can get a nice deal if you alternate, yeah - generic "staples" at your local giant or whatever, Asian market for fresher or unique stuff, dry spices from an Indian grocery...

It's only comfort keeping people going to the same store every time. And I guess the hassle of doing two trips a week or something.