The place by me doesn't require a membership either, although being a co-op, it certainly offers one. The prices are generally terrible -- think "even worse than Whole Foods" -- but the bulk spices are less outrageous. More importantly, you still come out way ahead buying only the little bit of some weird spice you need for that one dish instead of a whole jar, even if the price per pound is higher.

Or just buy a bunch of small containers and split normal size things with friends.

I'm legit thinking about doing this now, I have so many containers in my fridge that don't have to be anywhere near as large.

I don't need a big bottle of Worcestershire, and I like having a large selection of mustards.