We gave up on those a few years back as Iceland has so many other things to offer! Plus, strip clubs are illegal in Iceland, but they get around this by having 'Lingerie Bars' instead.
Inside, they look like a normal strip club, complete with pole, but the staff aren't allowed to use it, only the customers are! You're also expected to buy drinks for the girls and this is how they make money - the more drinks customers buy, the more commission the girls make.