I knew they were British, so I always assumed it had something to do with the whole Virgin Queen thing(it was and is a nickname for Elizabeth the first) or something like that, but it was apparently because they considered themselves virgins in business when they started their first record store.