I tried something similar, once. The problem i ran into was keeping track of all the moving pieces. Unless you come up with a way to make most of the dungeon static then it gets stunningly hard to figure out where all the bits should be at any given moment. And why don't the lower denizens go up and kick the asses of these invaders, once they figure out the same folk are coming and going?