I was in the cast of a show that used these. They're officially called "periactoids" (http://philsprops.co.uk/gallerydetails.php?ImageID=9 was the first Google hit).
Ours were for "Secret Garden" and the chorus members had to move them. It added additional choreography. As long as yours are kept as walls they should work great. (Ours had the additional task of becoming the garden - with leaf and vine cutouts and gelled fairy lights - that could only be plugged in after they were in place - two seconds before they had to come on.)
Ours were four-sided columns (we settled on this after too many of us called them pterodactyls!). To keep things as light as possible, they attached luon to 2x2 posts - the luon was slightly longer than the posts to mask the scooter wheels attached to each of the four corners. Paint rollers and painter's tape came in very handy for painting the things - which came *after* assembly. (Ours were about 7 feet tall)
If you put any "artwork" for the houses on the walls - best option is to mount a printout on foamcoare to keep things lightweight. (Another show I was involved with decided to go for "real" paintings - it took three people to move *one* - as opposed to one person moving the column for Secret Garden).
Note: if you plan on having these towards the back of your set - to be rotated - make them 3-sided instead of four - less of a chance of them getting stuck during the changes.
Best of luck!