The relationship between housing costs and second home ownership rates is complicated.