Crowds once mingled below two tall arcades supported by 164-foot-tall columns. But due to earthquakes and unstable foundations, these architectural elements collapsed long ago