古 ('ancient') prefixes a place name to mean 'the ancient civilization based there.' Same pattern:
古希腊 'ancient Greece,'
古埃及 'ancient Egypt,'
古印度 'ancient India.' Together with these,
古罗马 forms the standard quartet of 'four great ancient civilizations of the West/world' that Chinese students learn in world-history class.