Abstract
Place is an important element in visual understanding. Given a photo of abuilding, people can often tell its functionality, e.g. a restaurant or a shop,its cultural style, e.g. Asian or European, as well as its economic type, e.g.industry oriented or tourism oriented. While place recognition has been widelystudied in previous work, there remains a long way towards comprehensive placeunderstanding, which is far beyond categorizing a place with an image andrequires information of multiple aspects. In this work, we contributePlacepedia, a large-scale place dataset with more than 35M photos from 240Kunique places. Besides the photos, each place also comes with massivemulti-faceted information, e.g. GDP, population, etc., and labels at multiplelevels, including function, city, country, etc.. This dataset, with its largeamount of data and rich annotations, allows various studies to be conducted.Particularly, in our studies, we develop 1) PlaceNet, a unified framework formulti-level place recognition, and 2) a method for city embedding, which canproduce a vector representation for a city that captures both visual andmulti-faceted side information. Such studies not only reveal key challenges inplace understanding, but also establish connections between visual observationsand underlying socioeconomic/cultural implications.