Retouchdown: Releasing Touchdown on StreetLearn as a Public Resource for Language Grounding Tasks in Street View

Harsh Mehta, Yoav Artzi, Jason Baldridge, Eugene Ie, Piotr Mirowski


Abstract
The Touchdown dataset (Chen et al., 2019) provides instructions by human annotators for navigation through New York City streets and for resolving spatial descriptions at a given location. To enable the wider research community to work effectively with the Touchdown tasks, we are publicly releasing the 29k raw Street View panoramas needed for Touchdown. We follow the process used for the StreetLearn data release (Mirowski et al., 2019) to check panoramas for personally identifiable information and blur them as necessary. These have been added to the StreetLearn dataset and can be obtained via the same process as used previously for StreetLearn. We also provide a reference implementation for both Touchdown tasks: vision and language navigation (VLN) and spatial description resolution (SDR). We compare our model results to those given in (Chen et al., 2019) and show that the panoramas we have added to StreetLearn support both Touchdown tasks and can be used effectively for further research and comparison.
Anthology ID:
2020.splu-1.7
Volume:
Proceedings of the Third International Workshop on Spatial Language Understanding
Month:
November
Year:
2020
Address:
Online
Editors:
Parisa Kordjamshidi, Archna Bhatia, Malihe Alikhani, Jason Baldridge, Mohit Bansal, Marie-Francine Moens
Venue:
SpLU
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
56–62
Language:
URL:
https://aclanthology.org/2020.splu-1.7
DOI:
10.18653/v1/2020.splu-1.7
Bibkey:
Cite (ACL):
Harsh Mehta, Yoav Artzi, Jason Baldridge, Eugene Ie, and Piotr Mirowski. 2020. Retouchdown: Releasing Touchdown on StreetLearn as a Public Resource for Language Grounding Tasks in Street View. In Proceedings of the Third International Workshop on Spatial Language Understanding, pages 56–62, Online. Association for Computational Linguistics.
Cite (Informal):
Retouchdown: Releasing Touchdown on StreetLearn as a Public Resource for Language Grounding Tasks in Street View (Mehta et al., SpLU 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.splu-1.7.pdf
Video:
 https://slideslive.com/38940082
Data
StreetLearn