Friendships, Rivalries, and Trysts: Characterizing Relations between Ideas in Texts

Chenhao Tan, Dallas Card, Noah A. Smith


Abstract
Understanding how ideas relate to each other is a fundamental question in many domains, ranging from intellectual history to public communication. Because ideas are naturally embedded in texts, we propose the first framework to systematically characterize the relations between ideas based on their occurrence in a corpus of documents, independent of how these ideas are represented. Combining two statistics—cooccurrence within documents and prevalence correlation over time—our approach reveals a number of different ways in which ideas can cooperate and compete. For instance, two ideas can closely track each other’s prevalence over time, and yet rarely cooccur, almost like a “cold war” scenario. We observe that pairwise cooccurrence and prevalence correlation exhibit different distributions. We further demonstrate that our approach is able to uncover intriguing relations between ideas through in-depth case studies on news articles and research papers.
Anthology ID:
P17-1072
Volume:
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2017
Address:
Vancouver, Canada
Editors:
Regina Barzilay, Min-Yen Kan
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
773–783
Language:
URL:
https://aclanthology.org/P17-1072
DOI:
10.18653/v1/P17-1072
Bibkey:
Cite (ACL):
Chenhao Tan, Dallas Card, and Noah A. Smith. 2017. Friendships, Rivalries, and Trysts: Characterizing Relations between Ideas in Texts. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 773–783, Vancouver, Canada. Association for Computational Linguistics.
Cite (Informal):
Friendships, Rivalries, and Trysts: Characterizing Relations between Ideas in Texts (Tan et al., ACL 2017)
Copy Citation:
PDF:
https://aclanthology.org/P17-1072.pdf
Presentation:
 P17-1072.Presentation.pdf
Note:
 P17-1072.Notes.pdf
Video:
 https://aclanthology.org/P17-1072.mp4
Code
 Noahs-ARK/idea_relations