Past Readings

Wednesday 12/1/11, 4pm, C3.108, a reading group on the recent Culturomics paper in Science that has created a bit of a buzz. See abstract below and http://www.culturomics.org/ .

We constructed a corpus of digitized texts containing about 4% of all books ever printed. Analysis of this corpus enables us to investigate cultural trends quantitatively. We survey the vast terrain of "culturomics", focusing on linguistic and cultural phenomena that were reflected in the English language between 1800 and 2000. We show how this approach can provide insights about fields as diverse as lexicography, the evolution of grammar, collective memory, the adoption of technology, the pursuit of fame, censorship, and historical epidemiology. "Culturomics" extends the boundaries of rigorous quantitative inquiry to a wide array of new phenomena spanning the social sciences and the humanities.

Wednesday 19/1/11, there's an open slot for a Journal Club (someone presenting someone else's paper) or work-in-progress talk.

Wednesday 26/1, no meeting. (we skip the regular CLS slot, and think of Khalil Sima'an's talk at the ILLC Colloquium (28/1), on machine translation and statistical estimation, as our own keynote).

2008-2009

Bannard, C., Lieven, E., & Tomasello, M. (2009). Modeling children’s early grammatical knowledge, PNAS, 106, 17284-17289.
Demberg, V., & Keller, F. (2009). A Computational Model of Prediction in Human Parsing: Unifying Locality and Surprisal Effects. Proceedings of CogSci09.
Perlovsky, L. (2009). Language and cognition. Neural Networks, 22, 247-257.
Jaeger, T. F. and N. Snider. (2007). Implicit learning and syntactic persistence: Surprisal and cumulativity. In L. Wolter and J. Thorson (Eds.), University of Rochester Working Papers in the Language Sciences, 3(1), 26-44.
Sections 1 to 6 of: O'Donnel, Goodman, & Tenenbaum (2009). Fragment grammars: exploring computation and reuse in language.
Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience.
Conner, M., Gertner, Y., Fisher, C., & Roth, D. (2008). Baby SRL: Modeling early language acquisition. Proceedings of CoNLL.
Miikkulainen, R. (1997). Natural Language Processing with Subsymbolic Neural Networks. In: A. Browne (Ed.), Neural Network Perspectives on Cognition and Adaptive Robotics, 120–139.
Ackerman & Malouf (to appear). Parts and wholes: Patterns of relatedness in complex morphological systems and why they matter. In: J. P. Blevins & J. Blevins (Eds.), Analogy in Grammar: Form and Acquisition. Oxford University Press, Oxford.
Boston & Hale (2007). Garden-Pathing in a Statistical Dependency Parser. In Proceedings of the Fourth Midwest Computational Linguistics Colloquium (MCLC)
and
Boston, Hale, Kliegl, & Vasishth (2008). Surprising parser actions and reading difficulty. In Proceedings of ACL-08:HLT.
Griffiths & Kalish (2007). Language evolution by iterated learning with bayesian agents., Cognitive Science, 31, 441-480
Johnson (2008). Using adaptor grammars to identify synergies in the unsupervised acquisition of linguistic structure. In Proceedings of ACL
Mark Paskin (2001). Grammatical Bigrams. In Proceedings of NIPS
Riezler, Liu & Vasserman (2008). Translating queries into snippets for improved query expansion. Proceedings of Coling 2008
Cohn & Lapata (2008). Sentence compression beyond word deletion. Proceedings of Coling 2008

2007-2008

Theme: Meaning

Discourse Representation Theory: Chapter 7.4 of Gamut, L.T.F. (1991), Logic, Language, and Meaning, Volume 2.
G. Boella, R. Damiano, and L. Lesmo (1999). Beating a donkey: a mental model approach to complex anaphorical phenomena. In: Proc. of European Congress of Cognitive Science http://www.di.unito.it/~gull/PS/donkey.ps
Bergen, B.K. & Chang, N.C. (2005). Embodied Construction Grammar in simulation-based language understanding. In: J. Östman & M. Fried (Eds.), Construction Grammars: Cognitive grounding and theoretical extensions (pp. 147-190). Amsterdam: John Benjamins. http://www2.hawaii.edu/~bergen/ECG.pdf
Johnson-Laird, P. (2006). Models and heterogeneous reasoning. Journal of Experimental & Theoretical Artificial Intelligence, 18, 121-148.
MacCartney, B., & Manning, C.D. (2007). Natural logic for textual inference. Proceedings of the Workshop on Textual Entailmant and Paraphrasing, pp. 193-200
Stone, M. (2004). Intention, interpretation and the computational structure of language. Cognitive Science, 28, 781-809.

Theme: Language Acquisition

Yang & Legate (2007). Morphosyntactic learning and the development of tense. Language Acquisition, 315-344
Alishahi & Stevenson (in press). A computational model for early argument structure acquisition. Cognitive Science
Freudenthal, Pine, Aguado-Orea, & Gobet. Modeling the developmental patterning of finiteness marking in English, Dutch, German, and Spanish using MOSAIC. Cognitive Science, 31, 311-341.

Lari & Young (1990). The Estimation of Stochastic CFGs using the Inside-Outside Algorithm.
Lappin & Shieber (2007). Machine learning theory and practice as a source of insight into universal grammar. Journal of Linguistics

2006-2007

Theme: Incremental parsing

Hale, J. (2004), The Information-Processing Difficulty of Incremental Parsing. In: F. Keller, S. Clark, M. Crocker and M. Steedman (Eds.), Proceedings of the ACL Workshop Incremental Parsing: Bringing Engineering and Cognition Together (pp. 58-65)
Hale, J. (2006), Uncertainty about the rest of the sentence. Cognitive Science, 30, 609-642.
Sections 3.1.2 - 3.1.4 of Colin Phillips's dissertation Order and Structure'(1996, MIT).
Sturt, Pickering, & Crocker (1990). Structural Change and Reanalysis Difficulty in Language Comprehension, Journal of Memory and Language, 40
Sturt & Crocker (1996). Monotonic Syntactic Processing: A Cross-linguistic Study of Attachment and Reanalysis, Language and Cognitive Processes, 11
Pickering, Traxler, & Crocker (2000). Ambiguity Resolution in Sentence Processing: Evidence against Frequency-Based Accounts, Journal of Memory and Language 43, 447-475

2005-2006

Theme: Major Syntactic Formalisms

Steedman & Baldridge (2003), Combinatory Categorial Grammar. Unpublished Tutorial Paper
Solan, Horn, Ruppin & Edelman (2005), Unsupervised learning of natural languages, Proc. Nat. Acad. Sci. USA
Hockenmaier & Steedman (2002), Generative Models for Statistical Parsing with Combinatory Grammars. Proceedings of the 40th Meeting of the ACL, Philadelphia, 335-342.
Joshi (2004), Starting With Complex Primitives Pays Off: Complicate Locally, Simplify Globally. Cognitive Science 28, 637-668
Bangalore & Joshi (1999), Supertagging: An Approach to Almost Parsing . Computational Linguistics
Pollard & Sag (1994), Head-Driven Phrase Structure Grammar. Chicago and Stanford: U. Chicago Press and CSLI Publications. pp 1-46
Abney (1997), Stochastic Attribute-Value Grammars, Computational Linguistics
Johnson, Geman, Canon, Chi, & Riezler (1999), Estimators for Stochastic "Unification-Based" Grammars . ACL'99
Melcuk, Dependency Syntax: Theory and Practice (chapter I)
Tsarfaty (submitted), Integrated Morphological and Syntactic Ambiguity Resolution for Modern Hebrew (and Other Semitic Languages)
Eisner, J. M (1996), Three new probabilistic models for dependency parsing: An exploration. Proceedings of the 16th International Conference on Computational Linguistics (COLING-96), pages 340-345
Manning & Carpenter (1997), Probabilistic Parsing Using Left Corner Language Models. Proceedings of the Fifth International Workshop on Parsing Technologies (IWPT-97), MIT, pp. 147-158.

2004-2005

Natural Language Learning

Klein & Manning (2004) Corpus-Based Induction of Syntactic Structure: Models of Dependency and Constituency, ACL 2004
Collins & Roark (2004) Incremental Parsing with the Perceptron Algorithm, ACL 2004
Taskar, Klein, Collins, Koller & Manning (2004) Max-Margin Parsing, EMNLP 2004
Toutanova, Manning & Ng (2004) Learning Random Walk Models for Inducing Word Dependency Distributions, ICML 2004
Toutanova, Mitchell & Manning (2003) Optimizing Local Probability Models for Statistical Parsing, ECML 2003
Pinker (1979). Formal Models of Language Learning. Cognition, 7, 217-283
Clark (2004). Grammatical Inference and the Argument from the Poverty of the Stimulus. AAAI Spring Symposium on Interdisciplinary Approaches to Language Learning, Stanford CA. 2004
Valiant (1984). A Theory of the Learnable. Communications of the ACM 27
Kearns & Vazirani, An Introduction to Computational Learning Theory, Chapter 1.
Mitchell, Machine Learning, Chapter 7
Edelman, Solan, Horn & Ruppin (2003). Rich Syntax from a Raw Corpus: Unsupervised Does It. Proceedings of NIPS
Solan, Z., Horn, D., Ruppin, E., & Edelman, S. (2003). Unsupervised Context Sensitive Language Acquisition from a Large Corpus. Proceedings of NIPS
Pedersen, Edelman, Solan, Horn, & Ruppin (2004). Some Tests of an Unsupervised Model of Language Acquisition. Proceedings of COLING-2004 Workshop on Psycho-computational Models of Human Language Acquisition