Lecture: A working man's merge

Evidence for restricted distributional composition in phrase semantics

This talk presents a mediating perspective on computational phrase composition between naïve additive composition and complex latent representations from regression models. The aim of the work presented is to reduce the unrestricted transformation of latent embeddings to a classification problem of convolutional filters at phrase level. The classifier is embedded within a Tree-LSTM (Tai et al. 2015) architecture and trained on truth-grounded sister node prediction. Preliminary results show evidence that a restricted selection of filters is enough for phrase construction in high-dimensional spaces, but also, there is more to it than addition.
This talk will introduce the distributional compositional semantics framework (Baroni 2014) and outline previous computational work into the texture of (semantic) merge, as well as present preliminary results from my Master thesis.

This talk presents a mediating perspective on computational phrase composition between naïve additive composition and complex latent representations from regression models. The aim of the work presented is to reduce the unrestricted transformation of latent embeddings to a classification problem of convolutional filters at phrase level. The classifier is embedded within a Tree-LSTM (Tai et al. 2015) architecture and trained on truth-grounded sister node prediction. Preliminary results show evidence that a restricted selection of filters is enough for phrase construction in high-dimensional spaces, but also, there is more to it than addition.
This talk will introduce the distributional compositional semantics framework (Baroni 2014) and outline previous computational work into the texture of (semantic) merge, as well as present preliminary results from my Master thesis.

Baroni, M., Bernardi, R. and Zamparelli, R., 2014. Frege in space: A program for compositional distributional semantics. Linguistic Issues in language technology, 9, pp.241-346.
Tai, K.S., Socher, R. and Manning, C.D., 2015. Improved semantic representations from tree-structured long short-term memory networks. arXiv preprint arXiv:1503.00075.

Info

Day: 2023-05-27
Start time: 11:05
Duration: 00:30
Room: SH 0.107
Track: Theoretical Linguistics

Links:

Feedback

Click here to let us know how you liked this event.

Concurrent Events