Publications

Koustuv Sinha, Jon Gauthier, Aaron Mueller, Kanishka Misra, Keren Fuentes, Roger Levy, Adina Williams (2023). Language model acceptability judgements are not always robust to context. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Outstanding Paper Award.

Cite Arxiv ACL Anthology

Koustuv Sinha, Amirhossein Kazemnejad, Siva Reddy, Joelle Pineau, Dieuwke Hupkes, Adina Williams (2022). The Curious Case of Absolute Position Embeddings. Findings of Empirical Methods of Natural Language Processing.

Cite DOI Arxiv

Shanya Sharma, Manan Dey, Koustuv Sinha (2022). How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts. Findings of Empirical Methods of Natural Language Processing (EMNLP), 2022.

Cite DOI Arxiv

Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, Douwe Kiela (2021). Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little. Empirical Methods of Natural Language Processing (EMNLP).

Cite Arxiv ACL Anthology Code

Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams (2021). UnNatural Language Inference. Association of Computational Linguistics (ACL), Oral, Outstanding Paper Award.

Cite Arxiv ACL Anthology Code

Prasanna Parthasarathi, Koustuv Sinha, Joelle Pineau, Adina Williams (2021). Sometimes We Want Ungrammatical Translations. Empirical Methods of Natural Language Processing (EMNLP) Findings.

Cite ACL Anthology

Shanya Sharma, Manan Dey, Koustuv Sinha (2021). Evaluating Gender Bias in Natural Language Inference .

Cite URL

Anuroop Sriram, Matthew Muckley, Koustuv Sinha, Farah Shamout, Joelle Pineau, Krzysztof J. Geras, Lea Azour, Yindalon Aphinyanaphongs, Nafissa Yakubova, William Moore (2021). COVID-19 Deterioration Prediction via Self-Supervised Representation Learning and Multi-Image Prediction.

Cite Arxiv Code

Koustuv Sinha, Joelle Pineau, Jessica Forde, Rosemary Nan Ke, Hugo Larochelle (2020). NeurIPS 2019 Reproducibility Challenge. ReScience C.

Cite DOI URL

Emily Goodwin, Koustuv Sinha, Timothy J. O'Donnell (2020). Probing Linguistic Systematicity. Association of Computational Linguistics (ACL).

Cite Arxiv ACL Anthology Code

Nicolas Gontier, Koustuv Sinha, Siva Reddy, Christopher Pal (2020). Measuring Systematic Generalization in Neural Proof Generation with Transformers. Neural Information Procesing Systems (NeurIPS).

Cite Arxiv NeurIPS Code

Koustuv Sinha, Prasanna Parthasarathi, Jasmine Wang, Ryan Lowe, William L. Hamilton, Joelle Pineau (2020). Learning an Unreferenced Metric for Online Dialogue Evaluation. Association of Computational Linguistics (ACL).

Cite Arxiv ACL Anthology Code

Joelle Pineau, Philippe Vincent-Lamarre, Koustuv Sinha, Vincent Larivière, Alina Beygelzimer, Florence d'Alché-Buc, Emily Fox, Hugo Larochelle (2020). Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program). Journal of Machine Learning Research (JMLR).

Cite JMLR

Shagun Sodhani, Mayoore S Jaiswal, Lauren Baker, Koustuv Sinha, Carl Shneider, Peter Henderson, Joel Lehman, Ryan Lowe (2020). Ideas for Improving the Field of Machine Learning: Summarizing Discussion from the NeurIPS 2019 Retrospectives Workshop. arXiv preprint arXiv:2007.10546.

Cite Arxiv

Koustuv Sinha, Shagun Sodhani, Joelle Pineau, William L Hamilton (2020). Evaluating Logical Generalization in Graph Neural Networks. arXiv preprint arXiv:2003.06560.

Cite Arxiv Code

Joelle Pineau, Koustuv Sinha, Genevieve Fried, Rosemary Nan Ke, Hugo Larochelle (2019). ICLR Reproducibility Challenge 2019. ReScience C.

PDF Cite DOI

Koustuv Sinha, Shagun Sodhani, Jin Dong, Joelle Pineau, William L. Hamilton (2019). CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text. Empirical Methods of Natural Language Processing (EMNLP), Oral.

Cite Arxiv ACL Anthology Code

Nicolas A. Gontier, Koustuv Sinha, Peter Henderson, Iulian Serban, Michael Noseworthy, Prasanna Parthasarathi, Joelle Pineau (2018). The RLLChatbot: a solution to the ConvAI Challenge. under review at Dialog & Discourse Journal (D&D).

Cite

Peter Henderson, Koustuv Sinha, Nicolas Angelard-Gontier, Nan Rosemary Ke, Genevieve Fried, Ryan Lowe, Joelle Pineau (2018). Ethical Challenges in Data-Driven Dialogue Systems. AAAI/ACM AI Ethics and Society Conference.

Cite ACM Code

Koustuv Sinha, Shagun Sodhani, William L. Hamilton, Joelle Pineau (2018). Compositional Language Understanding with Text-based Relational Reasoning. Relational Representation Learning Workshop, NIPS.

Cite Code

Peter Henderson, Koustuv Sinha, Rosemary Nan Ke, Joelle Pineau (2018). Adversarial Gain. Arxiv Pre-print.

Cite

Koustuv Sinha, Yue Dong, Jackie Chi-kit Cheung, Derek Ruths (2018). A Hierarchical Neural Attention-based Text Classifier. Empirical Methods of Natural Language Processing (EMNLP).

Cite ACL Anthology Code