Publications

See also: Google Scholar

Over seventy peer-reviewed publications, many of which in top-tier conferences and journals (AAAI, IJCAI, COLING, EMNLP, NAACL, ACL, ICLR, AKBC, ISWC, ESWC, SWJ, JWS, KBS). An additional nine papers are currently under review.

1. (under review) Huabin Liu, Filip Ilievski, Cees Snoek. Commonsense Video Question Answering through Video-Grounded Entailment Tree Reasoning. CVPR.

2. (under review) Tygo Bloem, Filip Ilievski. Clustering Internet Memes Through Template Matching and Multi-Dimensional Similarity. The Web Conference.

3. (under review) Koen Kraiijveld, Yifan Jiang, Kaixin Ma, Filip Ilievski. COLUMBUS: Evaluating COgnitive Lateral Understanding through Multiple-choice reBUSes. AAAI.

4. (under review) Jiarui Zhang, Mahyar Khayatkhoei, Prateek Chhikara, Filip Ilievski. ViCrop: Perceiving Small Visual Details in Zero-shot Visual Question Answering with Multimodal Large Language Models. ICLR.

5. (under review) Jiarui Zhang, Jinyi Hu, Mahyar Khayatkhoei, Filip Ilievski, Maosong Sun. Exploring Perceptual Limitations of Multimodal LLMs on Small Visual Objects. NAACL.

6. (to appear) Filip Ilievski, Riccardo Tommasini. Capturing the Semantics of Internet Memes. The Handbook on Neurosymbolic AI and Knowledge Graphs.

7. (to appear) Mohammad Jaleed Khan, Filip Ilievski, Edward Curry. Neurosymbolic Visual Reasoning with Scene Graphs and Multimodal LLMs. The Handbook on Neurosymbolic AI and Knowledge Graphs.

8. (to appear) Leilani Gilpin, Filip Ilievski. Neuro-Symbolic Reasoning in the Traffic Domain. Neurosymbolic Artificial Intelligence Journal.

9. (to appear) Filip Ilievski. Human-centric AI with Common Sense. Springer Nature Synthesis Book.

10. Yifan Jiang, Jiarui Zhang, Kexuan Sun, Zhivar Sourati, Kian Ahrabian, Kaixin Ma, Filip Ilievski, Jay Pujara (2024). MARVEL: Multiple Abstraction and Reasoning benchmark for Visual Evaluation and Learning. NeurIPS Benchmarks.

11. Zhivar Sourati, Darshan Deshpande, Filip Ilievski, Kiril Gashteovski, Sascha Saralajew (2024). Robust Text Classification: Analyzing Prototype-Based Networks. EMNLP (Findings).

12. Yifan Jiang, Kaixin Ma, Filip Ilievski (2024). SemEval-2024 Task 9: BRAINTEASER, A Novel Task Defying Common Sense. SemEval workshop, co-located with NAACL.

13. Saurav Joshi, Filip Ilievski, Luca Luceri. Contextualizing internet memes across social media platforms. Workshop on Multimodal Content Analysis for Social Good: MM4SG. Best Paper and Best Presentation Award.

14. Zhivar Sourati, Filip Ilievski, Pia Sommerauer (2024). ARN: Analogical Reasoning on Narratives. TACL.

15. Darshan Deshpande, Zhivar Sourati, Filip Ilievski, Fred Morstatter (2024). Contextualizing Argument Quality Assessment with Relevant Knowledge. NAACL.

16. Bradley P. Allen, Filip Ilievski (2024). Standardizing Knowledge Engineering Practices with a Reference Architecture. Transactions on Graph and Data Knowledge (TGDK).

17. M. Jaleed Khan, Filip Ilievski, John G. Breslin, Edward Curry (2024). A Survey of Neurosymbolic Visual Reasoning with Scene Graphs and Common Sense Knowledge. Neurosymbolic Artificial Intelligence journal.

18. Saurav Joshi, Filip Ilievski, Jay Pujara (2024). Knowledge-powered recommendation for an improved diet water footprint. AAAI demonstration program.

19. Prateek Chhikara, Dhiraj Chaurasia, Yifan Jiang, Omkar Masur, Filip Ilievski (2024). FIRE: Food Image to REcipe generation. WACV.

20. Jiarui Zhang, Mahyar Khayatkhoei, Prateek Chhikara, Filip Ilievski (2023). Visual Cropping Improves Zero-Shot Question Answering of Multimodal Large Language Models. R0-FoMo, co-located with NeurIPS.

21. Filip Ilievski, Kartik Shenoy, Hans Chalupsky, Nicholas Klein, Pedro Szekely (2023). A Study of Concept Similarity in Wikidata. Semantic Web Journal.

22. Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma (2023). Knowledge-enhanced Agents for Interactive Text Games. K-CAP. Best Student Paper Award.

23. Yifan Jiang, Filip Ilievski, Kaixin Ma, Zhivar Sourati (2023). BRAINTEASER: Lateral Thinking Puzzles for Large Language Models. EMNLP.

24. Yifan Jiang, Filip Ilievski, Kaixin Ma (2023). Transferring Procedural Knowledge across Commonsense Tasks. European Conference on Artificial Intelligence (ECAI).

25. Ana Iglesias-Molina, Kian Ahrabian, Filip Ilievski, Jay Pujara, Oscar Corcho (2023). Comparison of Knowledge Graph Representations for User Consumption Scenarios. International Semantic Web Conference (ISWC) Research Track.

26. Jiarui Zhang, Filip Ilievski, Aravinda Kolla, Jonathan Francis, Kaixin Ma, Alessandro Oltramari (2023). A study of situational reasoning in traffic. KDD.

27. Alessandro Oltramari, Jonathan Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee (2023). Generalizable Neuro-Symbolic Systems for Commonsense Question Answering. Workshop on Neuro-Symbolic Learning and Reasoning (NeSy2023).

28. Abhinav Kumar Thakur, Filip Ilievski, H\^ong-\^An Sandlin, Zhivar Sourati, Luca Luceri, Riccardo Tommasini, Alain Mermoud (2023). Explainable Classification of Internet Memes. Workshop on Neuro-Symbolic Learning and Reasoning (NeSy2023).

29. Zhivar Sourati, Filip Ilievski, Hông-Ân Sandlin, Alain Mermoud (2023). Case-based Reasoning with Language Models for Classification of Logical Fallacies. International Joint Conference on Artificial Intelligence (IJCAI).

30. Filip Ilievski, Kaixin Ma, Alessandro Oltramari, Peifeng Wang, Jay Pujara (2023). Building Robust and Explainable AI with Commonsense Knowledge Graphs and Neural Models. Compendium of Neuro-Symbolic Artificial Intelligence (book chapter).

31. Riccardo Tommasini, Filip Ilievski, Thilini Wijesiriwardene (2023). The Internet Meme Knowledge Graph. Extended Semantic Web Conference (ESWC) Resource Track.

32. Zhivar Sourati, Vishnu Priya Prasanna Venkatesh, Darshan Deshpande, Himanshu Rawlani, Filip Ilievski, Hông-Ân Sandlin, Alain Mermoud (2023). Robust and Explainable Identification of Logical Fallacies in Natural Language Arguments. Knowledge-Based Systems (KBS).

33. Peifeng Wang, Aaron Chan, Filip Ilievski, Muhao Chen, Xiang Ren (2023). PINTO: Faithful Language Reasoning Using Prompted-Generated Rationales. International Conference on Learning Representations (ICLR). 2023.

34. Abhinav Kumar Thakur, Filip Ilievski, H\^ong-\^An Sandlin, Alain Mermoud, Zhivar Sourati, Luca Luceri, Riccardo Tommasini (2023). Multimodal and Explainable Internet Meme Classification. AAAI AI4SG workshop.

35. Peifeng Wang, Aaron Chan, Filip Ilievski, Muhao Chen, Xiang Ren (2022). PINTO: Faithful Language Reasoning Using Prompted-Generated Rationales. NeurIPS workshops TL4NLP and TSRML.

36. Jiarui Zhang, Filip Ilievski, Aravinda Kolla, Jonathan Francis, Kaixin Ma, Alessandro Oltramari (2022). Utilizing Background Knowledge for Robust Reasoning over Traffic Situations. AAAI Workshop on Knowledge Augmented Methods for NLP.

37. Ehsan Qasemi, Filip Ilievski, Muhao Chen, Pedro Szekely (2022). PaCo: Preconditions Attributed to Commonsense Knowledge. Conference on Empirical Methods in Natural Language Processing (EMNLP) Findings.

38. Filip Ilievski, Jay Pujara, Kartik Shenoy (2022). Does Wikidata Support Analogical Reasoning? KGSWC.

39. Bohui Zhang, Filip Ilievski, Pedro Szekely (2022). Enriching Wikidata with Linked Open Data. ISWC Wikidata workshop.

40. Nicholas Klein, Filip Ilievski, Hayden Freedman, Pedro Szekely (2022). Identifying Surprising Facts in Wikidata. ISWC Wikidata workshop.

41. Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari (2022). A Study of Zero-shot Adaptation with Commonsense Knowledge. Automated Knowledge Base Construction (AKBC).

42. Kaixin Ma, Filip Ilievski, Jonathan Francis, Eric Nyberg, Alessandro Oltramari (2022). Coalescing Global and Local Information for Procedural Text Understanding. Conference on Computational Linguistics (COLING).

43. Thiloshon Nagarajah, Filip Ilievski, Jay Pujara. Understanding Narratives through Dimensions of Analogy. Qualitative Reasoning workshop, co-located with IJCAI 2022.

44. Jiang Wang, Filip Ilievski, Pedro Szekely, Ke-Thia Yao (2022). Augmenting Knowledge Graphs for Better Link Prediction. International Joint Conference on Artificial Intelligence (IJCAI).

45. Sara Melotte, Filip Ilievski, Linglan Zhang, Aditya Malte, Namita Mutha, Fred Morstatter, Ninareh Mehrabi (2022). Where Does Bias in Common Sense Knowledge Models Come From? IEEE Journal on Internet Computing, Special issue on Knowledge-infused Learning.

46. Peifeng Wang, Jonathan Zamora, Junfeng Liu, Filip Ilievski, Muhao Chen, Xiang Ren (2022). Contextualized Scene Imagination for Generative Commonsense Reasoning. International Conference on Learning Representations (ICLR) 2022.

47. Alessandro Oltramari, Jon Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee (2022). Generalizable Neuro-symbolic Systems for Commonsense Question Answering. In Neuro-Symbolic Artificial Intelligence: The State of the Art.

48. Nicholas Klein, Filip Ilievski, Pedro Szekely (2021). Generating Explainable Abstractions for Wikidata Entities. Eleventh International Conference on Knowledge Capture (K-CAP).

49. Kartik Shenoy, Filip Ilievski, Daniel Garijo, Daniel Schwabe, Pedro Szekely (2021). A Study of the Quality of Wikidata. Journal of Seb Semantics, Special Issue on Community-Based Knowledge Bases.

50. Filip Ilievski, Alessandro Oltramari, Kaixin Ma, Bin Zhang, Deborah L. McGuinness, Pedro Szekely (2021). Dimensions of Commonsense Knowledge. Knowledge-Based Systems (KBS). Volume 229. ISSN 0950-7051. 10.1016/j.knosys.2021.107347.

51. Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari (2021). Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP).

52. Avijit Thawani, Jay Pujara, Filip Ilievski (2021). Numeracy Enhances the Literacy of Language Models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP).

53. Peifeng Wang, Filip Ilievski, Muhao Chen, Xiang Ren (2021). Do Language Models Perform Generalizable Commonsense Inference? In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. 3681–3688. DOI.

54. Avijit Thawani, Jay Pujara, Pedro Szekely, Filip Ilievski (2021). Representing Numbers in NLP: a Survey and a Vision. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 644–656. DOI.

55. Filip Ilievski, Pedro Szekely, Bin Zhang (2021). CSKG: The CommonSense Knowledge Graph. In Proceedings of Extended Semantic Web Conference (ESWC), Resource Track. 680–696. ISBN 978-3-030-77385-4.

56. Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari (2021). Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering. In Proceedings of the AAAI Conference on Artificial Intelligence. 13507–13515.

57. Filip Ilievski, Pedro Szekely, Gleb Satyukov, Amandeep Singh. User-friendly Comparison of Similarity Algorithms on Wikidata. Wikidata-21 workshop, co-located with the International Semantic Web Conference (ISWC).

58. Hans Chalupsky, Pedro Szekely, Filip Ilievski, Daniel Garijo, Kartik Shenoy. Creating and Querying Personalized Versions of Wikidata on a Laptop. Wikidata-21 workshop, co-located with the International Semantic Web Conference (ISWC).

59. Filip Ilievski, Jay Pujara, Hanzhi Zhang (2021). Story Generation with Commonsense Knowledge Graphs and Axioms. Common Sense Knowledge Bases (CSKB) workshop, co-located with the Automated Knowledge Base Construction (AKBC) Conference.

60. Zaina Shaik, Filip Ilievski, Fred Morstatter (2021). Analyzing Race and Citizenship Bias in Wikidata. Workshop for REU Research in Networking and Systems (REUNS 2021), co-located with 2021 IEEE 18th International Conference on Mobile Ad Hoc and Smart Systems (MASS).

61. Mark Mann, Filip Ilievski, Mohammad Rostami, Aastha Aastha, Basel Shbita (2021). Open Drug Knowledge Graph. Knowledge Graph Construction (KGC) workshop, co-located with the Extended Semantic Web Conference (ESWC).

62. Ziping Hu, Zepei Zhao, Mohammad Rostami, Filip Ilievski, Basel Shbita (2021). Knowledge Graph-Based Housing Market Analysis. Knowledge Graph Construction (KGC) workshop, co-located with the Extended Semantic Web Conference (ESWC).

63. Peifeng Wang, Nanyun Peng, Filip Ilievski, Pedro Szekely, Xiang Ren (2020). Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answering. In Findings of the Association for Computational Linguistics: EMNLP 2020. Association for Computational Linguistics. 4129–4140. DOI.

64. Filip Ilievski, Daniel Garijo, Hans Chalupsky, Naren Teja, Yixiang Yao, Craig Rogers, Rongpeng Li, Jun Liu, Amandeep Singh, Daniel Schwabe, Pedro Szekely (2020). KGTK: A Toolkit for High-Volume Knowledge Graph Manipulation. In: J. Z. Pan et al. (Eds.): The Semantic Web – ISWC 2020, LNCS 12507, DOI.

65. Piek Vossen, Filip Ilievski, Marten Postma, Antske Fokkens, Gosse Minnema, Levi Remijnse (2020). Large-scale Cross-lingual Language Resources for Referencing and Framing. In Proceedings of the 12th Language Resources and Evaluation Conference. 3162–3171.

66. Filip Ilievski, Pedro Szekely, Daniel Schwabe (2020). Commonsense Knowledge in Wikidata. Wikidata-20 workshop, co-located with the International Semantic Web Conference (ISWC).

67. Marten Postma, Levi Remijnse, Filip Ilievski, Antske Fokkens, Sam Titarsolej, Piek Vossen (2020). Combining Conceptual and Referential Annotation to Study Variation in Framing. In Proceedings of the International FrameNet Workshop 2020: Towards a Global, Multilingual FrameNet. 31–40.

68. Avijit Thawani, Jay Pujara, Filip Ilievski, Pedro Szekely (2020). Representing Numbers in Language Models. West Coast NLP (WeCNLP) Summit.

69. Filip Ilievski (2019). Identity of Long-Tail Entities in Text. Studies on the Semantic Web. Volume 43. IOS Press. ISBN 978-1-64368-042-2 (print) | 978-1-64368-043-9 (online).

70. Filip Ilievski (2019). Identity of Long-Tail Entities in Text. PhD dissertation. Vrije Universiteit Amsterdam. 227p.

71. Filip Ilievski, Eduard Hovy, Piek Vossen, Stefan Schlobach, Qizhe Xie (2019). The Role of Knowledge in Establishing Identity of Long-Tail Entities. Journal of Web Semantics (JWS), Special Issue on Language Technology and Knowledge Graphs. Volumes 61-62. ISSN 1570-8268. 10.2139/ssrn.3697491.

72. Filip Ilievski, Piek Vossen, Stefan Schlobach (2018). Systematic Study of Long Tail Phenomena in Entity Linking. In Proceedings of the 27th International Conference on Computational Linguistics (COLING). Association for Computational Linguistics. 664–674.

73. Piek Vossen, Filip Ilievski, Marten Postma, Roxane Segers (2018). Don’t Annotate, but Validate: a Data-to-Text Method for Capturing Event Data. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). European Language Resources Association (ELRA).

74. Piek Vossen, Marten Postma, Filip Ilievski (2018). ReferenceNet: a semantic-pragmatic network for capturing reference relations. In Proceedings of the 9th Global Wordnet Conference. Global Wordnet Association. 219–228.

75. Marten Postma, Filip Ilievski, Piek Vossen (2018). SemEval-2018 Task 5: Counting Events and Participants in the Long Tail. In Proceedings of The 12th International Workshop on Semantic Evaluation. Association for Computational Linguistics. 70-80. DOI.

76. Wouter Beek, Filip Ilievski, Jeremy Debattista, Stefan Schlobach, Jan Wielemaker (2017). Literally Better: Analyzing and Improving the Quality of Literals. Semantic Web Journal (SWJ). Semantic Web, volume 9. DOI.

77. Wouter Beek, Laurens Rietveld, Filip Ilievski, Stefan Schlobach (2017). LOD Lab: Scalable Linked Data Processing. In Reasoning Web: Logical Foundation of Knowledge Graph Construction and Query Answering. Springer International Publishing. 124–155. ISBN 978-3-319-49493-7. DOI.

78. Filip Ilievski, Piek Vossen, Marieke van Erp (2017). Hunger for Contextual Knowledge and a Road Map to Intelligent Entity Linking. In proceedings of Language, Data and Knowledge (LDK). Springer International Publishing. 143–149. ISBN 978-3-319-59888-8.

79. Filip Ilievski, Marten Postma, Piek Vossen (2016). Semantic overfitting: what ‘world’ do we consider when evaluating disambiguation of text?. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee. 1180–1191.

80. Filip Ilievski, Wouter Beek, Marieke van Erp, Laurens Rietveld, Stefan Schlobach (2016). LOTUS: Adaptive Text Search for Big Linked Data. In Proceedings of the 13th International Conference on The Semantic Web. Latest Advances and New Domains - Volume 9678. ISBN 978-3-319-34128-6. 470-485. DOI.

81. Filip Ilievski, Giuseppe Rizzo, Marieke van Erp, Julien Plu, Raphael Troncy (2016). Context-enhanced Adaptive Entity Linking. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16). European Language Resources Association (ELRA). 541-548.

82. Marieke van Erp, Pablo Mendes, Heiko Paulheim, Filip Ilievski, Julien Plu, Giuseppe Rizzo, Joerg Waitelonis (2016). Evaluating Entity Linking: An Analysis of Current Benchmark Datasets and a Roadmap for Doing a Better Job. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16). European Language Resources Association (ELRA). 4373–4379.

83. Roxane Segers, Egoitz Laparra, Marco Rospocher, Piek Vossen, German Rigau, Filip Ilievski (2016). The Predicate Matrix and the Event and Implied Situation Ontology: Making More of Events. In Proceedings of the 8th Global WordNet Conference (GWC). Global Wordnet Association. 364-372.

84. Marten Postma, Filip Ilievski, Piek Vossen, Marieke van Erp (2016). Moving away from semantic overfitting in disambiguation datasets. In Proceedings of the Workshop on Uphill Battles in Language Processing: Scaling Early Achievements to Robust Methods. Association for Computational Linguistics. 17-21. DOI.

85. Marieke van Erp, Roxane Segers, Filip Ilievski, Antske Fokkens, Rodrigo Agerri, Marco Rospocher, Itziar Aldabe, Egoitz Laparra, German Rigau, Sanne Vrijenhoek (2016). D5. 2.2 Domain model for financial and economic events, version 3 Deliverable D5. 2.2.

86. Piek Vossen, Tommaso Caselli, Agata Cybulska, Antske Fokkens, [Filip Ilievski]{.ul}, Anne-Lyse Minard, Paramita Mirza, Itziar Aldabe, Egoitz Laparra, German Rigau (2016). Event Narrative Module, version 3 Deliverable D5.1.3.

87. Filip Ilievski, Wouter Beek, Marieke van Erp, Laurens Rietveld, Stefan Schlobach (2015). LOTUS: Linked Open Text UnleaShed. In Proceedings of the 6th International Workshop on Consuming Linked Data (COLD).

88. Marieke van Erp, Filip Ilievski, Marco Rospocher, Piek Vossen (2015). Missing Mr. Brown and buying an Abraham Lincoln – Dark Entities and DBpedia. In Proceedings of the NLP and DBpedia workshop.

89. Tommaso Caselli, Piek Vossen, Marieke van Erp, Antske Fokkens, Filip Ilievski, Ruben Izquierdo Bevia, Minh Lê, Roser Morante, and Marten Postma (2015). When it’s all piling up: investigating error propagation in an NLP pipeline. In: NLP Applications: completing the puzzle.

90. Piek Vossen, Tommaso Caselli, Filip Ilievski, Ruben Izquierdo, Alessandro Lopopolo, Emiel Van Miltenburg, Roser Morante, Ngoc Minh, Marten Postma (2015). Words in context: a reference perspective on the lexicon. In Proceedings of the MAPLEX workshop.