Samuel Cahyawijaya

I’m currently working as a 3rd year PhD Student at Centre for Artificial Intelligence Research (CAiRE) HKUST focusing on the field of multilingualism for low-resource languages, especially in Southeast Asian languages.

In addition to pursuing my PhD, I am also supervising undergraduate and master students who are interested in NLP research. If you are interested in learning more about NLP, please feel free to reach out to me via email

⌛ Previously

Together with my research colleagues, we started an Indonesian research community, 🇮🇩 IndoNLP, and have been active in NLP research in Indonesian indigenous languages (e.g., IndoNLU, IndoNLG, One Country 700+ Languages, NusaX, NusaCrowd, NusaWrites, etc.) since 2020.
🎓 I studied and graduated as an MPhil in The Hong Kong University of Science and Technology, Hong Kong 🇭🇰 from 2019 to 2021. I worked on efficient NLP modeling & low-resource language research as a part of the Centre for Artificial Intelligence Research (CAiRE), HKUST.
- From 2017 to 2019, I built my career in data science and resource-oriented research in Indonesia 🇮🇩. I was a Data Scientist at UangTeman, Senior Research Engineer at Prosa.ai, Indonesia 🇮🇩, and Senior Data Scientist at Julo.
From 2014 to 2017, I built two startups in Indonesia 🇮🇩.
1. A for-profit corporation, namely PT. Devarta Kencana Indonesia, focuses on building a tool for rapid software development.
2. A non-profit organization, namely Yayasan Pelita Cakrawala Inspirasi, focuses on building a healthcare crowd-sourcing platform in Indonesia, known as WeCare.id.
🎓 I got my Bachelor’s degree from the undergraduate program of Computer Science at Bandung Institute of Technology (ITB), Indonesia 🇮🇩 in 2014.
From 2013 to 2015, I worked on various research projects regarding integrated modular avionics, real-time visual tracking, and 3D computer graphics at Bandung Institute of Technology (ITB), Indonesia 🇮🇩.

🏆 Awards

Resource Award at IJCNLP-AACL 2023 for NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages (November 2023 )
Area Chair’s Award at IJCNLP-AACL 2023 for A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity (November 2023 )
Best Paper Award at SEALP 2023 for IndoToD: A Multi-Domain Indonesian Benchmark For End-to-End Task-Oriented Dialogue Systems (November 2023 )
Outstanding Paper Award at EACL 2023 for NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages (May 2023 )
Best Student Paper Award at DialDoc 2022 for Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters (May 2022 )
Honorable Mention Award at NLP4ConvAI for XPersona: Evaluating Multilingual Personalized Chatbot (November 2021 )
Hong Kong PhD Fellowship from Research Grants Council of Hong Kong (September 2021 )
Merit Award of e-Inclusion category at INAICTA 2014 (August 2014 )
Semi-Finalist of the World Citizenship Category of Imagine Cup 2014 (August 2014 )
1st Place Winner of Data Mining Competition at Gemastik 6 (October 2013 )
1st Place Winner of Gemastik 6 Debugging Competition at Gemastik 6 (October 2013 )
3rd Place Winner of Samsung App Challenge 2013 (September 2013 )
1st Place Winner of the Innovation Category of Imagine Cup 2013 (March 2013 )

💡 Interests

As of now, I’m researching the fields of multicultural and multilingualism across various language families and modalities.

You can take a look at my resume here.

If you are interested in collaborating or discussing this, please feel free to reach out to me via email.

News

Dec 12, 2023	Our collaborative research papers Multilingual Large Language Models Are Not Yet Code-Switchers and Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages have been respectively published in EMNLP 2023 and CALCS Workshop 2023!
Nov 6, 2023	🎉 So happy that 3 out of 4 of our published papers in AACL 2023 got an award!
Sep 19, 2023	So proud of our latest IndoNLP ’s collaboration project! 🚀 Introducing NusaWrites, our groundbreaking project accepted at AACL 2023. 📚🌍 Dive deep into our analysis of corpora collection strategy and explore a comprehensive language modeling benchmark for underrepresented and extremely low-resource 🇮🇩 local languages.
May 4, 2023	EACL 2023 Outstanding Paper Award for NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages.
May 1, 2023	NusaCrowd is published in ACL Findings 2023. So proud of our IndoNLP community! From a joint collaboration to 100+ datasets.

Publication Highlight

NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages

Samuel Cahyawijaya, Holy Lovenia, Fajri Koto, Dea Adhista, Emmanuel Dave, Sarah Oktavianti, Salsabil Maulana Akbar, Jhonson Lee, Nuur Shadieq, Tjeng Wawan Cenggoro, Hanung Wahyuning Linuwih, Bryan Wilie, Galih Pradipta Muridan, Genta Indra Winata, David Moeljadi, Alham Fikri Aji, Ayu Purwarianti, and Pascale Fung.

. 2023.

arXiv Bib

@misc{cahyawijaya2023nusawrites,
  title = {{NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages}},
  author = {Cahyawijaya, Samuel and Lovenia, Holy and Koto, Fajri and Adhista, Dea and Dave, Emmanuel and Oktavianti, Sarah and Akbar, Salsabil Maulana and Lee, Jhonson and Shadieq, Nuur and Cenggoro, Tjeng Wawan and Linuwih, Hanung Wahyuning and Wilie, Bryan and Muridan, Galih Pradipta and Winata, Genta Indra and Moeljadi, David and Aji, Alham Fikri and Purwarianti, Ayu and Fung, Pascale},
  year = {2023},
  archiveprefix = {arXiv},
  primaryclass = {cs.CL},
}

InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuning

Samuel Cahyawijaya, Holy Lovenia, Tiezheng Yu, Willy Chung, and Pascale Fung.

arXiv preprint arXiv:2305.13627. 2023.

arXiv Bib

@article{cahyawijaya2023instruct,
  title = {{InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuning}},
  author = {Cahyawijaya, Samuel and Lovenia, Holy and Yu, Tiezheng and Chung, Willy and Fung, Pascale},
  year = {2023},
  journal = {arXiv preprint arXiv:2305.13627},
}

Multilingual Large Language Models Are Not (Yet) Code-Switchers

Ruochen Zhang, Samuel Cahyawijaya, Jan Christian Blaise Cruz, and Alham Fikri Aji.

arXiv preprint arXiv:2305.14235. 2023.

arXiv Bib

@article{zhang2023multilingual,
  title = {{Multilingual Large Language Models Are Not (Yet) Code-Switchers}},
  author = {Zhang, Ruochen and Cahyawijaya, Samuel and Cruz, Jan Christian Blaise and Aji, Alham Fikri},
  year = {2023},
  journal = {arXiv preprint arXiv:2305.14235},
}

NusaCrowd: Open Source Initiative for Indonesian NLP Resources

Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Fajri Koto, and others.

In Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, 9-14 July 2023. 2023.

arXiv Bib

@inproceedings{cahyawijaya2022nusacrowd,
  title = {{NusaCrowd: Open Source Initiative for Indonesian NLP Resources}},
  author = {Cahyawijaya, Samuel and Lovenia, Holy and Aji, Alham Fikri and Winata, Genta Indra and Wilie, Bryan and Mahendra, Rahmad and Wibisono, Christian and Romadhony, Ade and Vincentio, Karissa and Koto, Fajri and others},
  year = {2023},
  journal = {arXiv preprint arXiv:2207.10524},
  booktitle = {Findings of the Association for Computational Linguistics: {ACL} 2023, Toronto, Canada, 9-14 July 2023},
  publisher = {Association for Computational Linguistics},
  series = {Findings of {ACL}},
  volume = {{ACL} 2023},
}

NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages

Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Rahmad Mahendra, Fajri Koto, Ade Romadhony, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Pascale Fung, Timothy Baldwin, Jey Han Lau, Rico Sennrich, and Sebastian Ruder.

In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. May 2023.

Bib PDF

@inproceedings{winata-etal-2023-nusax,
  title = {{NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages}},
  author = {Winata, Genta Indra and Aji, Alham Fikri and Cahyawijaya, Samuel and Mahendra, Rahmad and Koto, Fajri and Romadhony, Ade and Kurniawan, Kemal and Moeljadi, David and Prasojo, Radityo Eko and Fung, Pascale and Baldwin, Timothy and Lau, Jey Han and Sennrich, Rico and Ruder, Sebastian},
  year = {2023},
  month = may,
  booktitle = {Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics},
  publisher = {Association for Computational Linguistics},
  address = {Dubrovnik, Croatia},
  pages = {815--834},
}

The Obscure Limitation of Modular Multilingual Language Models

Muhammad Farid Adilazuarda, Samuel Cahyawijaya, and Ayu Purwarianti.

In Tiny Papers of Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda, 5 May 2023. May 2023.

Bib PDF

@inproceedings{adilazuarda2023obscure,
  title = {{The Obscure Limitation of Modular Multilingual Language Models}},
  author = {Adilazuarda, Muhammad Farid and Cahyawijaya, Samuel and Purwarianti, Ayu},
  year = {2023},
  booktitle = {Tiny Papers of Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda, 5 May 2023},
  publisher = {ICLR},
}

How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling

Samuel Cahyawijaya, Bryan Wilie, Holy Lovenia, Huan Zhong, MingQian Zhong, Yuk-Yu Nancy Ip, and Pascale Fung.

In Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI). Dec 2022.

Bib PDF

@inproceedings{cahyawijaya-etal-2022-long,
  title = {{How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling}},
  author = {Cahyawijaya, Samuel and Wilie, Bryan and Lovenia, Holy and Zhong, Huan and Zhong, MingQian and Ip, Yuk-Yu Nancy and Fung, Pascale},
  year = {2022},
  month = dec,
  booktitle = {Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI)},
  publisher = {Association for Computational Linguistics},
  address = {Abu Dhabi, United Arab Emirates (Hybrid)},
  pages = {160--172},
}

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia

Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, and Sebastian Ruder.

In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. Dec 2022.

arXiv Bib PDF

@inproceedings{DBLP:conf/acl/AjiWKCRMKMPBLR22,
  title = {{One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia}},
  author = {Aji, Alham Fikri and Winata, Genta Indra and Koto, Fajri and Cahyawijaya, Samuel and Romadhony, Ade and Mahendra, Rahmad and Kurniawan, Kemal and Moeljadi, David and Prasojo, Radityo Eko and Baldwin, Timothy and Lau, Jey Han and Ruder, Sebastian},
  year = {2022},
  journal = {CoRR},
  booktitle = {Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), {ACL} 2022, Dublin, Ireland, May 22-27, 2022},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2203.13357},
  pages = {7226--7249},
  doi = {10.18653/v1/2022.acl-long.500},
  editor = {Muresan, Smaranda and Nakov, Preslav and Villavicencio, Aline},
  timestamp = {Mon, 01 Aug 2022 01:00:00 +0200},
  biburl = {https://dblp.org/rec/conf/acl/AjiWKCRMKMPBLR22.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}

SNP2Vec: Scalable Self-Supervised Pre-Training for Genome-Wide Association Study

Samuel Cahyawijaya, Tiezheng Yu, Zihan Liu, Xiaopu Zhou, Tze Wing Tiffany Mak, Nancy Y. Ip, and Pascale Fung.

In Proceedings of the 21st Workshop on Biomedical Language Processing, BioNLP@ACL 2022, Dublin, Ireland, May 26, 2022. Dec 2022.

arXiv Bib PDF

@inproceedings{DBLP:conf/bionlp/CahyawijayaYLZM22,
  title = {{SNP2Vec: Scalable Self-Supervised Pre-Training for Genome-Wide Association Study}},
  author = {Cahyawijaya, Samuel and Yu, Tiezheng and Liu, Zihan and Zhou, Xiaopu and Mak, Tze Wing Tiffany and Ip, Nancy Y. and Fung, Pascale},
  year = {2022},
  journal = {CoRR},
  booktitle = {Proceedings of the 21st Workshop on Biomedical Language Processing, BioNLP@ACL 2022, Dublin, Ireland, May 26, 2022},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2204.06699},
  pages = {140--154},
  doi = {10.18653/v1/2022.bionlp-1.14},
  editor = {Demner{-}Fushman, Dina and Cohen, Kevin Bretonnel and Ananiadou, Sophia and Tsujii, Junichi},
  timestamp = {Mon, 01 Aug 2022 01:00:00 +0200},
  biburl = {https://dblp.org/rec/conf/bionlp/CahyawijayaYLZM22.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation

Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, and Pascale Fung.

In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. Dec 2021.

arXiv Bib PDF

@inproceedings{DBLP:conf/emnlp/CahyawijayaWWVL21,
  title = {{IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation}},
  author = {Cahyawijaya, Samuel and Winata, Genta Indra and Wilie, Bryan and Vincentio, Karissa and Li, Xiaohong and Kuncoro, Adhiguna and Ruder, Sebastian and Lim, Zhi Yuan and Bahar, Syafri and Khodra, Masayu Leylia and Purwarianti, Ayu and Fung, Pascale},
  year = {2021},
  journal = {CoRR},
  booktitle = {Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, {EMNLP} 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2104.08200},
  pages = {8875--8898},
  doi = {10.18653/v1/2021.emnlp-main.699},
  editor = {Moens, Marie{-}Francine and Huang, Xuanjing and Specia, Lucia and Yih, Scott Wen{-}tau},
  timestamp = {Thu, 20 Jan 2022 00:00:00 +0100},
  biburl = {https://dblp.org/rec/conf/emnlp/CahyawijayaWWVL21.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}

IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding

Bryan Wilie, Karissa Vincentio, Genta Indra Winata, Samuel Cahyawijaya, Xiaohong Li, Zhi Yuan Lim, Sidik Soleman, Rahmad Mahendra, Pascale Fung, Syafri Bahar, and Ayu Purwarianti.

In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2020, Suzhou, China, December 4-7, 2020. Dec 2020.

arXiv Bib PDF

@inproceedings{DBLP:conf/ijcnlp/WilieVWCLLSMFBP20,
  title = {{IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding}},
  author = {Wilie, Bryan and Vincentio, Karissa and Winata, Genta Indra and Cahyawijaya, Samuel and Li, Xiaohong and Lim, Zhi Yuan and Soleman, Sidik and Mahendra, Rahmad and Fung, Pascale and Bahar, Syafri and Purwarianti, Ayu},
  year = {2020},
  journal = {CoRR},
  booktitle = {Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, {AACL/IJCNLP} 2020, Suzhou, China, December 4-7, 2020},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2009.05387},
  pages = {843--857},
  editor = {Wong, Kam{-}Fai and Knight, Kevin and Wu, Hua},
  timestamp = {Fri, 06 Aug 2021 01:00:00 +0200},
  biburl = {https://dblp.org/rec/conf/ijcnlp/WilieVWCLLSMFBP20.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}