Samuel Cahyawijaya

A passionate machine learning researcher. Enjoy to work on data technology, machine learning, and autonomous system. Experienced in data analysis, forecasting, artificial intelligence, machine learning, deep learning, etc.

I want to get deeper understanding on how human minds work and I have a passion on how to build one myself.

You can take a look at my CV here.

If you are interested to collaborate or discuss, please feel free to reach out to me via email.

News

Sep 19, 2023	So proud of our latest IndoNLP ’s collaboration project! 🚀 Introducing NusaWrites, our groundbreaking project accepted at AACL 2023. 📚🌍 Dive deep into our analysis of corpora collection strategy and explore a comprehensive language modeling benchmark for underrepresented and extremely low-resource 🇮🇩 local languages.
May 4, 2023	EACL 2023 Outstanding Paper Award for NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages.
May 1, 2023	NusaCrowd is published in ACL Findings 2023. So proud of our IndoNLP community! From a joint collaboration to 100+ datasets.

Selected Publications

Instruct-Align: Teaching Novel Languages with to LLMs through Alignment-based Cross-Lingual Instruction

Samuel Cahyawijaya, Holy Lovenia, Tiezheng Yu, Willy Chung, and Pascale Fung.

arXiv preprint arXiv:2305.13627. 2023.

arXiv Bib

@article{cahyawijaya2023instruct,
  title = {{Instruct-Align: Teaching Novel Languages with to LLMs through Alignment-based Cross-Lingual Instruction}},
  author = {Cahyawijaya, Samuel and Lovenia, Holy and Yu, Tiezheng and Chung, Willy and Fung, Pascale},
  year = {2023},
  journal = {arXiv preprint arXiv:2305.13627},
}

Multilingual Large Language Models Are Not (Yet) Code-Switchers

Ruochen Zhang, Samuel Cahyawijaya, Jan Christian Blaise Cruz, and Alham Fikri Aji.

arXiv preprint arXiv:2305.14235. 2023.

arXiv Bib

@article{zhang2023multilingual,
  title = {{Multilingual Large Language Models Are Not (Yet) Code-Switchers}},
  author = {Zhang, Ruochen and Cahyawijaya, Samuel and Cruz, Jan Christian Blaise and Aji, Alham Fikri},
  year = {2023},
  journal = {arXiv preprint arXiv:2305.14235},
}

NusaCrowd: Open Source Initiative for Indonesian NLP Resources

Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Fajri Koto, and others.

In Findings of the Association for Computational Linguistics: ACL 2023, Toronto, Canada, 9-14 July 2023. 2023.

arXiv Bib

@inproceedings{cahyawijaya2022nusacrowd,
  title = {{NusaCrowd: Open Source Initiative for Indonesian NLP Resources}},
  author = {Cahyawijaya, Samuel and Lovenia, Holy and Aji, Alham Fikri and Winata, Genta Indra and Wilie, Bryan and Mahendra, Rahmad and Wibisono, Christian and Romadhony, Ade and Vincentio, Karissa and Koto, Fajri and others},
  year = {2023},
  journal = {arXiv preprint arXiv:2207.10524},
  booktitle = {Findings of the Association for Computational Linguistics: {ACL} 2023, Toronto, Canada, 9-14 July 2023},
  publisher = {Association for Computational Linguistics},
  series = {Findings of {ACL}},
  volume = {{ACL} 2023},
}

NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages

Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Rahmad Mahendra, Fajri Koto, Ade Romadhony, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Pascale Fung, Timothy Baldwin, Jey Han Lau, Rico Sennrich, and Sebastian Ruder.

In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics. May 2023.

Bib PDF

@inproceedings{winata-etal-2023-nusax,
  title = {{NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages}},
  author = {Winata, Genta Indra and Aji, Alham Fikri and Cahyawijaya, Samuel and Mahendra, Rahmad and Koto, Fajri and Romadhony, Ade and Kurniawan, Kemal and Moeljadi, David and Prasojo, Radityo Eko and Fung, Pascale and Baldwin, Timothy and Lau, Jey Han and Sennrich, Rico and Ruder, Sebastian},
  year = {2023},
  month = may,
  booktitle = {Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics},
  publisher = {Association for Computational Linguistics},
  address = {Dubrovnik, Croatia},
  pages = {815--834},
}

The Obscure Limitation of Modular Multilingual Language Models

Muhammad Farid Adilazuarda, Samuel Cahyawijaya, and Ayu Purwarianti.

In Tiny Papers of Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda, 5 May 2023. May 2023.

Bib PDF

@inproceedings{adilazuarda2023obscure,
  title = {{The Obscure Limitation of Modular Multilingual Language Models}},
  author = {Adilazuarda, Muhammad Farid and Cahyawijaya, Samuel and Purwarianti, Ayu},
  year = {2023},
  booktitle = {Tiny Papers of Eleventh International Conference on Learning Representations (ICLR), Kigali, Rwanda, 5 May 2023},
  publisher = {ICLR},
}

How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling

Samuel Cahyawijaya, Bryan Wilie, Holy Lovenia, Huan Zhong, MingQian Zhong, Yuk-Yu Nancy Ip, and Pascale Fung.

In Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI). Dec 2022.

Bib PDF

@inproceedings{cahyawijaya-etal-2022-long,
  title = {{How Long Is Enough? Exploring the Optimal Intervals of Long-Range Clinical Note Language Modeling}},
  author = {Cahyawijaya, Samuel and Wilie, Bryan and Lovenia, Holy and Zhong, Huan and Zhong, MingQian and Ip, Yuk-Yu Nancy and Fung, Pascale},
  year = {2022},
  month = dec,
  booktitle = {Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI)},
  publisher = {Association for Computational Linguistics},
  address = {Abu Dhabi, United Arab Emirates (Hybrid)},
  pages = {160--172},
}

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia

Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, and Sebastian Ruder.

In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022. Dec 2022.

arXiv Bib PDF

@inproceedings{DBLP:conf/acl/AjiWKCRMKMPBLR22,
  title = {{One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia}},
  author = {Aji, Alham Fikri and Winata, Genta Indra and Koto, Fajri and Cahyawijaya, Samuel and Romadhony, Ade and Mahendra, Rahmad and Kurniawan, Kemal and Moeljadi, David and Prasojo, Radityo Eko and Baldwin, Timothy and Lau, Jey Han and Ruder, Sebastian},
  year = {2022},
  journal = {CoRR},
  booktitle = {Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), {ACL} 2022, Dublin, Ireland, May 22-27, 2022},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2203.13357},
  pages = {7226--7249},
  doi = {10.18653/v1/2022.acl-long.500},
  editor = {Muresan, Smaranda and Nakov, Preslav and Villavicencio, Aline},
  timestamp = {Mon, 01 Aug 2022 01:00:00 +0200},
  biburl = {https://dblp.org/rec/conf/acl/AjiWKCRMKMPBLR22.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}

SNP2Vec: Scalable Self-Supervised Pre-Training for Genome-Wide Association Study

Samuel Cahyawijaya, Tiezheng Yu, Zihan Liu, Xiaopu Zhou, Tze Wing Tiffany Mak, Nancy Y. Ip, and Pascale Fung.

In Proceedings of the 21st Workshop on Biomedical Language Processing, BioNLP@ACL 2022, Dublin, Ireland, May 26, 2022. Dec 2022.

arXiv Bib PDF

@inproceedings{DBLP:conf/bionlp/CahyawijayaYLZM22,
  title = {{SNP2Vec: Scalable Self-Supervised Pre-Training for Genome-Wide Association Study}},
  author = {Cahyawijaya, Samuel and Yu, Tiezheng and Liu, Zihan and Zhou, Xiaopu and Mak, Tze Wing Tiffany and Ip, Nancy Y. and Fung, Pascale},
  year = {2022},
  journal = {CoRR},
  booktitle = {Proceedings of the 21st Workshop on Biomedical Language Processing, BioNLP@ACL 2022, Dublin, Ireland, May 26, 2022},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2204.06699},
  pages = {140--154},
  doi = {10.18653/v1/2022.bionlp-1.14},
  editor = {Demner{-}Fushman, Dina and Cohen, Kevin Bretonnel and Ananiadou, Sophia and Tsujii, Junichi},
  timestamp = {Mon, 01 Aug 2022 01:00:00 +0200},
  biburl = {https://dblp.org/rec/conf/bionlp/CahyawijayaYLZM22.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation

Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, and Pascale Fung.

In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. Dec 2021.

arXiv Bib PDF

@inproceedings{DBLP:conf/emnlp/CahyawijayaWWVL21,
  title = {{IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation}},
  author = {Cahyawijaya, Samuel and Winata, Genta Indra and Wilie, Bryan and Vincentio, Karissa and Li, Xiaohong and Kuncoro, Adhiguna and Ruder, Sebastian and Lim, Zhi Yuan and Bahar, Syafri and Khodra, Masayu Leylia and Purwarianti, Ayu and Fung, Pascale},
  year = {2021},
  journal = {CoRR},
  booktitle = {Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, {EMNLP} 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2104.08200},
  pages = {8875--8898},
  doi = {10.18653/v1/2021.emnlp-main.699},
  editor = {Moens, Marie{-}Francine and Huang, Xuanjing and Specia, Lucia and Yih, Scott Wen{-}tau},
  timestamp = {Thu, 20 Jan 2022 00:00:00 +0100},
  biburl = {https://dblp.org/rec/conf/emnlp/CahyawijayaWWVL21.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}

IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding

Bryan Wilie, Karissa Vincentio, Genta Indra Winata, Samuel Cahyawijaya, Xiaohong Li, Zhi Yuan Lim, Sidik Soleman, Rahmad Mahendra, Pascale Fung, Syafri Bahar, and Ayu Purwarianti.

In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2020, Suzhou, China, December 4-7, 2020. Dec 2020.

arXiv Bib PDF

@inproceedings{DBLP:conf/ijcnlp/WilieVWCLLSMFBP20,
  title = {{IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding}},
  author = {Wilie, Bryan and Vincentio, Karissa and Winata, Genta Indra and Cahyawijaya, Samuel and Li, Xiaohong and Lim, Zhi Yuan and Soleman, Sidik and Mahendra, Rahmad and Fung, Pascale and Bahar, Syafri and Purwarianti, Ayu},
  year = {2020},
  journal = {CoRR},
  booktitle = {Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, {AACL/IJCNLP} 2020, Suzhou, China, December 4-7, 2020},
  publisher = {Association for Computational Linguistics},
  volume = {abs/2009.05387},
  pages = {843--857},
  editor = {Wong, Kam{-}Fai and Knight, Kevin and Wu, Hua},
  timestamp = {Fri, 06 Aug 2021 01:00:00 +0200},
  biburl = {https://dblp.org/rec/conf/ijcnlp/WilieVWCLLSMFBP20.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org},
  eprinttype = {arXiv},
}