Shinhyeok Oh

I obtained a master’s degree in computer and communications engineering from the Kangwon National University, under the guidance of Prof. Harksoo Kim. I am currently working at Riiid as Research Scientist (NLP), and enjoy discussing topics related to transfer learning and knowledge distillation. Specifically, I find pleasure in exploring ways, such as self-supervised learning, domain adaptation, and multi-modality, to extract value from other tasks, domains, or previously overlooked resources for the intended objective.

Email: achromatically@naver.com
Google Scholar: Link
LinkedIn: Link
CV: Link

Research Interests

Transfer Learning, Large Language Models, Multimodality

NEWS

DEC 2023: Our paper (MEME) got accepted to AAAI 2024.
SEP 2023: Our paper on diffusion models (ANT) got accepted to NeurIPS 2023.
May 2023: Our 2 papers got accepted to Findings of ACL 2023.
NOV 2022: Our paper on text-to-speech synthesis (RWEN-TTS) got accepted to AAAI 2023.
NOV 2021: We took the first place both automatic evaluation and human evaluation in the APE task @WMT, EMNLP 2021.
SEP 2021: Our system paper on Automatic Post-Editing got accepted to WMT, EMNLP 2021.
MAY 2021: Our paper on Aspect-based Sentiment Analysis(DCRAN) got accepted to ACL 2021.

Academic Activities

Reviewer of ACL, NAACL, EACL, and ARR
Reviewer of Artificial Intelligence Review
Reviewer of IEEE Transactions on Audio, Speech and Language Processing

International Publications

[2024]

Multi-Architecture Multi-Expert Diffusion Models
{Yunsung Lee, Jin-Young Kim, Hyojun Go}⁺, Myeongho Jeong, Shinhyeok Oh, Seungtaek Choi (⁺Co-first author)
AAAI 2024 [PDF]

[2023]

Addressing Negative Transfer in Diffusion Models
{Hyojun Go, JinYoung Kim, Yunsung Lee}⁺, Seunghyun Lee, Shinhyeok Oh, Hyeongdon Moon, Seungtaek Choi (⁺Co-first author)
NeurIPS 2023 [PDF]
Evaluation of Question Generation Needs More References
{Shinhyeok Oh, Hyojun Ko}⁺, Hyeongdon Moon, Yunsung Lee, Myeongho Jeong, Hyun Seung Lee and Seungtaek Choi (⁺equal contribution)
Findings of ACL 2023 [PDF]
Cross Encoding As Augmentation: Towards Effective Educational Text Classification
{Hyun Seung Lee, Seungtaek Choi}⁺, Yunsung Lee, Hyeongdon Moon, Shinhyeok Oh, Myeongho Jeong, Hyojun Go, Christian Wallraven (⁺equal contribution)
Findings of ACL 2023 [PDF]
RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech Synthesis
{Shinhyeok Oh, HyeongRae Noh}⁺, Yoonseok Hong, Insoo Oh (⁺equal contribution)
AAAI 2023 (Oral Presentation) [PDF] [Demo]

[2021]

Netmarble AI Center’s WMT21 Automatic Post-Editing Shared Task Submission
{Shinhyeok Oh, Sion Jang, Hu Xu}⁺, Shounan An, Insoo Oh (⁺equal contribution)
WMT @EMNLP 2021 (System paper, 1st place) [PDF] [Results]
Deep Context- and Relation-Aware Learning for Aspect-based Sentiment Analysis
{Shinhyeok Oh, Dongyub Lee}⁺, Taesun Whang, IlNam Park, Gaeun Seo, EungGyun Kim, Harksoo Kim (⁺equal contribution)
ACL 2021 (Oral Presentation) [PDF] [Blog]

[2020]

Improving Document-Level Sentiment Classification Using Importance of Sentences
Gihyeon Choi, Shinhyeok Oh, Harksoo Kim
Entropy (SCIE) [PDF]

[2019]

Multi-Turn Chatbot Based on Query-Context Attentions and Dual Wasserstein Generative Adversarial Networks
Jintae Kim, Shinhyeok Oh, Oh-Woog Kwon, Harksoo Kim
Appl. Sci. (SCIE) [PDF]

Domestic Publications

Method of Reflecting Various Personas in a Chatbot
Shinhyeok Oh, Seokwon Jung, Harksoo Kim
Journal of KIISE (KCI)
Movie Revies Sentiment Analysis Considering the Order in which Sentiment Words Appear
HongJin Kim, Damrin Kim, Boeun Kim, Shinhyeok Oh, Harksoo Kim
HCLT 2020
Korean Named Entity Recognition Using ELECTRA and Label Attention Network
HongJin Kim, Shinhyeok Oh, Harksoo Kim
HCLT 2020
Korean Generative Chatbot using Topic Embedding
Shinhyeok Oh, Harksoo Kim
HCLT 2020
Personal Characteristics Classifier for Persona Chatbot Research
Shinhyeok Oh, Harksoo Kim, Jeong-Eom Lee, Seona Kim, Youngmin Park, Myungho Noh
KSC 2019
Personalized Multi-Turn Chatbot Based on Dual WGAN
Shinhyeok Oh, Jintae Kim, Harksoo Kim, Jeong-Eom Lee, Seona Kim, Youngmin Park, Myungho Noh
HCLT 2019
Multi-head Attention and Pointer Network Based Syllables Dependency Parser
HongJin Kim, Shinhyeok Oh, Damrin Kim, Boeun Kim, Harksoo Kim
HCLT 2019
Persona Reflection Method for Generative Chatbot System
Shinhyeok Oh, Jintae Kim, Youngmin Park, Seona Kim, Jeong-Eom Lee, Harksoo Kim
KCC 2019
Korean Dependency Parsing Using ELMo and Multi-head Attention
Seongsik Park, Shinhyeok Oh, Hongjin Kim, Sihyung Kim, Harksoo Kim
HCLT 2018
Korean Dependency Parsing using Multi-head Attention and Pointer Network
Seongsik Park, Shinhyeok Oh, Hongjin Kim, Harksoo Kim
HCLT 2018

Awards

Year	Award
2023	1st Place, Open LLM Leaderboard (as of Oct 4, 2023) @Huggingface (as a team member) [Link]
2021	The First Place in the APE Task @WMT, EMNLP 2021 (Automatic Post-Editing) [Link]
2020	Special Prize in Korean Language Information Processing Competition (Chatbot)
2020	Special Prize in Korean Language Information Processing Competition (Sentiment Analysis)
2019	Bronze Prize in Korean Language Information Processing Competition (Dependency Parsing)
2019	Gold Prize in 1st Kangwon SW Festival [Link]
2018	Grand Prize in Korean Language Information Processing Competition (Dependency Parsing) [Link]

Invited Talks

Instructor, Kangwon National University, 2023
Courses: Special Lecture for Junior (Topic: Guidance on career path)
Instructor, Kangwon National University, 2023
Courses: Special Lecture for Freshman (Topic: AI Foundation Models)
Instructor, Kangwon National University, 2022
Courses: Special Lecture for Junior (Topic: Career in Artificial Intelligence)

Teaching Experience

Teaching Assistant, LG Uplus, 2020
Courses: Natural Language Processing
Teaching Assistant, Kangwon National University, 2018-2019
Courses: Java Programming, C Programming, App Programing
Instructor, Kangwon National University, 2017 (supplementary classes supported by Kangwon National University)
Courses: Java Programming