Jexus Scripts


Scripts by a student in electrical engineering

美國 EECS 博士班申請經驗分享 (ML/DL/NLP/Speech)

2021 Fall NLP/Speech PhD Application


My Work - Lifelong Language Knowledge Distillation

EMNLP 2020 long paper


My Work - Dual Inference for Improving Language Understanding and Generation

EMNLP 2020 findings paper


Which layer preserves the best cross-lingual representations in multilingual-BERT?

Small experiments on multilingual-BERT


What has the positional "embedding" learned?

Small probing experiments on the positional embeddings


My Work - SpeechBERT:An Audio-and-text Jointly Learned Language Model for End-to-end Spoken Question Answering

Interspeech 2020 conference paper


My Work - Towards Understanding of Medical Randomized Controlled Trials by Conclusion Generation

In Proceedings of the 10th International Workshop on Health Text Mining and Information Analysis at EMNLP (LOUHI 2019)


RoBERTa - A Robustly Optimized BERT Pretraining Approach

2019 paper (enhanced BERT, beating XLNet) - slide


Visualizing and Measuring the Geometry of BERT​

2019 short paper - slide


Multi-Source Unsupervised Domain Adaptation

DLCV 2019 Spring Final Project - ICCV 2019 Workshop (Visual Domain Adaptation Challenge)