Publications
International Conference
2027
- Sumika Tsuda, Kazuki Yano, Jun Suzuki, and Reina Akama. After the Predicate Comes the Phrase: How Inversion Affects LLM Reading Comprehension. Findings of EACL 2027.
2026
- Kazuki Yano, Jun Suzuki, and Shinji Watanabe. Adapting Text LLMs to Speech via Multimodal Depth Up-Scaling. INTERSPEECH 2026 [arXiv].
- Kazuki Yano, Shun Kiyono, Sosuke Kobayashi, Sho Takase, and Jun Suzuki. Pre-training LLM without Learning Rate Decay Enhances Supervised Fine-Tuning. ICLR 2026 [OpenReview].
- Ryo Fujii, Makoto Morishita, Kazuki Yano, and Jun Suzuki. TimeMachine-bench: A Benchmark on Evaluating Model's Capability on Repository-level Migration Tasks. EACL 2026 [ACL Anthology].
- Keigo Shibata, Kazuki Yano, Ryosuke Takahashi, Wataru Ikeda, and Jun Suzuki. Suppressing Final Layer Hidden State Jumps in Transformer Pretraining. Findings of EACL 2026 [ACL Anthology].
2025
- Kazuki Yano, Sho Takase, Sosuke Kobayashi, Shun Kiyono, and Jun Suzuki. Efficient Construction of Model Family through Progressive Training Using Model Expansion. COLM 2025 [OpenReview].
- Wataru Ikeda, Kazuki Yano, Ryosuke Takahashi, Jaesung Lee, Keigo Shibata, and Jun Suzuki. Layer-wise Importance Analysis of Feed-Forward Networks in Transformer-based Language Models. COLM 2025 [OpenReview].
- Kazuki Yano, Takumi Ito, and Jun Suzuki. STEP: Staged Parameter-Efficient Pre-training for Large Language Models. NAACL 2025 [ACL Anthology].
2024
- Keito Kudo, Hiroyuki Deguchi, Makoto Morishita, Ryo Fujii, Takumi Ito, Shintaro Ozaki, Koki Natsumi, Kai Sato, Kazuki Yano, Ryosuke Takahashi, Subaru Kimura, Tomomasa Hara, Yusuke Sakai, and Jun Suzuki. Document-level Translation with LLM Reranking: Team-J at WMT 2024 General Translation Task. WMT 2024 [ACL Anthology].
- Kazuki Yano, Takumi Ito, and Jun Suzuki. STEP: Staged Parameter-Efficient Pre-training for Large Language Models. ACL 2024 Student Research Workshop.