あなたの研究テーマについて教えてください。What is your research theme?

My research theme is "Efficient and Accessible AI using Transformer BBVI". My work addresses the significant computational barrier presented by modern AI, particularly large-scale transformer models. The immense resources required to train these models currently limit their development to a few highly-funded corporations, hindering broader innovation and use.

My core research activity is to develop a more efficient and affordable training method using Black Box Variational Inference (BBVI), a technique from Bayesian machine learning. I am currently focused on developing methods to effectively "Bayesianize" transformer architectures. In fact, building upon my prior work on BBVI's variance issues, I have prepared a new draft outlining this approach, which is now under review for next year's AAAI conference.

The academic significance of this research lies in creating a novel, scalable algorithm that can train massive models more efficiently. We will also empirically study its scaling properties, which we believe the AI research community will find useful.

Ultimately, the work carries a significant societal impact. By lowering the hardware requirements for training, our objective is to make cutting-edge AI accessible to smaller organizations, universities, and individual researchers. This would not only democratize the field but also foster a more diverse and innovative AI ecosystem.

なぜ博士課程へ進学しましたか？Why did you decide to pursue a doctoral program?

My decision to pursue a doctoral program was a natural progression, driven by my excitement for exploring knowledge beyond established facts. My academic interests have always been at the intersection of programming and statistics, and I enjoy immersing myself in the new technologies and methodologies that define machine learning and computational data science.

This conviction grew stronger during my master’s program. For my thesis, I proposed a new topic model for analyzing consumer corpora, an effort that culminated in a publication in the Annals of Data Science. However, upon completing my degree, I felt strongly that my academic journey was not yet finished. The research process had uncovered even more ideas I wanted to pursue, and I knew a master’s degree was only a stepping stone toward my ultimate goals.

I realized that to truly contribute to the field and develop my research, I needed a more rigorous and focused environment. The opportunity to study abroad at NAIST presented the perfect path forward. The prospect of learning from the expertise of its faculty and interfacing with international researchers was an invaluable chance to broaden my horizons. Pursuing my doctorate is therefore not just an extension of my studies, but a deliberate step towards becoming a more capable and collaborative researcher on the cutting edge of AI.

Graniteの支援で役立っている・助かっていることを教えてください。Please share what has been helpful or beneficial through the support provided by Granite.

First and foremost, the financial support has been indispensable. My first two years as a doctoral student at NAIST were funded by the MEXT Top Global University Project scholarship. However, this support concluded after my second year, leaving my final and most critical year unfunded. As an international student, this presented an insurmountable challenge, and the aid from the GRANITE project has been instrumental in allowing me to complete my studies. It has relieved significant financial pressure, enabling me to dedicate my full concentration to my research.

Equally valuable, however, is the project's holistic support that extends beyond research into professional development. The GRANITE project's series of lectures on business knowledge, for instance, has provided me with new and interesting perspectives. Furthermore, the support for connecting us with companies and finding internship opportunities is a resource I wish to make even greater use of this year. As I approach the completion of my PhD, I must now begin thinking about career opportunities outside of the university, and the framework provided by GRANITE is an immense help in navigating that transition.

将来の目標、もしくはあなたが胸に秘めた野望があればぜひ教えてください。Please share your future goals or any ambitions you hold close to your heart.

I am driven by the desire to contribute new knowledge to the growing well of human creativity, which is the core of my identity as a researcher.

However, my greatest ambition, which I hope to define my career, is to unlock the potential of AI for everyone. Currently, the development of cutting-edge models is largely limited to a few highly-funded corporations like Meta and OpenAI due to staggering computational requirements. I believe AI is a promising technology that has the potential to change everyone's lives for the better, and democratizing it is the best approach to ensure its benefits are distributed across the entirety of society.

This ambition is the central motivation for my doctoral research. My GRANITE-sponsored project is my first concrete step towards this goal. By developing a more efficient training algorithm, my objective is to make these powerful models more affordable and accessible, providing smaller organizations and researchers with a blueprint to build and innovate. Ultimately, I envision a future where advanced AI is not a walled-off technology but a tool available to the many, and I hope my work helps lay the foundation for that reality.

博士課程進学を考えている人へのメッセージをください。Please share a message for those considering pursuing a doctoral program.

Do not be afraid to step away from the hype and strike out on your own path. It is easy to feel pressure to chase the most popular topics, but research that is not "in vogue" today can become incredibly important tomorrow.

From a pragmatic standpoint, choosing a less crowded area can reduce the stress and the intense pressure to publish or risk being scooped. More importantly, it grants you the freedom to work on projects and topics that you genuinely love.

The process of earning a doctorate is already a high-stress endeavor; it does not have to be a painful one. My recommendation is to use this period of contemplation to find a subject that truly excites you. Following that passion is what will make the journey truly rewarding.