Ever since the Large Language Model (LLM) revolution took over in 2023, I have been working on the engineering side of LLMs, developing the tools and platforms that support Baidu’s flagship LLM ERNIE Bot. I am delighted to share a talk that my colleague and I presented at the WAVE SUMMIT 2023深度学习开发者大会. In this talk, we introduced PaddleNLP and PaddleMix, which are the open-source versions of our work on LLMs and multi-modal models, respectively.
The slides for the talk are accessible here, and a recording can be viewed here. If you prefer a rewritten transcript, you can access it via this WeChat Blog.
PREVIOUSQuantization Basics