MediaTek Cooperates with Baidu Ernie Bot Model to Enhance Generative AI Experience on Edge Devices

Aug 16, 2023 - 2:00 PM

HSINCHU, Taiwan – August 16, 2023 – MediaTek, a leading global fabless semiconductor powering more than two billion connected edge devices every year, today announced it is working closely with Baidu to leverage its Large Language Model (LLM), known as the Ernie Bot Model. Utilizing Baidu’s LLM as well as MediaTek’s latest APUs and NeuroPilot AI Platform, MediaTek aims to accelerate Generative AI application development on smartphones, IoT, vehicles, smart home, and more. This will enable opportunities for on-device Generative AI processing as well as cloud computing.

"Generative AI is quickly increasing in popularity, and we want to provide developers with the tools and ecosystem needed to truly empower edge devices with impactful AI capabilities,” said Dr. Yenchi Lee, Deputy General Manager of MediaTek’s Wireless Communications Business Unit. “Working together with Ernie Bot Model, we aim to achieve our vision of enabling more exciting and innovative experiences in the field of AI.”

In addition to the Ernie Bot Model platform, Baidu also features PaddlePaddle, China’s first independently developed, open-source and open industry-level deep learning platform. Through the integration and development of these two platforms, Baidu has created a solid foundation for AI that significantly reduces the threshold required for AI development and highlights the value of big AI models to enhance real-life AI applications.

MediaTek has an advanced AI platform architecture. NeuroPilot provides a complete and powerful software solution for MediaTek SoC platforms with built-in heterogeneous computing units such as CPUs, GPUs, and APUs (standalone AI processors), enabling developers to "write once, write all" on existing and future MediaTek hardware platforms, as well as product lines such as smartphones, automobiles, smart homes, and IoT, helping developers to efficiently develop and deploy neural network model-based AI applications on MediaTek platforms. AI developers can use mainstream frameworks like TensorFlow, Pytorch, TF Lite, Caffe, Caffe2, and more to build neural network models and connect them to the NeuroPilot system, which can take full advantage of the powerful arithmetic power of the MediaTek AI system to significantly improve the efficiency of the models running on the device, and reduce power and memory consumption.

Recently, Baidu open-sourced the 3B model structure of the Ernie Bot big language model to MediaTek, and based on this, the two parties reached a consensus to jointly optimize the Ernie Bot model on edge devices. In the future, the two parties will also work together to optimize the larger models running on Dimensity platforms, so that the Ernie Bot model can utilize higher performance and greater energy efficiency on edge devices to serve developers and end-users.

MediaTek's long-term partnership with Baidu will empower their respective ecosystems, as each company continues to explore the frontiers of AI technology, working together to drive continued innovation and development in the AI industry.


###


About MediaTek Inc.

MediaTek Incorporated (TWSE: 2454) is a global fabless semiconductor company that enables nearly 2 billion connected devices a year. We are a market leader in developing innovative systems-on-chip (SoC) for mobile, home entertainment, connectivity and IoT products. Our dedication to innovation has positioned us as a driving market force in several key technology areas, including highly power-efficient mobile technologies, automotive solutions and a broad range of advanced multimedia products such as smartphones, tablets, digital televisions, 5G, Voice Assistant Devices (VAD) and wearables. MediaTek empowers and inspires people to expand their horizons and achieve their goals through smart technology, more easily and efficiently than ever before. We work with the brands you love to make great technology accessible to everyone, and it drives everything we do. Visit www.mediatek.com for more information.