Intel Enables Baidu's ERNIE Bot 4.5 Edge Deployment
Intel Powers Baidu's ERNIE Bot 4.5 for Edge Computing
Baidu made waves in the AI community on June 30 by open-sourcing its ERNIE Bot 4.5 series, comprising ten cutting-edge models. This release includes:
- MoE models with 47B and 3B activation parameters
- A dense model with 0.3B parameters
- Pre-trained weights and inference code for developer accessibility
Technical Synergy with Intel
Intel demonstrated remarkable technical agility by completing edge-side adaptations through its OpenVINO toolkit within hours of Baidu's release. This optimization enables deployment on Intel's Core Ultra platform, leveraging:
- Hardware acceleration
- Cross-platform compatibility
- Enhanced inference performance
The collaboration builds on a partnership dating to 2021, where teams adapted multiple PaddlePaddle models (including PaddleOCR and PaddleDetection) for OpenVINO deployment.
Performance Breakthroughs
The ERNIE Bot 4.5 series showcases significant advances in:
- Multimodal understanding
- Text generation
- Logical reasoning
Independent benchmarks indicate the models outperform GPT4.5 in multiple categories while offering API costs at just 1% of GPT4.5's pricing.
Key Points
- Baidu open-sourced 10 AI models with commercial-ready weights
- Intel achieved same-day edge deployment via OpenVINO optimization
- Models demonstrate superior performance to GPT4.5 at fraction of cost
- Partnership enables direct PaddlePaddle-to-OpenVINO model conversion
