Meta AI Unveils SPDL Tool to Triple Data Loading Speed for AI Training
Meta AI has launched SPDL, a new tool designed to accelerate data loading for AI model training by up to three times. Using a thread-based approach, SPDL significantly reduces GPU idle time and enhances overall training efficiency, especially for large-scale and high-throughput data systems. The tool is open-source and compatible with major AI frameworks like PyTorch.