Seekable OCI indexing support announced for Amazon SageMaker AI

Amazon Web Services (AWS) has launched Seekable OCI (SOCI) indexing support for Amazon SageMaker AI training and processing tasks. This new feature enables lazy-loading by fetching only the necessary files instantly instead of downloading entire container images, allowing jobs to start in seconds rather than minutes.

SOCI indexing technology removes the container image download process from the critical path, reducing GPU idle times by up to 90 percent according to benchmarks. The system streams the remaining data in the background while pulling the files required for startup.

Users can deploy this feature by using pre-indexed AWS Deep Learning Containers or by adding an index to their own custom images. This process does not require any changes to existing job definitions or entry points.