AI / ML

Vibhor Kumar argues that AI reliability failures stem from infrastructure execution issues like timeouts and crashes, not model accuracy. ORBIT is introduced as an execution framework designed to handle these non-intelligent system failures. The piece emphasizes that robust engineering is required to ensure decisions remain explainable and consistent despite underlying process instability.

• Reliability depends on execution resilience, not just model intelligence.
• Network timeouts and worker restarts cause unexplainable AI failures.
• ORBIT provides a framework to manage these system-level risks.
• Focus on state recording and message deduplication for consistency.

Training deep learning models on variable-length sequences often forces a trade-off between efficiency and implementation complexity. Data-Centric Parallel (DCP) resolves this by letting data drive runtime settings, dynamically adjusting parallel size, gradient accumulation, and recomputation based on each batch's sequence length. This approach eliminates the need for static configurations or extensive code changes, achieving up to a 2.88x speedup on H200 GPUs.

• DCP dynamically adjusts parallel size and gradient accumulation per batch based on sequence length.
• Avoids workload imbalance caused by static configuration approaches in variable-length training.
• Reduces code complexity compared to existing methods that require significant architectural changes.
• Delivers up to 2.88x speedup on 32 H200 GPUs for deep learning workloads.

Google DeepMind has open-sourced the code for WeatherNext 2, a global medium-range atmospheric and cyclone forecasting model. The repository also includes implementations for its predecessors, GraphCast and GenCast. Users can access model outputs via Google Cloud services, WeatherLab, or OpenMeteo without running the model locally.

• Open-source access to WN2 code enables local experimentation and integration.
• Predecessor models GraphCast and GenCast code are also included in the repo.
• Direct data feeds available via Google Cloud, WeatherLab, and OpenMeteo APIs.
• Focuses on global medium-range forecasting and tropical cyclone tracking.