FUEL Status - Intermittent errors on google/gemma-4-31b-it – Incident details

Error rates on the google/gemma-4-31b-it model have returned to normal and remained stable overnight following the change deployed to limit how often the affected connection re-establishes. We are continuing to work with our infrastructure provider on the underlying network path issue. This incident is now resolved.

Error rates on the google/gemma-4-31b-it model have returned to normal and remain stable following the change deployed earlier. We are working with our infrastructure provider to resolve the underlying network path issue and will continue to monitor overnight. We will provide another update by morning.

We have identified the cause of the intermittent errors affecting the google/gemma-4-31b-it model: an instability in the network path serving it causes requests to fail intermittently. A fix is rolling out to limit how often the connection re-establishes, which should reduce the errors significantly while we address the underlying path issue with our provider. Error rates have already improved; some intermittent errors may continue until the rollout completes. We are monitoring and will update shortly.

A mitigation was applied to reduce errors on the google/gemma-4-31b-it model, and error rates improved, but our investigation is ongoing as some intermittent errors continue. We are continuing to work on a full fix and will provide another update shortly.

We have identified the cause of the elevated errors affecting the google/gemma-4-31b-it model and applied a mitigation. Error rates for this model have largely returned to normal, and we are monitoring to confirm stability. A small number of requests to other models may still see brief, intermittent errors while we complete our investigation. We will provide another update shortly.