| ID | Workflow | Result | Correct | Bug | Created | Started | Finished | Revision | Error |
|---|---|---|---|---|---|---|---|---|---|
| e8a9d68b-3db4-4e66-a3df-1abbef210f10 | repro | 💥 | KCSAN: data-race in __stop_tty / pty_write (16) | 2026/03/09 22:34 | 2026/03/09 22:34 | 2026/03/09 22:57 | 6972f30219093b03bcc1a54487e12a7097245c01 | Error 504, Message: Deadline expired before operation could complete., Status: DEADLINE_EXCEEDED, Details: [map[@type:type.googleapis.com/google.rpc.DebugInfo detail:[ORIGINAL ERROR] generic::deadline_exceeded: [original: beyond::dependency::DEADLINE_EXCEEDED] while running coroutine; Failed while fetching a stream from leaf at '<bns:/bns/mh/borg/mh/bns/uniserve-model-server-common-prod-jobs/uniserve.prod-common-mh.prod-common-global.ghostlite_pod-16x16.d25843e7-34fd-4991-a772-fc875026757d/128>'; Failed to close the streaming context; status = DEADLINE_EXCEEDED: while running coroutine; Failed while fetching a stream from leaf at '<bns:/bns/mh/borg/mh/bns/uniserve-model-server-common-prod-jobs/uniserve.prod-common-mh.prod-common-global.ghostlite_pod-16x16.d25843e7-34fd-4991-a772-fc875026757d/128>' [type.googleapis.com/stairways.orch.ErrorLoc='learning/serving/servables/wiz/orch_wiz_servable.cc:1077'] === Source Location Trace: === net/rpc/common/stream/stream-context.cc:1470 learning/brain/research/stairways/orchestrator/root/remote_chain.cc:150 learning/serving/servables/wiz/orch_wiz_servable.cc:1085 ; Failed to run inference for model: go/debugstr name: "prod-common-global__/aistudio/gemini-v4p1m-rev24-snowball-lc__main__/aistudio/gemini-v4p1m-rev24-snowball-lc__2026022700__prefill__variant__c3238ed4-cb0b-41c1-a7f5-a73f3b419975" version { value: 1 } signature_name: "serving_default" ; [model=/aistudio/gemini-v4p1m-rev24-snowball-lc,target=PredictionService]; for endpoint: [google.rpc.error_details_ext] { message: "Deadline expired before operation could complete." details { type_url: "type.googleapis.com/language_labs.genai.debug.GeminiApiDebugInfo" value: "\222\001\375\t\n\335\twhile running coroutine; Failed while fetching a stream from leaf at \'<bns:/bns/mh/borg/mh/bns/uniserve-model-server-common-prod-jobs/uniserve.prod-common-mh.prod-common-global.ghostlite_pod-16x16.d25843e7-34fd-4991-a772-fc875026757d/128>\'; Failed to close the streaming context; status = DEADLINE_EXCEEDED: while running coroutine; Failed while fetching a stream from leaf at \'<bns:/bns/mh/borg/mh/bns/uniserve-model-server-common-prod-jobs/uniserve.prod-common-mh.prod-common-global.ghostlite_pod-16x16.d25843e7-34fd-4991-a772-fc875026757d/128>\' [type.googleapis.com/stairways.orch.ErrorLoc=\'learning/serving/servables/wiz/orch_wiz_servable.cc:1077\']\n=== Source Location Trace: ===\nnet/rpc/common/stream/stream-context.cc:1470\nlearning/brain/research/stairways/orchestrator/root/remote_chain.cc:150\nlearning/serving/servables/wiz/orch_wiz_servable.cc:1085\n; Failed to run inference for model: go/debugstr \nname: \"prod-common-global__/aistudio/gemini-v4p1m-rev24-snowball-lc__main__/aistudio/gemini-v4p1m-rev24-snowball-lc__2026022700__prefill__variant__c3238ed4-cb0b-41c1-a7f5-a73f3b419975\"\nversion {\n value: 1\n}\nsignature_name: \"serving_default\"\n; [model=/aistudio/gemini-v4p1m-rev24-snowball-lc,target=PredictionService]; for endpoint: \022\033net/rpc/rpc-status.cc:562:0" } } 525002922 { 3 { 1: "/aistudio/gemini-v4p1m-rev24-snowball-lc" } 6 { 5 { 1 { 1: "/aistudio/gemini-v4p1m-rev24-snowball-lc" 3: "serving_default" } 2: 1048576 3: 1 } 6 { 2: 1 3: 0 4: "Non-retryable error: while running coroutine; Failed while fetching a stream from leaf at \'<bns:/bns/mh/borg/mh/bns/uniserve-model-server-common-prod-jobs/uniserve.prod-common-mh.prod-common-global.ghostlite_pod-16x16.d25843e7-34fd-4991-a772-fc875026757d/128>\'; Failed to close the streaming context; status = DEADLINE_EXCEEDED: while running coroutine; Failed while fetching a stream from leaf at \'<bns:/bns/mh/borg/mh/bns/uniserve-model-server-common-prod-jobs/uniserve.prod-common-mh.prod-common-global.ghostlite_pod-16x16.d25843e7-34fd-4991-a772-fc875026757d/128>\' [type.googleapis.com/stairways.orch.ErrorLoc=\'learning/serving/servables/wiz/orch_wiz_servable.cc:1077\']\n=== Source Location Trace: ===\nnet/rpc/common/stream/stream-context.cc:1470\nlearning/brain/research/stairways/orchestrator/root/remote_chain.cc:150\nlearning/serving/servables/wiz/orch_wiz_servable.cc:1085\n | |
| 4f8bda19-d56a-49f6-879d-185e0fb1c438 | assessment-kcsan | Benign: ✅ | ❓ | KCSAN: data-race in __stop_tty / pty_write (16) | 2026/01/10 08:14 | 2026/01/10 08:14 | 2026/01/10 08:38 | 7519916073b761ced56a7b15fdeeb4674e8dc125 |