Rate this Page

★ ★ ★ ★ ★

beginner/serving_tutorial

Run in Google Colab

Note

Go to the end to download the full example code.

Serve PyTorch models at scale with Ray Serve#

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs
How to configure an HTTP endpoint for the deployment using FastAPI
Enable dynamic request batching for higher throughput
Configure autoscaling and per-replica CPU/GPU resource allocation
Load test the service with concurrent requests and monitor it with the Ray dashboard
How Ray Serve deployments can self-heal from failures
Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

PyTorch v2.9+ and torchvision
Ray Serve (ray[serve]) v2.52.1+
A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup#

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model#

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment#

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation#

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests#

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-07 14:28:51,127 WARNING services.py:2137 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-07 14:28:51,293 INFO worker.py:2014 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2062: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4523) INFO 2026-04-07 14:28:53,718 proxy 172.17.0.2 -- Proxy starting on node 3ff9d40c344409f267ba701d6650fafa1e62666117d4891007c41e1c (HTTP port: 8000).
INFO 2026-04-07 14:28:53,788 serve 3836 -- Started Serve in namespace "serve".
(ProxyActor pid=4523) INFO 2026-04-07 14:28:53,784 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4519) INFO 2026-04-07 14:28:53,888 controller 4519 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4519) INFO 2026-04-07 14:28:53,889 controller 4519 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4523) INFO 2026-04-07 14:28:53,892 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4523) INFO 2026-04-07 14:28:53,899 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fcae0444cd0>.
(ServeController pid=4519) INFO 2026-04-07 14:28:53,993 controller 4519 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4523) INFO 2026-04-07 14:28:57,707 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
INFO 2026-04-07 14:28:57,907 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,164 mnist_classifier_MNISTClassifier ugrpo1jt afbdd968-8938-466e-a26f-5955d5e70b89 -- POST / 200 552.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,167 mnist_classifier_MNISTClassifier ugrpo1jt 2be08ffe-af5f-4e96-a781-4b4f8ff6434e -- POST / 200 537.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,167 mnist_classifier_MNISTClassifier ugrpo1jt 312fd769-e4ec-4828-a754-20da2130f3d0 -- POST / 200 535.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,168 mnist_classifier_MNISTClassifier ugrpo1jt 594c5aa1-6abe-4509-9b9b-44e9e56ae0e8 -- POST / 200 526.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,169 mnist_classifier_MNISTClassifier ugrpo1jt afbd364d-2130-4c3d-b136-6735d7549357 -- POST / 200 527.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,169 mnist_classifier_MNISTClassifier ugrpo1jt 3582988b-7076-4e7f-927c-6ac7c9e106e1 -- POST / 200 526.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,170 mnist_classifier_MNISTClassifier ugrpo1jt c02679ff-4ef2-4358-af7a-60bbc717cae3 -- POST / 200 525.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,171 mnist_classifier_MNISTClassifier ugrpo1jt de8b5217-011f-4e92-a8c0-d954e68f0000 -- POST / 200 524.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,172 mnist_classifier_MNISTClassifier ugrpo1jt c2b0133b-f1b3-42d6-9495-d844ace967c9 -- POST / 200 521.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,174 mnist_classifier_MNISTClassifier ugrpo1jt 5047b8f2-f28f-4ce3-a7a1-9b3a70d15ab9 -- POST / 200 523.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,174 mnist_classifier_MNISTClassifier ugrpo1jt f308eab0-f252-40f7-b60e-e03d14a3c875 -- POST / 200 521.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,175 mnist_classifier_MNISTClassifier ugrpo1jt efb2d712-73f7-4da8-8814-0432ffe7f176 -- POST / 200 519.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,175 mnist_classifier_MNISTClassifier ugrpo1jt af27e10e-b936-4ba5-a0e4-b6a68919aed4 -- POST / 200 519.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,176 mnist_classifier_MNISTClassifier ugrpo1jt 7f2e1cc3-596a-408f-9809-ecde3078fecd -- POST / 200 519.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,178 mnist_classifier_MNISTClassifier ugrpo1jt 89de5072-7566-4b5e-9487-e6704881ed8f -- POST / 200 520.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,180 mnist_classifier_MNISTClassifier ugrpo1jt e3ba0cbc-f214-41e5-bcc0-d70df5b63606 -- POST / 200 520.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,181 mnist_classifier_MNISTClassifier ugrpo1jt 7c1a4299-60bb-4ccf-bcbb-05eb6be28812 -- POST / 200 521.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,181 mnist_classifier_MNISTClassifier ugrpo1jt 8403474e-79e5-4258-b67b-64cb8762736b -- POST / 200 517.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,182 mnist_classifier_MNISTClassifier ugrpo1jt 2f6bd6ff-7b31-4f00-b4b1-0934f87087e3 -- POST / 200 518.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,188 mnist_classifier_MNISTClassifier ugrpo1jt c25b01fa-b0bf-42d3-a012-4b47d1d4af5f -- POST / 200 522.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,190 mnist_classifier_MNISTClassifier ugrpo1jt 3bba1423-88c0-454f-b507-97817814dfa5 -- POST / 200 522.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,190 mnist_classifier_MNISTClassifier ugrpo1jt e09b1df4-f7d8-4a48-bda6-06f16e9b82b4 -- POST / 200 523.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,191 mnist_classifier_MNISTClassifier ugrpo1jt 6704de02-f1e9-4a58-ab10-a5eb02b5e45b -- POST / 200 522.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,310 mnist_classifier_MNISTClassifier ugrpo1jt e3d8eb7a-b24e-425e-b496-4b9f957fd436 -- POST / 200 640.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,316 mnist_classifier_MNISTClassifier ugrpo1jt 5e9166cc-52af-45e3-bf7a-41184169e289 -- POST / 200 645.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,317 mnist_classifier_MNISTClassifier ugrpo1jt 9510fb21-b7a7-421c-b622-34868db84c38 -- POST / 200 646.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,317 mnist_classifier_MNISTClassifier ugrpo1jt 7a7e232a-5c77-46ea-af0a-b61298204b3f -- POST / 200 645.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,318 mnist_classifier_MNISTClassifier ugrpo1jt 9fef415c-bf3b-4620-ac06-e3e33e06426f -- POST / 200 642.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,318 mnist_classifier_MNISTClassifier ugrpo1jt e3f602b2-840d-47d6-9a63-ad3d8fe1b92c -- POST / 200 640.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,318 mnist_classifier_MNISTClassifier ugrpo1jt 82f40adb-d80c-4da5-a404-d28a6ecd6c21 -- POST / 200 640.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,319 mnist_classifier_MNISTClassifier ugrpo1jt 49890871-54b4-4c1c-b5bd-e80618c5f320 -- POST / 200 640.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,319 mnist_classifier_MNISTClassifier ugrpo1jt e72e5af8-3268-4721-a4c8-757470d4e296 -- POST / 200 639.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,319 mnist_classifier_MNISTClassifier ugrpo1jt c88a7733-66e1-498b-b843-29f69a4c6a47 -- POST / 200 640.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,319 mnist_classifier_MNISTClassifier ugrpo1jt f21211da-73a3-4466-91c5-a4d8d8050c54 -- POST / 200 639.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,320 mnist_classifier_MNISTClassifier ugrpo1jt 234d949e-8e78-49b6-82b8-a9d80f0f3b00 -- POST / 200 635.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,320 mnist_classifier_MNISTClassifier ugrpo1jt 5a98153b-c3fe-4dde-8ce5-498cf79e5c4b -- POST / 200 637.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,320 mnist_classifier_MNISTClassifier ugrpo1jt 17b77a3d-7fd9-4385-a254-eaa825653cd3 -- POST / 200 635.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,320 mnist_classifier_MNISTClassifier ugrpo1jt c3a28f54-ff03-4a5d-8c8a-95c82474a7f3 -- POST / 200 632.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,320 mnist_classifier_MNISTClassifier ugrpo1jt e442bb21-0055-470e-ae48-86d9a9809df6 -- POST / 200 631.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,321 mnist_classifier_MNISTClassifier ugrpo1jt dd2e3c4f-34ce-4ecc-959a-9268326af266 -- POST / 200 631.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,321 mnist_classifier_MNISTClassifier ugrpo1jt dc6a0a7d-1648-47c1-99a7-8984260deb71 -- POST / 200 626.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,321 mnist_classifier_MNISTClassifier ugrpo1jt ecd646c5-b849-40db-b2b3-5b12e33eb22a -- POST / 200 625.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,321 mnist_classifier_MNISTClassifier ugrpo1jt 4d069f95-6a4c-4d2f-90fc-132c8d68346c -- POST / 200 626.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,322 mnist_classifier_MNISTClassifier ugrpo1jt 1e0b7eb8-c240-49da-bd7c-3a9cdf17a5db -- POST / 200 618.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,323 mnist_classifier_MNISTClassifier ugrpo1jt e27d8d3b-ac21-49da-9c81-39bc073213e9 -- POST / 200 623.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,323 mnist_classifier_MNISTClassifier ugrpo1jt dfb65f46-0cac-4871-a5f2-cefca58f8b58 -- POST / 200 619.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,323 mnist_classifier_MNISTClassifier ugrpo1jt c7c2fad9-9288-45c6-8976-5627ef96a8b4 -- POST / 200 624.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,324 mnist_classifier_MNISTClassifier ugrpo1jt 486b9583-8eca-4596-a3d5-e432e7d6e1c1 -- POST / 200 624.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,324 mnist_classifier_MNISTClassifier ugrpo1jt 2105161c-75c7-45a1-a188-754afae065a1 -- POST / 200 622.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,324 mnist_classifier_MNISTClassifier ugrpo1jt d57f505e-17fb-45bc-b899-74f3ddaf652a -- POST / 200 617.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,325 mnist_classifier_MNISTClassifier ugrpo1jt cbf0036a-227c-40af-9da3-84e932eafcbd -- POST / 200 614.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,325 mnist_classifier_MNISTClassifier ugrpo1jt cac3879c-4bae-4d2b-a2ea-b9081cd6dc6d -- POST / 200 614.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,325 mnist_classifier_MNISTClassifier ugrpo1jt d851cfef-07b0-4fc8-8dc5-6530e78c7791 -- POST / 200 614.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,325 mnist_classifier_MNISTClassifier ugrpo1jt 46279c0e-66b8-40fa-8f61-d9fc67243b08 -- POST / 200 612.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,326 mnist_classifier_MNISTClassifier ugrpo1jt 8abf6d2f-4f5a-437e-a13e-f1a5e5d8f7b0 -- POST / 200 614.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,327 mnist_classifier_MNISTClassifier ugrpo1jt a1bbe665-1705-4534-9721-f5b6bfa11d6c -- POST / 200 612.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,328 mnist_classifier_MNISTClassifier ugrpo1jt 1f2814ee-6ec5-438c-a04c-2e1f89641d55 -- POST / 200 615.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,331 mnist_classifier_MNISTClassifier ugrpo1jt 0ef37491-842d-47ca-81a8-5e59e365090d -- POST / 200 618.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,331 mnist_classifier_MNISTClassifier ugrpo1jt 8d204dfa-d423-4402-a9b0-44502be77d8d -- POST / 200 616.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,333 mnist_classifier_MNISTClassifier ugrpo1jt a403e014-bbb6-4eae-9700-1554b4154d9c -- POST / 200 617.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,333 mnist_classifier_MNISTClassifier ugrpo1jt 4f58088d-f9fa-4b59-9dc8-99da31d8bd7f -- POST / 200 617.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,334 mnist_classifier_MNISTClassifier ugrpo1jt 59e20027-5cbe-4a56-9355-8f58b45f26b3 -- POST / 200 617.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,335 mnist_classifier_MNISTClassifier ugrpo1jt 48a10519-037b-4191-95e9-dc9f2ec76ae6 -- POST / 200 480.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,336 mnist_classifier_MNISTClassifier ugrpo1jt bac0a63b-adf4-4666-a44f-190000da78f4 -- POST / 200 615.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,336 mnist_classifier_MNISTClassifier ugrpo1jt 880a892a-6568-4e0b-94e5-00924c9591d1 -- POST / 200 618.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,412 mnist_classifier_MNISTClassifier ugrpo1jt e35692ec-857f-4142-9e3f-23f060f5a387 -- POST / 200 692.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,416 mnist_classifier_MNISTClassifier ugrpo1jt 5916d601-4a24-477c-90bb-02881ffd5a55 -- POST / 200 560.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,419 mnist_classifier_MNISTClassifier ugrpo1jt da36eb6c-ec11-43eb-ab56-e8acf77bdacc -- POST / 200 697.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,419 mnist_classifier_MNISTClassifier ugrpo1jt d5e28b7a-dcb7-4c4c-970a-19e5ec7bafa4 -- POST / 200 696.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,422 mnist_classifier_MNISTClassifier ugrpo1jt 40370d38-0d16-4eba-bea5-674d5deec0bb -- POST / 200 697.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,422 mnist_classifier_MNISTClassifier ugrpo1jt 057c5336-175f-4481-a998-cbc508f379f9 -- POST / 200 573.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,423 mnist_classifier_MNISTClassifier ugrpo1jt a330ab8c-b195-41d8-b7fe-2640d52dcc4c -- POST / 200 565.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,425 mnist_classifier_MNISTClassifier ugrpo1jt 0cd19b7a-0fee-4b27-9e28-6fdf01eb6a78 -- POST / 200 567.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,425 mnist_classifier_MNISTClassifier ugrpo1jt 1cb1360e-f7c3-408c-8b23-68ec638d0237 -- POST / 200 567.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,426 mnist_classifier_MNISTClassifier ugrpo1jt 9198c8df-177f-4cf4-956d-ab0e227d247e -- POST / 200 567.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,426 mnist_classifier_MNISTClassifier ugrpo1jt d5d1e85c-71cc-4bb1-8c3e-20d22b9e9683 -- POST / 200 566.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,430 mnist_classifier_MNISTClassifier ugrpo1jt f6f3ea75-3d24-43db-9f3d-d3c7f3ae7d36 -- POST / 200 569.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,431 mnist_classifier_MNISTClassifier ugrpo1jt 984e1253-1336-4382-8a97-da4399cb1344 -- POST / 200 569.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,431 mnist_classifier_MNISTClassifier ugrpo1jt 6d825d37-5bd9-441a-85b3-d135b1c820f7 -- POST / 200 569.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,432 mnist_classifier_MNISTClassifier ugrpo1jt a0edae9f-490a-4218-be5c-f89c13f0bbf7 -- POST / 200 569.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,435 mnist_classifier_MNISTClassifier ugrpo1jt 47c2e110-c5be-4578-a43b-eb4fc094bed1 -- POST / 200 572.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,444 mnist_classifier_MNISTClassifier ugrpo1jt cb981c67-cfc7-4b55-a264-c18400c8d0a0 -- POST / 200 579.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,448 mnist_classifier_MNISTClassifier ugrpo1jt a7da814d-bede-40a2-a3d5-955ef2916cd1 -- POST / 200 584.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,450 mnist_classifier_MNISTClassifier ugrpo1jt 4b3dcb3a-378c-4788-b246-38fa859469be -- POST / 200 584.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,451 mnist_classifier_MNISTClassifier ugrpo1jt 7402a7ac-28c1-4931-9823-70d284bcf416 -- POST / 200 586.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,451 mnist_classifier_MNISTClassifier ugrpo1jt 1c33732d-1bfc-4229-ad55-ad65822eb03d -- POST / 200 584.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,453 mnist_classifier_MNISTClassifier ugrpo1jt 29b97160-ffad-4dc1-8265-2498ea06a434 -- POST / 200 587.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,454 mnist_classifier_MNISTClassifier ugrpo1jt 98514904-e7d6-476a-bb33-6d05e6f4c170 -- POST / 200 587.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,455 mnist_classifier_MNISTClassifier ugrpo1jt 2cfce377-0ee3-46b8-876f-dc7cecbc04d1 -- POST / 200 587.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,457 mnist_classifier_MNISTClassifier ugrpo1jt 22370898-71d2-4405-97fd-30c0be3a085f -- POST / 200 588.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,457 mnist_classifier_MNISTClassifier ugrpo1jt 191eda7c-f5e5-488b-ae83-0ded33650a06 -- POST / 200 588.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,461 mnist_classifier_MNISTClassifier ugrpo1jt 28b9eff1-0668-4152-9593-457bbe8c08ed -- POST / 200 590.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,468 mnist_classifier_MNISTClassifier ugrpo1jt f08be5ef-5d82-4ee1-897d-2c1f4c2cf0c1 -- POST / 200 596.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,469 mnist_classifier_MNISTClassifier ugrpo1jt 7c0f91f9-3f71-412c-bd4b-559b1263a553 -- POST / 200 596.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,470 mnist_classifier_MNISTClassifier ugrpo1jt ffc179fc-eb2f-4835-8568-f22f37aaf443 -- POST / 200 596.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,470 mnist_classifier_MNISTClassifier ugrpo1jt c2d68352-3bc7-4a49-87ac-cf88458513d9 -- POST / 200 596.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,476 mnist_classifier_MNISTClassifier ugrpo1jt d14ba372-9ef5-4d2e-ab75-c556adbc4465 -- POST / 200 601.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,480 mnist_classifier_MNISTClassifier ugrpo1jt 0350607b-fd13-4f5b-bcb2-f8eaff2587a2 -- POST / 200 603.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,481 mnist_classifier_MNISTClassifier ugrpo1jt d436b535-9b82-4b2b-9bf0-e88b49d6ceec -- POST / 200 605.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,482 mnist_classifier_MNISTClassifier ugrpo1jt 54386f18-4088-4b67-b5cd-127ffbfac216 -- POST / 200 606.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,482 mnist_classifier_MNISTClassifier ugrpo1jt 19f5b28c-5b44-417d-af8c-55f122b63169 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,483 mnist_classifier_MNISTClassifier ugrpo1jt cb8c7a59-fa02-454e-a139-2171dfd57df7 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,483 mnist_classifier_MNISTClassifier ugrpo1jt 2a85a865-a9bb-42c3-8686-61a6985c1dd6 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,483 mnist_classifier_MNISTClassifier ugrpo1jt c02d64f4-6951-4393-91c7-c527a5aecf4e -- POST / 200 288.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,484 mnist_classifier_MNISTClassifier ugrpo1jt 76bc021c-fbb5-479f-9fbf-9ac5dd1f75c1 -- POST / 200 296.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,484 mnist_classifier_MNISTClassifier ugrpo1jt 8e211a6b-be7c-46a4-b4d6-7c8112ba4937 -- POST / 200 286.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,485 mnist_classifier_MNISTClassifier ugrpo1jt ae6389af-4911-4833-ad59-7ecaa5fa1f64 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,485 mnist_classifier_MNISTClassifier ugrpo1jt 2ada5d5c-ffc4-48c4-8d3c-e79bfd183e39 -- POST / 200 286.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,485 mnist_classifier_MNISTClassifier ugrpo1jt 0e681350-87e6-46bf-88fe-1af21026d2b5 -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,486 mnist_classifier_MNISTClassifier ugrpo1jt 43f4bedb-ae23-44c8-9e48-6c8dc79ff46a -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,486 mnist_classifier_MNISTClassifier ugrpo1jt 383e5129-d771-4290-a217-3242adf0f5b7 -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,486 mnist_classifier_MNISTClassifier ugrpo1jt cd2b3ab6-3855-4a27-9ca6-1106ce1d5ceb -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,486 mnist_classifier_MNISTClassifier ugrpo1jt 13d60f54-ba84-49ef-82f1-ee78b7320c4e -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,487 mnist_classifier_MNISTClassifier ugrpo1jt 9d2b018b-3e87-4535-a638-66e1e265bbdf -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,487 mnist_classifier_MNISTClassifier ugrpo1jt 10f1ed7e-5204-44ea-b1ca-1e1efc7f1a55 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,487 mnist_classifier_MNISTClassifier ugrpo1jt e6e04162-dab4-4e0e-9f5f-977061872635 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,487 mnist_classifier_MNISTClassifier ugrpo1jt d54dd51c-842e-421a-b916-1f8614375daa -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,487 mnist_classifier_MNISTClassifier ugrpo1jt 3e01ebe1-7a56-4cee-8480-d025a063109d -- POST / 200 270.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,487 mnist_classifier_MNISTClassifier ugrpo1jt 59b8f594-e8c1-47a6-b20e-64224823ea2a -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,488 mnist_classifier_MNISTClassifier ugrpo1jt 11c4198c-6680-4af1-98e7-719d5babe9a4 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,488 mnist_classifier_MNISTClassifier ugrpo1jt 404ca7a5-5115-492f-9c36-e439ad9d1edc -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,488 mnist_classifier_MNISTClassifier ugrpo1jt f41b2e45-5b01-45f9-84ff-a536d7d8a9ac -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,488 mnist_classifier_MNISTClassifier ugrpo1jt 2ee7ce9a-f814-4048-a46c-59ff9b3c6061 -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,560 mnist_classifier_MNISTClassifier ugrpo1jt 2e30f3a7-bb99-4750-8c6e-4f65a662c192 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,582 mnist_classifier_MNISTClassifier ugrpo1jt 9b878927-a556-4e1b-b6bc-98eae1f20d5c -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,584 mnist_classifier_MNISTClassifier ugrpo1jt a89b34f0-ba71-46aa-91b9-ae4e7419bbc4 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,586 mnist_classifier_MNISTClassifier ugrpo1jt 70e09350-689a-4e26-a8c0-d8e7be6dd6e6 -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,586 mnist_classifier_MNISTClassifier ugrpo1jt 56033ee4-1a31-4282-bde0-4d28e3609d86 -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,586 mnist_classifier_MNISTClassifier ugrpo1jt 1fccbce3-9f88-41ce-8633-0c297eae46fd -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,586 mnist_classifier_MNISTClassifier ugrpo1jt 3c91ac55-ab39-4b6c-a124-9d626f04a20e -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,587 mnist_classifier_MNISTClassifier ugrpo1jt abd90c01-1908-42eb-b440-9c0df9b0d893 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,588 mnist_classifier_MNISTClassifier ugrpo1jt 833f8f19-d8cd-427c-96cd-df59d2507288 -- POST / 200 245.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,588 mnist_classifier_MNISTClassifier ugrpo1jt e607fa73-2492-43d7-96a1-76324df2dcf9 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,588 mnist_classifier_MNISTClassifier ugrpo1jt 3b1aeb86-94f5-4f76-ae23-8adb3f453d0a -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,589 mnist_classifier_MNISTClassifier ugrpo1jt 017010b0-513e-4fc5-ab0c-884f4196ae27 -- POST / 200 226.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,589 mnist_classifier_MNISTClassifier ugrpo1jt ee661873-4249-408d-a374-b0fcac7a7f20 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt 88ee0f12-a373-4f8d-b18e-2a906c0d0d4e -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt 1ec46917-2de8-4f15-8794-15235a43c2bb -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt 2a06d717-d009-4720-807e-413768395522 -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt a821bdb4-0829-4a38-910b-99c0b50e018c -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt c493a4d3-f645-49ce-8f61-d98e741be715 -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt 257ae335-93d0-47dd-8e49-e00c4c29bd66 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,590 mnist_classifier_MNISTClassifier ugrpo1jt 20a6c5eb-1074-4af6-a099-909730f7416c -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt 595b0ac4-3fbc-4b5c-bfd7-1f16dbac12be -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt fa18b29e-395d-42fd-b1b5-e9e3911cf4bf -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt 9d88d241-d4e5-4a26-9397-e977d4e2b3e3 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt d1c52f3e-86b4-45ac-a7a2-be5dcc1a7500 -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt 5b368547-efdd-4102-8923-f0b959c57f3c -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt 1307b7f5-52ae-497e-833c-c162861a145f -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,591 mnist_classifier_MNISTClassifier ugrpo1jt 4c8f5d5a-fead-4191-a4d1-b82294b28888 -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt 98fde67c-d99b-4d43-b239-c3ae61b3b688 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt bbbb0c93-92c4-49cd-a66c-6dd0934a5427 -- POST / 200 217.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt c480530f-84c2-4179-a2f1-91379e461e1e -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt 3ec00c27-e681-4773-92fc-c22502d17e8f -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt 96711f60-8f98-45c9-87b7-60c00a8924e7 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt 16cc44ce-62c3-450e-bd09-f1b86194c0ae -- POST / 200 207.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt 4cd40db8-4e4f-4d84-8ee5-4dede086ec29 -- POST / 200 211.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,592 mnist_classifier_MNISTClassifier ugrpo1jt 073d3d0f-9e79-47d2-9334-2ccfd7b7737b -- POST / 200 207.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,593 mnist_classifier_MNISTClassifier ugrpo1jt 6f0be0bb-97a0-4265-9b44-2b039c2fb266 -- POST / 200 200.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,593 mnist_classifier_MNISTClassifier ugrpo1jt c9ce1503-f776-4013-9f9b-b4e52baa02a2 -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,593 mnist_classifier_MNISTClassifier ugrpo1jt 40c5f6bb-1596-4ffb-bb0e-e85a4d11f4fb -- POST / 200 185.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,593 mnist_classifier_MNISTClassifier ugrpo1jt 1581d39a-cb50-4187-aa94-c2e20ea24410 -- POST / 200 185.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,594 mnist_classifier_MNISTClassifier ugrpo1jt 8606180d-b41a-4ec1-b7bb-81db8c02fab7 -- POST / 200 185.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,594 mnist_classifier_MNISTClassifier ugrpo1jt 06e6a3da-5968-44a2-a009-65edc078a4b6 -- POST / 200 182.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,595 mnist_classifier_MNISTClassifier ugrpo1jt 5289fc53-0a82-41af-a21c-375ae2169148 -- POST / 200 175.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,595 mnist_classifier_MNISTClassifier ugrpo1jt 971ee7e9-00d3-455f-9cde-e526b7e79182 -- POST / 200 165.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,595 mnist_classifier_MNISTClassifier ugrpo1jt b5b14090-7944-473d-993d-0f6c7788edc0 -- POST / 200 163.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,596 mnist_classifier_MNISTClassifier ugrpo1jt 4d03818f-b56d-4690-9a37-fa5b0e85dfb3 -- POST / 200 160.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,716 mnist_classifier_MNISTClassifier ugrpo1jt d2842359-ba6e-4e90-b706-164dde6064cf -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,718 mnist_classifier_MNISTClassifier ugrpo1jt e5406156-910c-44d2-9aeb-03c3a0fe3bcc -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,718 mnist_classifier_MNISTClassifier ugrpo1jt 78397eaf-21a7-49e0-8fb0-9770866a294a -- POST / 200 267.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,719 mnist_classifier_MNISTClassifier ugrpo1jt c3ad53c7-a08e-424c-bd8a-71467743c9f4 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,719 mnist_classifier_MNISTClassifier ugrpo1jt 425ae4eb-03ca-4687-9da5-bdf337172c8b -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,720 mnist_classifier_MNISTClassifier ugrpo1jt 54c43666-462d-43f9-938d-5c0b76c959d0 -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,721 mnist_classifier_MNISTClassifier ugrpo1jt 3ff9deae-fd4f-41a8-9bbd-09b6222a54c1 -- POST / 200 232.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,723 mnist_classifier_MNISTClassifier ugrpo1jt 3d463787-4521-4291-87d5-2be04b2257fa -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,724 mnist_classifier_MNISTClassifier ugrpo1jt 01bbf3d0-bdd4-4f64-984f-08562ec8b42c -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,725 mnist_classifier_MNISTClassifier ugrpo1jt 6c64eb02-b38d-43ad-a6c6-257905dd7063 -- POST / 200 232.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,726 mnist_classifier_MNISTClassifier ugrpo1jt 0b314288-cc70-4ad0-babe-b02f87b1ad85 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,727 mnist_classifier_MNISTClassifier ugrpo1jt 25c9a33d-36fd-4658-b755-21d7c838bf3f -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,731 mnist_classifier_MNISTClassifier ugrpo1jt 3e4527a9-2109-4d22-8f33-6a3bbe23305a -- POST / 200 232.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,731 mnist_classifier_MNISTClassifier ugrpo1jt 9438cf08-b750-4451-87bf-5f07b089dcc1 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,733 mnist_classifier_MNISTClassifier ugrpo1jt 88c28e03-0945-4389-866a-c4f4186f1ec9 -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,736 mnist_classifier_MNISTClassifier ugrpo1jt 16ef6465-257b-4d3f-8df1-2daf7c5f82b1 -- POST / 200 199.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,736 mnist_classifier_MNISTClassifier ugrpo1jt ae8f56ee-ef2e-47f1-8a57-180cc8b6696e -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,739 mnist_classifier_MNISTClassifier ugrpo1jt 13790b81-ff34-4f29-bf5a-b54b186fab5d -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,740 mnist_classifier_MNISTClassifier ugrpo1jt 6f5ae613-7056-4a15-8301-cacdcd40c99a -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,741 mnist_classifier_MNISTClassifier ugrpo1jt 6786cff4-125d-4ed5-8e58-78a66d992364 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,742 mnist_classifier_MNISTClassifier ugrpo1jt 387a81fa-7a4d-47f1-9108-895f07d69f10 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,747 mnist_classifier_MNISTClassifier ugrpo1jt e3971954-e380-4e00-b26e-bb15343e41fb -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,748 mnist_classifier_MNISTClassifier ugrpo1jt 7ee81bc2-9384-47e1-8d32-48cd05730bae -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,749 mnist_classifier_MNISTClassifier ugrpo1jt a552e2f7-18ac-42db-9f3d-cafe6d9d13e7 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,759 mnist_classifier_MNISTClassifier ugrpo1jt 7cd60d36-7f8f-4c4e-b0c1-f25f35539f89 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,763 mnist_classifier_MNISTClassifier ugrpo1jt 2d95b432-8b1e-4f2b-8f5b-3677cd882222 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,764 mnist_classifier_MNISTClassifier ugrpo1jt c5662dfb-3784-4013-994f-32ffca70a919 -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,767 mnist_classifier_MNISTClassifier ugrpo1jt 9467a5ce-4e14-4a83-81ba-642012fea4e6 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,774 mnist_classifier_MNISTClassifier ugrpo1jt a5322edf-6599-4753-98de-194127452f28 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,775 mnist_classifier_MNISTClassifier ugrpo1jt 73a0c647-adb1-4762-9067-aaeed498fa92 -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,775 mnist_classifier_MNISTClassifier ugrpo1jt 2c75af68-3448-4980-886e-82cc5c9d98fb -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,777 mnist_classifier_MNISTClassifier ugrpo1jt 8c349fd3-0589-4c16-9dbc-972905c4ba3e -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,778 mnist_classifier_MNISTClassifier ugrpo1jt 870ab663-18a9-44ab-b91c-cb2b29707448 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,779 mnist_classifier_MNISTClassifier ugrpo1jt 293baf0c-b355-40ef-bbd2-9d475d6f1097 -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,779 mnist_classifier_MNISTClassifier ugrpo1jt 39b67664-d359-42d7-acdc-05a706b2fa21 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,779 mnist_classifier_MNISTClassifier ugrpo1jt 756586ef-83d2-4192-866f-1a16546bdcf1 -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,779 mnist_classifier_MNISTClassifier ugrpo1jt 1104c876-861d-4967-b523-a3ce8f132fc9 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:28:59,780 mnist_classifier_MNISTClassifier ugrpo1jt c109e914-0c00-4f50-a18d-41a685995b69 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,030 mnist_classifier_MNISTClassifier ugrpo1jt 03eec2dc-3b53-46f8-8890-51077d31ea4e -- POST / 200 482.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,031 mnist_classifier_MNISTClassifier ugrpo1jt 2dae4892-804f-4153-842a-5733a54bcc8d -- POST / 200 483.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,032 mnist_classifier_MNISTClassifier ugrpo1jt 9a3e75c7-c9db-496f-b16f-fda1535f52ff -- POST / 200 451.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,033 mnist_classifier_MNISTClassifier ugrpo1jt b54e0000-df9c-43aa-80ae-ffc98042ee84 -- POST / 200 452.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,033 mnist_classifier_MNISTClassifier ugrpo1jt e1e9e384-0871-4eb6-9df0-8dbff5bf91d4 -- POST / 200 452.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,034 mnist_classifier_MNISTClassifier ugrpo1jt 663dd1d7-b487-4d5a-b3ec-44d7858c6148 -- POST / 200 453.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,034 mnist_classifier_MNISTClassifier ugrpo1jt 13fb0d2c-5420-4904-b909-f9e72196dfb4 -- POST / 200 437.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,035 mnist_classifier_MNISTClassifier ugrpo1jt f32ab4cf-ab89-442e-add4-55f9c2aa0420 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,035 mnist_classifier_MNISTClassifier ugrpo1jt 9a8c7e75-77d6-4236-9781-203f84d47f9c -- POST / 200 438.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,037 mnist_classifier_MNISTClassifier ugrpo1jt 5f9d0d01-033f-48b3-a78f-87986d4cc612 -- POST / 200 439.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,039 mnist_classifier_MNISTClassifier ugrpo1jt 3607403e-73e4-4821-b5ad-880f29f70abf -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,039 mnist_classifier_MNISTClassifier ugrpo1jt 33dbb044-c38a-4e36-bce6-437171c9651c -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,040 mnist_classifier_MNISTClassifier ugrpo1jt ca490821-d99d-4cc4-a4f5-99532aed34de -- POST / 200 440.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,040 mnist_classifier_MNISTClassifier ugrpo1jt e9bbbc70-1931-4651-9342-bf79dfc42dda -- POST / 200 441.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,041 mnist_classifier_MNISTClassifier ugrpo1jt 3111afd0-08f8-40bc-a21a-62f75730c445 -- POST / 200 441.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,041 mnist_classifier_MNISTClassifier ugrpo1jt 770943fe-a160-4c03-9d0d-83f6d06d78c3 -- POST / 200 441.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,041 mnist_classifier_MNISTClassifier ugrpo1jt c60207d5-eab5-4ff1-8f91-73a47cfa1ce3 -- POST / 200 409.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,042 mnist_classifier_MNISTClassifier ugrpo1jt 00610d5e-18d6-4f3b-bf4b-7964e64fa08e -- POST / 200 442.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,042 mnist_classifier_MNISTClassifier ugrpo1jt 90bca228-adbf-4590-9324-bf5a854b6be7 -- POST / 200 410.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,042 mnist_classifier_MNISTClassifier ugrpo1jt 74c26f3d-a039-4072-80e3-1bc3c8007f6c -- POST / 200 409.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,042 mnist_classifier_MNISTClassifier ugrpo1jt 54f739dc-2ed6-47a6-aae0-a1c199879716 -- POST / 200 409.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,043 mnist_classifier_MNISTClassifier ugrpo1jt a71b6abf-be9e-4541-8615-77ab4928792f -- POST / 200 408.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,044 mnist_classifier_MNISTClassifier ugrpo1jt 03fb2ad2-820c-4388-b98b-3f4f65731b20 -- POST / 200 408.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,044 mnist_classifier_MNISTClassifier ugrpo1jt 9077ec2e-54ab-493b-9368-a103fae4c05f -- POST / 200 402.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,044 mnist_classifier_MNISTClassifier ugrpo1jt a83510e4-a3d3-4b65-b8a0-c6d870671d24 -- POST / 200 408.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,044 mnist_classifier_MNISTClassifier ugrpo1jt cf718dff-3de2-42ca-8b86-0b7cf22760c1 -- POST / 200 408.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,045 mnist_classifier_MNISTClassifier ugrpo1jt ba709ed0-d1f2-4247-adaa-253d3d0b0360 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,045 mnist_classifier_MNISTClassifier ugrpo1jt 38fc7942-ccb3-4643-b3a2-f491597a4cfe -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,046 mnist_classifier_MNISTClassifier ugrpo1jt 498acdd7-908b-4058-81fc-2fc90301d9b9 -- POST / 200 402.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,046 mnist_classifier_MNISTClassifier ugrpo1jt bb2d78d6-65b5-46f7-adb1-b97f135ec268 -- POST / 200 403.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,046 mnist_classifier_MNISTClassifier ugrpo1jt 8c58a12a-ac15-416a-9a30-7d2bcf9201c8 -- POST / 200 403.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,046 mnist_classifier_MNISTClassifier ugrpo1jt 9b14e736-b778-46a8-96fd-e9d1575a1e89 -- POST / 200 394.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,047 mnist_classifier_MNISTClassifier ugrpo1jt bddbb9cc-7c52-4970-9eba-4de05ec93b09 -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,047 mnist_classifier_MNISTClassifier ugrpo1jt 14ae1721-d8e1-455d-a747-ba7a3f3da0c9 -- POST / 200 399.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,048 mnist_classifier_MNISTClassifier ugrpo1jt e5602a23-df4f-4d10-b8c7-842cb12764b4 -- POST / 200 399.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,048 mnist_classifier_MNISTClassifier ugrpo1jt 14228434-cac8-40e7-ae52-f18eae527272 -- POST / 200 378.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,049 mnist_classifier_MNISTClassifier ugrpo1jt d5c2d078-6725-406b-b0d7-150040f497ea -- POST / 200 374.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,049 mnist_classifier_MNISTClassifier ugrpo1jt f0c623ea-7d1c-4936-b02d-6aeae856d688 -- POST / 200 373.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,050 mnist_classifier_MNISTClassifier ugrpo1jt b268a025-6dd1-481d-aea0-8e1822ea292f -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,051 mnist_classifier_MNISTClassifier ugrpo1jt 96f7ffaa-7c93-4599-80c5-0b4891fda37e -- POST / 200 373.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,054 mnist_classifier_MNISTClassifier ugrpo1jt f02432fc-9bf9-48c8-9735-2b6f9e92933e -- POST / 200 375.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,145 mnist_classifier_MNISTClassifier ugrpo1jt bf79808c-3207-4404-99ff-e374c31f4a12 -- POST / 200 460.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,147 mnist_classifier_MNISTClassifier ugrpo1jt f299bd5f-aec0-4f50-bab2-e38fd63a484b -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,148 mnist_classifier_MNISTClassifier ugrpo1jt 683bd201-a9f9-45b5-9640-ddf32aa92789 -- POST / 200 460.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,148 mnist_classifier_MNISTClassifier ugrpo1jt 88f4dd5b-971d-4712-824d-d80834c98828 -- POST / 200 461.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,149 mnist_classifier_MNISTClassifier ugrpo1jt 8ee51e33-f277-46d9-a0c7-f7699c810882 -- POST / 200 461.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,149 mnist_classifier_MNISTClassifier ugrpo1jt 53023cfd-7c3c-4849-ab89-9b46cabe96b3 -- POST / 200 459.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,149 mnist_classifier_MNISTClassifier ugrpo1jt 52d93b17-328a-485a-a50f-e60ce72fe864 -- POST / 200 461.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,150 mnist_classifier_MNISTClassifier ugrpo1jt c0f6b6ea-939a-4ad8-b431-80b264aa5cb8 -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,152 mnist_classifier_MNISTClassifier ugrpo1jt e1ea373e-cf53-4f24-8763-854ccc57de38 -- POST / 200 464.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,152 mnist_classifier_MNISTClassifier ugrpo1jt 95cc03b2-6844-4856-acf5-85a3b473d66e -- POST / 200 464.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,153 mnist_classifier_MNISTClassifier ugrpo1jt 418f470f-c133-4fd9-9032-643bf21acff6 -- POST / 200 464.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,154 mnist_classifier_MNISTClassifier ugrpo1jt 76e44265-b18a-4651-b28c-bca79bbb98d8 -- POST / 200 465.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,154 mnist_classifier_MNISTClassifier ugrpo1jt f597639c-e3ad-441b-97d1-c6d3b5b79587 -- POST / 200 465.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,162 mnist_classifier_MNISTClassifier ugrpo1jt c1900410-87b1-4102-88ff-12ba4dbbb89d -- POST / 200 472.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,163 mnist_classifier_MNISTClassifier ugrpo1jt c652907e-52d4-49d9-ae79-6fe0ae2cccb9 -- POST / 200 474.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,165 mnist_classifier_MNISTClassifier ugrpo1jt 5acb8e5c-0081-4a1d-ac1b-363c9b87593b -- POST / 200 476.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,167 mnist_classifier_MNISTClassifier ugrpo1jt fab3dfe1-4fb0-42b5-9f7a-cb802bec8ab1 -- POST / 200 477.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,167 mnist_classifier_MNISTClassifier ugrpo1jt c164be69-e838-47a7-85fa-10aef141a904 -- POST / 200 476.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,168 mnist_classifier_MNISTClassifier ugrpo1jt beda1cdf-afa9-45e4-bbbd-5c2b30a52da4 -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,168 mnist_classifier_MNISTClassifier ugrpo1jt 072e0de5-f77b-46db-aecf-df8381999a60 -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,168 mnist_classifier_MNISTClassifier ugrpo1jt 5d7a09ab-565f-40d3-81dd-b5c9b197937d -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,169 mnist_classifier_MNISTClassifier ugrpo1jt e0a5627e-a7bf-44b8-81ee-ff9a03b245dc -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,169 mnist_classifier_MNISTClassifier ugrpo1jt c500e977-0cad-4d88-bf9a-626336102b3d -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,177 mnist_classifier_MNISTClassifier ugrpo1jt fdc46ad4-90f3-4bf0-92a6-48f00a1bbdc3 -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,177 mnist_classifier_MNISTClassifier ugrpo1jt c3ac8bac-fcb1-4d6e-b876-1f5c757b7f68 -- POST / 200 403.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,178 mnist_classifier_MNISTClassifier ugrpo1jt af3ab053-c673-4ad2-ab18-8383bc64a5f9 -- POST / 200 397.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,179 mnist_classifier_MNISTClassifier ugrpo1jt 3e35a032-1b7b-44e1-b64d-efcd9ec7ebf5 -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,180 mnist_classifier_MNISTClassifier ugrpo1jt 57c3f219-eec3-4bb9-9c68-f69b10d92237 -- POST / 200 391.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,180 mnist_classifier_MNISTClassifier ugrpo1jt 3a9684c1-dc44-45d7-817c-688723e06316 -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,180 mnist_classifier_MNISTClassifier ugrpo1jt 3372879b-bab4-4680-ae5d-b79843eeab1e -- POST / 200 389.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,182 mnist_classifier_MNISTClassifier ugrpo1jt 6b99402d-06a6-467b-8610-4556d2a5bc71 -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,184 mnist_classifier_MNISTClassifier ugrpo1jt 5a108e0b-0abe-4596-b456-a0bc0fde28e1 -- POST / 200 394.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,185 mnist_classifier_MNISTClassifier ugrpo1jt b8d2bcee-206d-4f6f-adb3-25d11c57dc38 -- POST / 200 391.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,187 mnist_classifier_MNISTClassifier ugrpo1jt 60da430f-4135-42c6-be49-22d51ef0d627 -- POST / 200 392.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,189 mnist_classifier_MNISTClassifier ugrpo1jt 92e2e0d4-e351-4509-9571-d5897bd0fcb0 -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,194 mnist_classifier_MNISTClassifier ugrpo1jt fc18e60d-5499-493e-8d3a-0e70a32e082c -- POST / 200 398.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,195 mnist_classifier_MNISTClassifier ugrpo1jt 12418d87-0436-41f5-9fca-2d437a53d63d -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,195 mnist_classifier_MNISTClassifier ugrpo1jt 660834f1-6157-4c5a-b86e-c6f477ba5d2e -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,195 mnist_classifier_MNISTClassifier ugrpo1jt 1308a575-0b6f-4886-96dc-98b4f0bf4ea4 -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,196 mnist_classifier_MNISTClassifier ugrpo1jt e2cf7ce9-da9f-478b-b7fd-db02f3dd647f -- POST / 200 391.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,196 mnist_classifier_MNISTClassifier ugrpo1jt bc0452f9-7b4a-41ed-9c5a-caaa2ec60d0e -- POST / 200 391.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,196 mnist_classifier_MNISTClassifier ugrpo1jt b743cb78-9318-44a9-a59b-c8f778ab6d59 -- POST / 200 388.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,196 mnist_classifier_MNISTClassifier ugrpo1jt dcaaf64f-bc4d-4316-9bf3-5764b8d08ac1 -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,197 mnist_classifier_MNISTClassifier ugrpo1jt d3bb4930-95da-4902-a0a0-b2f9452ec574 -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,198 mnist_classifier_MNISTClassifier ugrpo1jt ee0ecadf-1968-408c-9b06-eeeb1b467b02 -- POST / 200 387.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,200 mnist_classifier_MNISTClassifier ugrpo1jt 43b44adb-d370-41d2-8600-008d74b35ec0 -- POST / 200 388.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,200 mnist_classifier_MNISTClassifier ugrpo1jt b10143db-2bda-42bd-86b4-4e2c77763ae1 -- POST / 200 388.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,202 mnist_classifier_MNISTClassifier ugrpo1jt c34ed4a4-19ad-4653-92ea-22aef1f4943f -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,203 mnist_classifier_MNISTClassifier ugrpo1jt fbc297bf-b163-4fe9-aee4-b683859922a7 -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,203 mnist_classifier_MNISTClassifier ugrpo1jt e3a81aad-25b9-4d95-9515-aa756bf7880b -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,204 mnist_classifier_MNISTClassifier ugrpo1jt 351d42df-e731-4127-b1aa-fae7ed564674 -- POST / 200 388.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,205 mnist_classifier_MNISTClassifier ugrpo1jt b742cbaa-5fbc-4243-9ea9-0354aee073dd -- POST / 200 388.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,205 mnist_classifier_MNISTClassifier ugrpo1jt 698c4821-ef8f-411a-9535-07483d7a5733 -- POST / 200 388.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,212 mnist_classifier_MNISTClassifier ugrpo1jt c71e25ea-3a08-40ae-872c-85bf5e40005e -- POST / 200 393.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,217 mnist_classifier_MNISTClassifier ugrpo1jt f18e90c6-1e39-43eb-a96f-eaeef1c281ff -- POST / 200 399.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,218 mnist_classifier_MNISTClassifier ugrpo1jt f3a89858-d258-487b-aecb-b6616e558364 -- POST / 200 398.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,218 mnist_classifier_MNISTClassifier ugrpo1jt 94a035dd-eac4-4238-b0b7-b97f86d4fcd1 -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,218 mnist_classifier_MNISTClassifier ugrpo1jt be2e1d1f-ca82-4de8-8781-840124c3bd07 -- POST / 200 397.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,218 mnist_classifier_MNISTClassifier ugrpo1jt 918c3d60-8e44-432a-a353-384392d3f829 -- POST / 200 397.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,288 mnist_classifier_MNISTClassifier ugrpo1jt b10a6da4-8e76-4ac7-8b74-9e04d4eba918 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,301 mnist_classifier_MNISTClassifier ugrpo1jt ae9a8376-669e-4248-9030-6de11711a79f -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,304 mnist_classifier_MNISTClassifier ugrpo1jt 8d4c5bfc-e722-4fc9-9f2d-0b91dd291ef5 -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,304 mnist_classifier_MNISTClassifier ugrpo1jt 6087e135-c0f5-44e0-bb2b-206e8327878e -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,305 mnist_classifier_MNISTClassifier ugrpo1jt 9fce1ef7-aa26-4c8e-a942-ee1e6a48f915 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,306 mnist_classifier_MNISTClassifier ugrpo1jt 979130a6-84d1-434d-8e72-cb6d4d94f7cc -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,307 mnist_classifier_MNISTClassifier ugrpo1jt 4c8653fa-c4c0-4eee-8035-e8b3e5059b1b -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,307 mnist_classifier_MNISTClassifier ugrpo1jt 15f88e33-ffce-41f5-b3c3-66e9ef0489e3 -- POST / 200 247.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,310 mnist_classifier_MNISTClassifier ugrpo1jt ade55fe2-0890-49af-ab2f-20f36583c0f4 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,312 mnist_classifier_MNISTClassifier ugrpo1jt 7b90beb1-7a1d-4f86-abed-98deae8d2869 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,312 mnist_classifier_MNISTClassifier ugrpo1jt 3eef34f7-8303-4e1a-bc75-e7018819c1f4 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,312 mnist_classifier_MNISTClassifier ugrpo1jt 9ac92244-2d81-4b38-9c66-3c3084d799bf -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,312 mnist_classifier_MNISTClassifier ugrpo1jt 4f690b11-3b77-4896-a160-e6dc41b9aefe -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,312 mnist_classifier_MNISTClassifier ugrpo1jt bfd5eaa0-aaa3-41d4-bfb5-9132c3941ef9 -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,312 mnist_classifier_MNISTClassifier ugrpo1jt 0066810d-578a-4189-9867-0a0adbbea9b2 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt b70ed1c2-bfee-45f5-ac74-f0381612549b -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt 5dd7cdc2-5fe3-44c3-b67d-70c71d31fc39 -- POST / 200 221.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt 39451b5e-f2d8-4e00-aa0b-98e826500158 -- POST / 200 216.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt 1005b10a-5440-4ba8-add9-2f47bf46e811 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt 7e17b7fe-3e19-4c45-bf47-cc88d6c3675b -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt acd39962-44bf-4ba7-9005-60d802f776a3 -- POST / 200 218.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,313 mnist_classifier_MNISTClassifier ugrpo1jt 5ca85af4-4055-4a13-9511-b6f2c83c77a8 -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt 348074e0-68a9-48f4-8405-9672c2acef1d -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt 949e57cc-7821-469a-bb8e-197d86d9c67e -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt d9e8ac22-6016-46f1-8932-735086ab8968 -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt 5171085c-99f7-48a7-a7c9-658d4b9d413b -- POST / 200 214.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt 019fc281-4013-46c9-af69-9b5be5b38a26 -- POST / 200 214.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt dab5d95f-1f5a-4584-8a7b-eab2599083ae -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,314 mnist_classifier_MNISTClassifier ugrpo1jt f1247e92-5415-4ede-9bfc-9ef5f3c134da -- POST / 200 213.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,435 mnist_classifier_MNISTClassifier ugrpo1jt 8df0bfb9-9d1d-4c62-8b5c-066c7e3aa321 -- POST / 200 333.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,437 mnist_classifier_MNISTClassifier ugrpo1jt fe5e2265-fa01-414e-9d44-1e8be0007fdc -- POST / 200 334.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,437 mnist_classifier_MNISTClassifier ugrpo1jt bb8ffed8-4904-4e99-8aea-66d2e58636a3 -- POST / 200 332.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,441 mnist_classifier_MNISTClassifier ugrpo1jt 52f4ad78-5196-4a13-a483-d493061f7e2c -- POST / 200 335.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,441 mnist_classifier_MNISTClassifier ugrpo1jt 488bf8f5-1005-414a-9278-b6cd2468a758 -- POST / 200 335.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,442 mnist_classifier_MNISTClassifier ugrpo1jt dfdca03d-b9c6-4327-a688-55e1f84868e2 -- POST / 200 334.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,443 mnist_classifier_MNISTClassifier ugrpo1jt 1f21a698-fefa-46bd-a722-bffbe40d7955 -- POST / 200 334.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,445 mnist_classifier_MNISTClassifier ugrpo1jt 2c9e5cf2-57cc-4dca-9dc4-5f14822b135e -- POST / 200 336.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,449 mnist_classifier_MNISTClassifier ugrpo1jt efada091-93b5-490c-83d7-b5194f40b749 -- POST / 200 329.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,451 mnist_classifier_MNISTClassifier ugrpo1jt ec48e1c4-ca59-4603-886b-cb64a0c2ae06 -- POST / 200 330.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,452 mnist_classifier_MNISTClassifier ugrpo1jt 6d006291-d308-4e0b-818f-19f82627ea3a -- POST / 200 329.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,452 mnist_classifier_MNISTClassifier ugrpo1jt 837c652d-2fa3-42c2-9df6-0d8591d006b0 -- POST / 200 329.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,453 mnist_classifier_MNISTClassifier ugrpo1jt 51f4b95b-5927-49f3-b24b-03c07a1267f7 -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,453 mnist_classifier_MNISTClassifier ugrpo1jt d1db752d-4315-453c-a731-bd50ee211c8f -- POST / 200 308.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,454 mnist_classifier_MNISTClassifier ugrpo1jt fb2017dc-00a7-41a1-b2aa-3f3ff04d3472 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,455 mnist_classifier_MNISTClassifier ugrpo1jt c2e8bdfc-6f8d-4219-8b52-c451a24182f2 -- POST / 200 278.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,455 mnist_classifier_MNISTClassifier ugrpo1jt 459eff25-a4af-401e-8f0e-6833b0aebe9b -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,456 mnist_classifier_MNISTClassifier ugrpo1jt 9a1dc97b-5605-4e7f-bfcf-e52f6e29b262 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,457 mnist_classifier_MNISTClassifier ugrpo1jt e959cd83-71ca-4027-a9b8-06bacbe512d3 -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,458 mnist_classifier_MNISTClassifier ugrpo1jt 8ad1698a-09f3-4681-af99-33edc8ef1a04 -- POST / 200 235.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,459 mnist_classifier_MNISTClassifier ugrpo1jt 1d0f3cea-240c-463a-a302-7435a94dc7b3 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,459 mnist_classifier_MNISTClassifier ugrpo1jt 1bc8018d-e835-4546-bd45-b8c6a23cd098 -- POST / 200 235.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,460 mnist_classifier_MNISTClassifier ugrpo1jt 5f766e7f-5cec-4484-ab4c-46eaa5e7e978 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,461 mnist_classifier_MNISTClassifier ugrpo1jt f4ac0273-ba89-42b7-a557-01a494764a3d -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,461 mnist_classifier_MNISTClassifier ugrpo1jt d270aedc-6c99-43d5-b3cb-65d92ab9b338 -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,462 mnist_classifier_MNISTClassifier ugrpo1jt b73f8ff5-426e-44cd-9daa-e07b8aa492c0 -- POST / 200 236.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,462 mnist_classifier_MNISTClassifier ugrpo1jt 8ea4f17b-129a-4dbd-8c77-7fb69597fcfe -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,463 mnist_classifier_MNISTClassifier ugrpo1jt e4e957dc-6b94-46eb-a644-942a91d3b656 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,464 mnist_classifier_MNISTClassifier ugrpo1jt e0d6343e-8414-458a-a34e-d7dda494cf5c -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,464 mnist_classifier_MNISTClassifier ugrpo1jt 8200d413-70da-4e4d-a5f7-120fe07f1e43 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,465 mnist_classifier_MNISTClassifier ugrpo1jt cb757759-ce97-428e-ab2e-8193a08e23d7 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,605 mnist_classifier_MNISTClassifier ugrpo1jt cfd414eb-e61a-4be2-93a1-b565d3288129 -- POST / 200 376.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,605 mnist_classifier_MNISTClassifier ugrpo1jt cf11f47f-b9b2-4807-ac3e-b7c922f59673 -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,606 mnist_classifier_MNISTClassifier ugrpo1jt 69aae014-65bf-401f-a6f7-9ea4ef99a6d4 -- POST / 200 371.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,606 mnist_classifier_MNISTClassifier ugrpo1jt 61acb076-67b1-4b6b-ab15-63ef3b209c71 -- POST / 200 376.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,606 mnist_classifier_MNISTClassifier ugrpo1jt 914a860f-967e-4320-9871-ffaba486f887 -- POST / 200 376.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,607 mnist_classifier_MNISTClassifier ugrpo1jt 626b4cdb-10b7-471b-bb99-113538bc8109 -- POST / 200 376.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,608 mnist_classifier_MNISTClassifier ugrpo1jt cfb3fc13-17d0-4aff-bb3d-aa8794847e28 -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,608 mnist_classifier_MNISTClassifier ugrpo1jt c3ae1543-6716-4282-a6d9-181a85fbd10a -- POST / 200 375.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,608 mnist_classifier_MNISTClassifier ugrpo1jt 11e0cd98-6dda-45fb-bb93-18eaec71aa20 -- POST / 200 375.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,609 mnist_classifier_MNISTClassifier ugrpo1jt beaa9a70-bc01-4ad5-a29d-c7491da2868d -- POST / 200 376.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,609 mnist_classifier_MNISTClassifier ugrpo1jt 95c92a75-b450-47b9-8b27-e0a09b956faa -- POST / 200 374.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,610 mnist_classifier_MNISTClassifier ugrpo1jt 0f5f92c6-bba0-430a-99ca-045784cbf25b -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,611 mnist_classifier_MNISTClassifier ugrpo1jt 836c6ed2-059b-46ec-b7db-d5d6e1e1b918 -- POST / 200 374.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,612 mnist_classifier_MNISTClassifier ugrpo1jt 9feb0cbb-b8e0-428f-9a5a-ce5c464e9b84 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,613 mnist_classifier_MNISTClassifier ugrpo1jt fc01a527-0483-4664-bd45-d033079bf16c -- POST / 200 373.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,613 mnist_classifier_MNISTClassifier ugrpo1jt 09250541-a213-4e11-a957-f37f77306249 -- POST / 200 372.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,614 mnist_classifier_MNISTClassifier ugrpo1jt 0277a4ac-8362-4777-9431-b96701c15709 -- POST / 200 372.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,614 mnist_classifier_MNISTClassifier ugrpo1jt 206108fe-257a-4058-ad48-0fe25e1d7bb9 -- POST / 200 366.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,614 mnist_classifier_MNISTClassifier ugrpo1jt 8b6d4011-3c40-4012-abe8-754517fec53a -- POST / 200 365.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,615 mnist_classifier_MNISTClassifier ugrpo1jt 567e93b4-8c5a-42c0-ba67-ec3e5c91640c -- POST / 200 362.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,616 mnist_classifier_MNISTClassifier ugrpo1jt 5eae3274-82c8-45fe-8697-0e96a3126134 -- POST / 200 361.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,616 mnist_classifier_MNISTClassifier ugrpo1jt 4d609928-afb3-4cda-a0b5-c1b15a78db02 -- POST / 200 361.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,617 mnist_classifier_MNISTClassifier ugrpo1jt 2e8a7e90-7226-49c9-8e5b-e0c08d735ab2 -- POST / 200 362.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,620 mnist_classifier_MNISTClassifier ugrpo1jt 1a1f0ecb-6189-4e6d-a90a-19e3a376cdb4 -- POST / 200 361.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,621 mnist_classifier_MNISTClassifier ugrpo1jt 462d5b35-3400-42df-8f50-eeac4dcb442b -- POST / 200 360.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,623 mnist_classifier_MNISTClassifier ugrpo1jt 21d443c1-a6a8-42e7-ab24-e513dba67c64 -- POST / 200 362.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,625 mnist_classifier_MNISTClassifier ugrpo1jt 5dc6d8b7-99a9-4a23-899a-2accab69b8de -- POST / 200 364.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,626 mnist_classifier_MNISTClassifier ugrpo1jt a7147a1d-3fd9-486d-a925-3c112e04943c -- POST / 200 362.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,629 mnist_classifier_MNISTClassifier ugrpo1jt c5fa7236-9935-4c11-ae60-0ac50a55827b -- POST / 200 364.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,634 mnist_classifier_MNISTClassifier ugrpo1jt 901e8e49-bd71-4594-9d29-5ff00df92beb -- POST / 200 370.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,637 mnist_classifier_MNISTClassifier ugrpo1jt 9a079cd2-6d8a-4b7c-9185-d4300dd760c7 -- POST / 200 370.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,638 mnist_classifier_MNISTClassifier ugrpo1jt f7d22018-acd9-4698-8b16-bd18c6dfd8de -- POST / 200 371.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,638 mnist_classifier_MNISTClassifier ugrpo1jt 6f883992-b21c-4396-83c8-4bc611be5e0c -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,638 mnist_classifier_MNISTClassifier ugrpo1jt 81028c07-0c77-4fb2-bdce-093a6c7128d7 -- POST / 200 322.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,639 mnist_classifier_MNISTClassifier ugrpo1jt e17e9157-ecd6-47ca-a1bc-0dd25116468f -- POST / 200 322.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,639 mnist_classifier_MNISTClassifier ugrpo1jt 731b813f-e338-4e05-adac-a782f9424b60 -- POST / 200 322.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,639 mnist_classifier_MNISTClassifier ugrpo1jt dfd20f95-20dc-4c5f-8f08-f737f7ec655e -- POST / 200 322.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,639 mnist_classifier_MNISTClassifier ugrpo1jt f50df572-ab2d-4532-9414-adc40aa923f9 -- POST / 200 322.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,639 mnist_classifier_MNISTClassifier ugrpo1jt fdcd191b-c447-443b-9c3b-3c43ef6e59fe -- POST / 200 322.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,640 mnist_classifier_MNISTClassifier ugrpo1jt e4fca8f8-880c-4db2-aa09-deedd50443cf -- POST / 200 320.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,640 mnist_classifier_MNISTClassifier ugrpo1jt db21b7d0-d9d6-415f-ace7-1b42439dac4a -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,640 mnist_classifier_MNISTClassifier ugrpo1jt d5470110-458e-410d-8a36-759ada16339a -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,640 mnist_classifier_MNISTClassifier ugrpo1jt b40d4756-ed93-4816-8c26-3e1b21e71efd -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,640 mnist_classifier_MNISTClassifier ugrpo1jt 85f7ae99-6b35-441a-8e0e-e640f69aca19 -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,641 mnist_classifier_MNISTClassifier ugrpo1jt d17e59f1-8fd1-4c41-b104-d5a0e924fcab -- POST / 200 273.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,641 mnist_classifier_MNISTClassifier ugrpo1jt 42db8240-e604-4397-9896-021e8431061a -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,641 mnist_classifier_MNISTClassifier ugrpo1jt ecce6cf2-e517-4e62-8b27-5ac7398e923c -- POST / 200 270.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,641 mnist_classifier_MNISTClassifier ugrpo1jt 448f8026-153a-4006-81e1-85c37aae7d6e -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,641 mnist_classifier_MNISTClassifier ugrpo1jt f12613cf-aae4-4d80-9e4e-3715d4ea2c28 -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,642 mnist_classifier_MNISTClassifier ugrpo1jt 4df54953-29fc-4723-82e0-d2eb69dbdaf5 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,642 mnist_classifier_MNISTClassifier ugrpo1jt 678671d5-1ee7-4bdb-8a8a-26b729cebce7 -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,642 mnist_classifier_MNISTClassifier ugrpo1jt 4e87cbc2-4d71-4527-b61a-15c18055c9df -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,642 mnist_classifier_MNISTClassifier ugrpo1jt 08bcf25d-e832-494a-aa59-746d3858e859 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,642 mnist_classifier_MNISTClassifier ugrpo1jt c9494d0b-7851-4a69-ac72-deebfcd33d30 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,642 mnist_classifier_MNISTClassifier ugrpo1jt b67adb24-d9fc-4c11-b98f-22d50a36d745 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,643 mnist_classifier_MNISTClassifier ugrpo1jt e52d60e6-62ee-4f2d-a51b-c612bd750628 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,643 mnist_classifier_MNISTClassifier ugrpo1jt d067b370-7459-427b-8059-a10bddb5b337 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,643 mnist_classifier_MNISTClassifier ugrpo1jt 1990e2d9-7a5b-4ad3-a724-b4c0bb87e787 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,643 mnist_classifier_MNISTClassifier ugrpo1jt 5748d282-875c-4643-b503-59a0c04d673f -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,643 mnist_classifier_MNISTClassifier ugrpo1jt 4c606150-2fdb-40cb-ad87-0af98c0d0251 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,644 mnist_classifier_MNISTClassifier ugrpo1jt 223ddf9d-875d-4191-a5e0-7f7203c94873 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,644 mnist_classifier_MNISTClassifier ugrpo1jt 192fcbed-6cfe-4a18-aa45-94aca75643b6 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,645 mnist_classifier_MNISTClassifier ugrpo1jt 7c5e5650-9d8d-4cbd-b0a4-acc67d2bda5f -- POST / 200 252.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,645 mnist_classifier_MNISTClassifier ugrpo1jt 0eeee7e5-fca0-48a1-ac36-3484a6c28c05 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,646 mnist_classifier_MNISTClassifier ugrpo1jt 82761d6f-d3c8-400b-9fba-21f8b33ca280 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,649 mnist_classifier_MNISTClassifier ugrpo1jt 263028bd-b753-4102-8ab5-31813c1b7143 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,649 mnist_classifier_MNISTClassifier ugrpo1jt 0e89f457-903a-4560-b3f9-9daca22671f0 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,650 mnist_classifier_MNISTClassifier ugrpo1jt 34d57b9a-b155-49b2-9b3b-cae4b5f496f7 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,650 mnist_classifier_MNISTClassifier ugrpo1jt dbfacb74-7a89-47c7-b11d-416233a59ad2 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,651 mnist_classifier_MNISTClassifier ugrpo1jt a1c93625-369c-4c4c-af74-4d7e45c400e4 -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,651 mnist_classifier_MNISTClassifier ugrpo1jt 0cf25677-cd82-45d4-be15-4be742fcf68a -- POST / 200 166.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,651 mnist_classifier_MNISTClassifier ugrpo1jt 32dbdcb6-09ba-44e1-ba6a-9b01bef2aaec -- POST / 200 163.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,653 mnist_classifier_MNISTClassifier ugrpo1jt 722e8d23-13ed-4adc-8133-d81098c8ad5c -- POST / 200 163.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,653 mnist_classifier_MNISTClassifier ugrpo1jt 62c7a1fe-ad30-4362-b3ae-a147ca1cd201 -- POST / 200 162.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,653 mnist_classifier_MNISTClassifier ugrpo1jt 1d728e06-5298-4720-8cc2-c0bd521f2766 -- POST / 200 161.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,654 mnist_classifier_MNISTClassifier ugrpo1jt 43e8bfbc-8f9d-4ac7-b00a-42f7f56da37a -- POST / 200 161.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,657 mnist_classifier_MNISTClassifier ugrpo1jt ad9e5f3e-edda-439e-89a4-a0809f927fb6 -- POST / 200 163.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,659 mnist_classifier_MNISTClassifier ugrpo1jt 9b54ce4f-61d5-41a9-bff9-579cce3295ad -- POST / 200 164.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,659 mnist_classifier_MNISTClassifier ugrpo1jt dfb4e6b1-2411-47ef-9af9-90fc6b7b567c -- POST / 200 164.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,659 mnist_classifier_MNISTClassifier ugrpo1jt af4fd331-5dab-401e-be7d-b30000dd9412 -- POST / 200 165.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,660 mnist_classifier_MNISTClassifier ugrpo1jt b834f5f8-3883-4ef6-aeb4-1032860f98fd -- POST / 200 164.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,661 mnist_classifier_MNISTClassifier ugrpo1jt dd5b21b8-3269-4984-bef5-8ab07c7b1a76 -- POST / 200 163.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,711 mnist_classifier_MNISTClassifier ugrpo1jt 836dd84b-e138-4d7d-af87-0ca61e2614d0 -- POST / 200 209.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,727 mnist_classifier_MNISTClassifier ugrpo1jt 4b47abd8-00f6-4f3e-8d4a-c159b390ac46 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,728 mnist_classifier_MNISTClassifier ugrpo1jt 6301eafa-920c-4842-88a2-64c5751a1e83 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,728 mnist_classifier_MNISTClassifier ugrpo1jt 8a1a8da4-225c-4d90-a266-dc1d5a9f0c12 -- POST / 200 223.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,729 mnist_classifier_MNISTClassifier ugrpo1jt 5231285d-d7d3-4528-92dd-ec9d77d8a5f9 -- POST / 200 220.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,729 mnist_classifier_MNISTClassifier ugrpo1jt 47d390ce-c8fd-499b-8e93-eb3fe79d701f -- POST / 200 220.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,729 mnist_classifier_MNISTClassifier ugrpo1jt a097a986-735e-487a-9c76-4b22f2177001 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,729 mnist_classifier_MNISTClassifier ugrpo1jt 39076b7d-4109-4d8f-87b4-e09216591eb7 -- POST / 200 218.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,729 mnist_classifier_MNISTClassifier ugrpo1jt 6a1cdd26-940c-437c-a42a-d013754468f4 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,729 mnist_classifier_MNISTClassifier ugrpo1jt ebcc9f5e-c49c-4ac6-986f-aa352a67d66e -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt c3bcd659-2d29-4498-9f40-47712f1e2fb1 -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt 0a1edfc6-fba5-4840-88fe-26ffeab87fff -- POST / 200 218.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt 2a57d958-76da-4f7b-a7cd-9a2f5fe5356b -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt 6a9d8e43-a8fb-4655-8bb5-6980a34c3cbd -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt d2f5382f-beba-48f5-b6aa-86b3fb8c16ce -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt 8bcde669-748f-432d-98a0-ae18d3beb16e -- POST / 200 212.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,730 mnist_classifier_MNISTClassifier ugrpo1jt a74a5751-1aa9-4041-a0f9-77abe6746654 -- POST / 200 212.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,731 mnist_classifier_MNISTClassifier ugrpo1jt 89bb112f-ba1d-49ae-9bf7-2792ec2f97ef -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,990 mnist_classifier_MNISTClassifier ugrpo1jt 3b9b26f9-ca5c-41c9-bffc-37806a2a07cf -- POST / 200 377.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,996 mnist_classifier_MNISTClassifier ugrpo1jt f2d51b55-666a-4c16-8a70-9e2cef829df4 -- POST / 200 380.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,996 mnist_classifier_MNISTClassifier ugrpo1jt aefc033a-5a52-4079-b287-d0a150476e88 -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,998 mnist_classifier_MNISTClassifier ugrpo1jt 062f640b-ce16-4c4c-b24a-ad7b0fdb470f -- POST / 200 370.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:00,998 mnist_classifier_MNISTClassifier ugrpo1jt 423ade86-0a79-419c-9624-a060e455df2c -- POST / 200 342.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,000 mnist_classifier_MNISTClassifier ugrpo1jt e3ca2885-1d5a-4dc4-997b-f434a103ba4f -- POST / 200 343.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,002 mnist_classifier_MNISTClassifier ugrpo1jt 6be70aac-4f36-48aa-8efd-987056d45e29 -- POST / 200 332.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,003 mnist_classifier_MNISTClassifier ugrpo1jt 8be456f2-7036-444e-aba7-a893975c49b1 -- POST / 200 336.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,004 mnist_classifier_MNISTClassifier ugrpo1jt f20f6c13-d00f-4a28-bfa8-7d733a3a7b3a -- POST / 200 336.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,005 mnist_classifier_MNISTClassifier ugrpo1jt 97669d5b-a405-4e1a-98e3-48890b6feda4 -- POST / 200 334.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,141 mnist_classifier_MNISTClassifier ugrpo1jt 91d65580-840b-4e36-8bf3-3a51d1ab3e40 -- POST / 200 456.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,142 mnist_classifier_MNISTClassifier ugrpo1jt 105ac546-feaa-475b-aecb-fd6a8566fe49 -- POST / 200 457.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,142 mnist_classifier_MNISTClassifier ugrpo1jt c5d93d75-cdd8-409c-a4c1-6217ae04573e -- POST / 200 469.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,144 mnist_classifier_MNISTClassifier ugrpo1jt d0b96204-50bc-46a9-b763-206e06b87ed9 -- POST / 200 469.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,144 mnist_classifier_MNISTClassifier ugrpo1jt 10ae31c4-d71e-4608-a1a4-0ae70bcf221a -- POST / 200 469.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,145 mnist_classifier_MNISTClassifier ugrpo1jt 36697317-074b-4ae6-ae16-c75ffebb66a4 -- POST / 200 467.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,146 mnist_classifier_MNISTClassifier ugrpo1jt dafce50e-942d-485d-b7c4-355f975a9f49 -- POST / 200 468.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,146 mnist_classifier_MNISTClassifier ugrpo1jt 58648d0a-9f74-4b25-8c5a-247a686e3dd9 -- POST / 200 468.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,149 mnist_classifier_MNISTClassifier ugrpo1jt 3bfcb104-ea30-48e9-b8da-c558ef2040c5 -- POST / 200 470.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,150 mnist_classifier_MNISTClassifier ugrpo1jt 249dc536-b581-4ee1-b9bc-08cd44cbae87 -- POST / 200 471.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,150 mnist_classifier_MNISTClassifier ugrpo1jt 80105c21-c371-47fb-a88a-01505c09cb94 -- POST / 200 470.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,150 mnist_classifier_MNISTClassifier ugrpo1jt a85ab4ba-9942-4444-9977-f32a279d75bd -- POST / 200 469.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,151 mnist_classifier_MNISTClassifier ugrpo1jt 2ec154d0-2464-4ed9-9a35-0c9a64e7ef66 -- POST / 200 469.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,151 mnist_classifier_MNISTClassifier ugrpo1jt 36285f5f-d9eb-4164-8763-43f45388c4e7 -- POST / 200 465.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,151 mnist_classifier_MNISTClassifier ugrpo1jt 5ffc34cd-a05c-4d74-bcc0-83c3e28616ea -- POST / 200 465.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,152 mnist_classifier_MNISTClassifier ugrpo1jt d985573c-67e1-43a1-8f5b-1df610894c45 -- POST / 200 459.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,152 mnist_classifier_MNISTClassifier ugrpo1jt 61c3b857-cfa2-4742-be7c-43ab55ae2a12 -- POST / 200 455.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,152 mnist_classifier_MNISTClassifier ugrpo1jt 6e50e1db-6a2a-4bed-b52e-0cad4332791b -- POST / 200 455.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,153 mnist_classifier_MNISTClassifier ugrpo1jt 7e45bc26-ed1f-4aa8-b083-2ba006942e70 -- POST / 200 442.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,153 mnist_classifier_MNISTClassifier ugrpo1jt f4f6ff7a-bbb6-438e-bb52-3c7cb08ed31d -- POST / 200 421.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,153 mnist_classifier_MNISTClassifier ugrpo1jt 14411048-0528-4d64-8e44-d8fb0617a9e8 -- POST / 200 421.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,154 mnist_classifier_MNISTClassifier ugrpo1jt 627f9928-80ee-46c1-9f47-4421be2e1456 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,155 mnist_classifier_MNISTClassifier ugrpo1jt 9baa135b-41db-4b82-b631-387946edfe3d -- POST / 200 420.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,155 mnist_classifier_MNISTClassifier ugrpo1jt bf2db76a-be51-4d16-afee-1e045081ab22 -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,156 mnist_classifier_MNISTClassifier ugrpo1jt 26fb2c29-4ef3-44f0-955d-1ca2313cc092 -- POST / 200 414.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,157 mnist_classifier_MNISTClassifier ugrpo1jt 2ede702b-2d6e-4cf5-9722-6d708d326014 -- POST / 200 414.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,157 mnist_classifier_MNISTClassifier ugrpo1jt 5c621d3a-1bde-4319-aea0-55d13499cd3e -- POST / 200 414.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,158 mnist_classifier_MNISTClassifier ugrpo1jt 6c8a66b1-9a65-483a-8418-8e308cefb954 -- POST / 200 414.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,159 mnist_classifier_MNISTClassifier ugrpo1jt 5f367408-f211-454b-b0fa-c208e989836c -- POST / 200 414.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,159 mnist_classifier_MNISTClassifier ugrpo1jt 7231d104-3757-474b-a6e9-45189148bd1d -- POST / 200 412.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,160 mnist_classifier_MNISTClassifier ugrpo1jt 3df7b162-7462-48c1-be2b-db0be2afd28f -- POST / 200 412.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,160 mnist_classifier_MNISTClassifier ugrpo1jt d39ff676-9935-42ba-a3d8-1aa77810fe8c -- POST / 200 412.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,161 mnist_classifier_MNISTClassifier ugrpo1jt 265ec363-4cb0-4235-b2cf-53d039bd5bce -- POST / 200 411.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,161 mnist_classifier_MNISTClassifier ugrpo1jt 26b9790b-aade-48e6-838b-91fb46870f74 -- POST / 200 411.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,161 mnist_classifier_MNISTClassifier ugrpo1jt 4d537932-ebc3-4155-bace-9684142e3f79 -- POST / 200 410.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,162 mnist_classifier_MNISTClassifier ugrpo1jt 59dd7aba-cc5e-48ce-b801-fc8f6b69844d -- POST / 200 409.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,163 mnist_classifier_MNISTClassifier ugrpo1jt 2fd4644a-6d5a-4761-817e-dbe5bb9d7de6 -- POST / 200 410.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,163 mnist_classifier_MNISTClassifier ugrpo1jt dd706bba-c2dd-47d9-922e-81b0fe682b6d -- POST / 200 409.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,164 mnist_classifier_MNISTClassifier ugrpo1jt bfe94b05-d5cb-41af-b393-2e982f03d37c -- POST / 200 409.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,165 mnist_classifier_MNISTClassifier ugrpo1jt 24fdeda7-24bf-404a-bf03-85d4faa813f6 -- POST / 200 410.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,165 mnist_classifier_MNISTClassifier ugrpo1jt 94b28ef7-0dfc-4e30-b850-b80e641d9e0a -- POST / 200 408.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,166 mnist_classifier_MNISTClassifier ugrpo1jt f0c0bffb-67cc-4824-9527-6d385a9d39f0 -- POST / 200 407.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,168 mnist_classifier_MNISTClassifier ugrpo1jt 754c9712-5e54-469b-9671-6887d431c405 -- POST / 200 409.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,172 mnist_classifier_MNISTClassifier ugrpo1jt 05c82c22-5eee-4f87-8460-b0e1817fd381 -- POST / 200 411.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,172 mnist_classifier_MNISTClassifier ugrpo1jt b4105379-0249-45d0-9499-ceafbe17a205 -- POST / 200 410.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,172 mnist_classifier_MNISTClassifier ugrpo1jt 12544eb2-ffc7-4c40-bcf0-a0ab1917c36f -- POST / 200 408.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,175 mnist_classifier_MNISTClassifier ugrpo1jt 3c36575e-be89-4f36-8806-a8650ca2f1b9 -- POST / 200 409.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,176 mnist_classifier_MNISTClassifier ugrpo1jt 11f6cc7b-9d94-41b3-a394-62ee5c9c447b -- POST / 200 410.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,176 mnist_classifier_MNISTClassifier ugrpo1jt 038c1d7a-3246-40d8-b27b-dfc6e1cc7081 -- POST / 200 408.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,178 mnist_classifier_MNISTClassifier ugrpo1jt 8a0f748e-4cd9-4f2b-9eb5-f6965b1a71e9 -- POST / 200 377.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,184 mnist_classifier_MNISTClassifier ugrpo1jt 567f915e-5cfa-45fc-8f9a-0fdc9eb7d3a5 -- POST / 200 383.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,184 mnist_classifier_MNISTClassifier ugrpo1jt 24c17de7-49f7-4938-844b-d37a6ad0af43 -- POST / 200 383.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,184 mnist_classifier_MNISTClassifier ugrpo1jt e780fbd9-99ab-48cb-9eff-a6acad5d6192 -- POST / 200 369.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,185 mnist_classifier_MNISTClassifier ugrpo1jt 14763f38-bd32-4de5-92dd-fcc31a2e35b9 -- POST / 200 369.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,185 mnist_classifier_MNISTClassifier ugrpo1jt 6d61b5b3-953e-4a3a-8df5-37c1fa5835cf -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,186 mnist_classifier_MNISTClassifier ugrpo1jt 35f6027e-d92d-4e81-9e59-f1d3718ac7ee -- POST / 200 369.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,188 mnist_classifier_MNISTClassifier ugrpo1jt 38cfb212-7c13-44a4-8874-c2128ed2c916 -- POST / 200 369.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,188 mnist_classifier_MNISTClassifier ugrpo1jt f774f376-57b1-433b-99fb-2b61a38cef03 -- POST / 200 369.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,188 mnist_classifier_MNISTClassifier ugrpo1jt 5c7cba07-75dc-452c-8b1b-58f83bc1a762 -- POST / 200 364.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,188 mnist_classifier_MNISTClassifier ugrpo1jt 48a03cc0-b502-4025-a183-e83d18d7fcc7 -- POST / 200 363.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,189 mnist_classifier_MNISTClassifier ugrpo1jt b2faf816-516c-4f43-9bed-fe43ce1365b9 -- POST / 200 359.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,189 mnist_classifier_MNISTClassifier ugrpo1jt d3f6b91c-89fe-4339-b045-1ef6a4696bf9 -- POST / 200 358.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,189 mnist_classifier_MNISTClassifier ugrpo1jt f98e8f81-78a9-4709-98b2-061d1383ac3c -- POST / 200 358.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,190 mnist_classifier_MNISTClassifier ugrpo1jt 796c2cc9-1793-4633-88d0-d4a95679ba36 -- POST / 200 357.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,190 mnist_classifier_MNISTClassifier ugrpo1jt 4bb49ed0-edd0-47e9-bba7-0110e6db19e0 -- POST / 200 352.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,190 mnist_classifier_MNISTClassifier ugrpo1jt f1c583e0-e2b4-45e3-b29e-dbf9b1e0d33c -- POST / 200 350.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,190 mnist_classifier_MNISTClassifier ugrpo1jt 28b77d6f-7728-4597-840d-d79294e38ca4 -- POST / 200 349.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,194 mnist_classifier_MNISTClassifier ugrpo1jt eaad5c2d-e015-439d-bc47-7eb9b3e13b3b -- POST / 200 351.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,194 mnist_classifier_MNISTClassifier ugrpo1jt 1687acb1-88c3-4556-a0ac-a2a97f96b11a -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,195 mnist_classifier_MNISTClassifier ugrpo1jt 23d7dac0-fd84-49df-9223-8b9579d92b59 -- POST / 200 218.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,195 mnist_classifier_MNISTClassifier ugrpo1jt 18378791-a881-434a-b981-bea6a90bf9a5 -- POST / 200 184.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,196 mnist_classifier_MNISTClassifier ugrpo1jt ca6b880d-83c3-4faa-899b-98bef1657be5 -- POST / 200 182.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,197 mnist_classifier_MNISTClassifier ugrpo1jt af85dbe1-3cb1-4767-9bc5-e1012c623d73 -- POST / 200 181.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,197 mnist_classifier_MNISTClassifier ugrpo1jt ec5ce4b5-4003-4aaf-bba3-0ce61d4c5fc5 -- POST / 200 181.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,198 mnist_classifier_MNISTClassifier ugrpo1jt 961eded9-116e-42c0-b637-f05b3e22ac64 -- POST / 200 179.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,199 mnist_classifier_MNISTClassifier ugrpo1jt 5a4757f8-080a-4086-a9b3-2317ae6497a6 -- POST / 200 179.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,200 mnist_classifier_MNISTClassifier ugrpo1jt 8c6efbb4-d383-4ca0-833c-f2ffc8e9b010 -- POST / 200 179.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,202 mnist_classifier_MNISTClassifier ugrpo1jt 833d1ff6-cd8b-4e74-bb15-d0d515177881 -- POST / 200 182.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,203 mnist_classifier_MNISTClassifier ugrpo1jt 51b17b6f-7d25-41eb-b61c-0e3f74690cc0 -- POST / 200 181.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,204 mnist_classifier_MNISTClassifier ugrpo1jt 1e95ed3c-c852-4769-8a03-8312d8f61d1c -- POST / 200 181.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,211 mnist_classifier_MNISTClassifier ugrpo1jt cdb45e66-e0ed-4a97-8051-1894c4bec972 -- POST / 200 442.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,212 mnist_classifier_MNISTClassifier ugrpo1jt 71ec5cd8-166c-40da-8024-902bcc045e5a -- POST / 200 443.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,212 mnist_classifier_MNISTClassifier ugrpo1jt 6716c93c-3eff-46b6-a1a0-27f52e9f531f -- POST / 200 441.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,213 mnist_classifier_MNISTClassifier ugrpo1jt 78ef7960-1c16-4c1d-a825-c3694d1ed1b8 -- POST / 200 439.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,213 mnist_classifier_MNISTClassifier ugrpo1jt e5b5e8f2-8ebd-4a10-b55a-afa1f435d7f1 -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,213 mnist_classifier_MNISTClassifier ugrpo1jt ec471e87-6637-4a50-9d38-80cba83f46ff -- POST / 200 434.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,214 mnist_classifier_MNISTClassifier ugrpo1jt 769c283f-805a-4363-a47d-80cc1c87dff2 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,214 mnist_classifier_MNISTClassifier ugrpo1jt fc1c9b92-59dc-472a-a850-c697cc6c6336 -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,214 mnist_classifier_MNISTClassifier ugrpo1jt 8e16be99-a0c0-4a87-8c77-9fe75e4d0beb -- POST / 200 432.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,215 mnist_classifier_MNISTClassifier ugrpo1jt 823ad389-7da0-4959-874d-aadfd30259d1 -- POST / 200 431.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,215 mnist_classifier_MNISTClassifier ugrpo1jt afaf43ec-a67c-4d96-8b2f-2298ae1a8e7f -- POST / 200 430.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,216 mnist_classifier_MNISTClassifier ugrpo1jt 6a3bd760-7e46-4bb9-b7c9-594e19690149 -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,216 mnist_classifier_MNISTClassifier ugrpo1jt 835bf702-6f9f-4e95-8c74-385136c17a27 -- POST / 200 427.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,216 mnist_classifier_MNISTClassifier ugrpo1jt 737f2770-ccb5-47f3-a032-9ca91097f2f3 -- POST / 200 426.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,216 mnist_classifier_MNISTClassifier ugrpo1jt 2bec40e1-36b2-4a94-b6c6-3c71bd24e381 -- POST / 200 426.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,217 mnist_classifier_MNISTClassifier ugrpo1jt 24e0fff9-c63f-414d-89b9-e035e7fa38d3 -- POST / 200 426.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,217 mnist_classifier_MNISTClassifier ugrpo1jt 098fc858-94cd-4ccd-82c2-07c26adec171 -- POST / 200 424.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,218 mnist_classifier_MNISTClassifier ugrpo1jt 2fb17b0f-1747-46ce-b5b3-10e9047fbf4d -- POST / 200 423.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,218 mnist_classifier_MNISTClassifier ugrpo1jt 0915f684-882b-4f18-bfe0-b5c17e757ee8 -- POST / 200 423.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,218 mnist_classifier_MNISTClassifier ugrpo1jt f985c2e5-47b8-4142-8e5c-45e38a069756 -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,443 mnist_classifier_MNISTClassifier ugrpo1jt 553686ff-046b-4e0b-aa9b-25efe2cf1824 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,445 mnist_classifier_MNISTClassifier ugrpo1jt 8e6cc397-a272-4a81-a7fa-6c664a776b37 -- POST / 200 225.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,445 mnist_classifier_MNISTClassifier ugrpo1jt c2df1664-4666-4042-8ecb-ea31ab4cdbab -- POST / 200 302.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,446 mnist_classifier_MNISTClassifier ugrpo1jt 6db90c1d-9d33-4cea-9380-507688f26198 -- POST / 200 298.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,447 mnist_classifier_MNISTClassifier ugrpo1jt c7249038-5abc-4e17-b591-1d79a0914084 -- POST / 200 292.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,449 mnist_classifier_MNISTClassifier ugrpo1jt 30493853-6b62-4a48-affc-d0d3969fb8eb -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,450 mnist_classifier_MNISTClassifier ugrpo1jt fe1b16c4-4dd9-4fbf-9340-a25576d5e8f5 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,450 mnist_classifier_MNISTClassifier ugrpo1jt 4e5bd80a-5e45-4879-8166-d33b30f746e8 -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,457 mnist_classifier_MNISTClassifier ugrpo1jt 8b16557e-58a3-416f-aa0f-2d891dc523cf -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,457 mnist_classifier_MNISTClassifier ugrpo1jt 307a1ab6-827a-4e94-9320-59081e1228af -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,459 mnist_classifier_MNISTClassifier ugrpo1jt a00859f7-45c0-4b67-90de-e67af893f863 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,459 mnist_classifier_MNISTClassifier ugrpo1jt 16df174e-531c-460e-ae6e-5f57826cd0fd -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,462 mnist_classifier_MNISTClassifier ugrpo1jt 06dbae7a-42f2-46b0-b331-db325b73bdcd -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,464 mnist_classifier_MNISTClassifier ugrpo1jt aab90b65-a9e3-4dda-b1e3-7c6c8be3a61d -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,465 mnist_classifier_MNISTClassifier ugrpo1jt c0237513-362e-42f1-82d5-d13a88a9b144 -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,465 mnist_classifier_MNISTClassifier ugrpo1jt f995fc66-f663-4b81-9358-10dbcbd5076b -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,468 mnist_classifier_MNISTClassifier ugrpo1jt aaa24432-750a-485e-a255-43846f97697e -- POST / 200 232.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,469 mnist_classifier_MNISTClassifier ugrpo1jt e97a85da-4112-4df7-b6ef-85b550c4cc53 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,470 mnist_classifier_MNISTClassifier ugrpo1jt 589e797c-0d65-455a-a341-484d30ff6997 -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,470 mnist_classifier_MNISTClassifier ugrpo1jt dd53ec41-262a-473e-9553-fa1447ff802d -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,471 mnist_classifier_MNISTClassifier ugrpo1jt 934fe71b-b757-4ad4-a339-21ea86f93f96 -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,471 mnist_classifier_MNISTClassifier ugrpo1jt 96839fe1-b97d-4dbc-8a2d-6dbd4f9db49f -- POST / 200 230.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,472 mnist_classifier_MNISTClassifier ugrpo1jt 2dafd2ad-e405-4ae6-9227-afb680c79187 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,481 mnist_classifier_MNISTClassifier ugrpo1jt 625e964f-72b6-4346-830e-aaf62cac602a -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,481 mnist_classifier_MNISTClassifier ugrpo1jt baff6c83-9188-4669-8879-890ed8bb6a84 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,483 mnist_classifier_MNISTClassifier ugrpo1jt 6d2eb712-1b78-4bd3-a8f5-e2f6fa4154a9 -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,484 mnist_classifier_MNISTClassifier ugrpo1jt f9e232cb-9d3a-440b-9d67-6ea7cdf9c8e0 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,484 mnist_classifier_MNISTClassifier ugrpo1jt 140ec709-7613-40b9-8ea9-42e22f8015d1 -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,484 mnist_classifier_MNISTClassifier ugrpo1jt 59639b33-1077-4d45-894e-25e77933d5ff -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,485 mnist_classifier_MNISTClassifier ugrpo1jt 03be9fb6-9536-4b1c-8147-0e558d36fbaf -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,485 mnist_classifier_MNISTClassifier ugrpo1jt 85e24552-18e1-40e1-9d99-98414d21069f -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,486 mnist_classifier_MNISTClassifier ugrpo1jt ccce24ab-753f-4ab9-80dd-e58a687f8ac3 -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,487 mnist_classifier_MNISTClassifier ugrpo1jt 36c37c3b-a6bf-4ef8-8627-1ff62203f341 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,488 mnist_classifier_MNISTClassifier ugrpo1jt be1952af-ea75-46e1-ac13-fe8be22d6954 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,489 mnist_classifier_MNISTClassifier ugrpo1jt fe1f6018-f38b-487c-8e51-58460f58ba6e -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,489 mnist_classifier_MNISTClassifier ugrpo1jt 1d764c9f-a53c-405e-8db2-4691e28faec1 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,490 mnist_classifier_MNISTClassifier ugrpo1jt 239a24a4-0f24-4f7f-9bde-f12d6f6ce017 -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,490 mnist_classifier_MNISTClassifier ugrpo1jt 6928f26d-f224-4c0c-a1da-b6420f52cc36 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,490 mnist_classifier_MNISTClassifier ugrpo1jt 1ea86f3a-5a49-466b-8da3-2618467ef0a4 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,491 mnist_classifier_MNISTClassifier ugrpo1jt af995ec9-8e54-422c-9cef-586a2a062517 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,492 mnist_classifier_MNISTClassifier ugrpo1jt a27ac501-18b1-4344-b55e-b0750f0c4729 -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,492 mnist_classifier_MNISTClassifier ugrpo1jt e3bf96c0-d254-479e-bcfc-894c6e2ca1c3 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,492 mnist_classifier_MNISTClassifier ugrpo1jt 28debecb-d382-424b-8dbe-4ad3b487de4a -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,492 mnist_classifier_MNISTClassifier ugrpo1jt 306cbee7-f057-4c8f-92e7-2b420d15f3ef -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,493 mnist_classifier_MNISTClassifier ugrpo1jt 3c89f24d-40fc-467d-8a14-59a86541df19 -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,494 mnist_classifier_MNISTClassifier ugrpo1jt 51c98e3a-b2dd-4e6a-8508-4c053a6408ca -- POST / 200 223.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,568 mnist_classifier_MNISTClassifier ugrpo1jt d7029b15-12d7-40d0-99fe-ebeaf547b790 -- POST / 200 293.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,572 mnist_classifier_MNISTClassifier ugrpo1jt 2c0f04de-3fc1-47dc-933f-beff2676172c -- POST / 200 298.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,572 mnist_classifier_MNISTClassifier ugrpo1jt 184c4292-68aa-434d-b508-995fb4318451 -- POST / 200 295.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,573 mnist_classifier_MNISTClassifier ugrpo1jt 6b9875df-8585-429d-ad72-8786e6fea40b -- POST / 200 262.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,573 mnist_classifier_MNISTClassifier ugrpo1jt 3163188f-f624-41e3-a42f-3f3b2e8d911c -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,574 mnist_classifier_MNISTClassifier ugrpo1jt 8e5c4196-cf45-45a1-9015-7a06de00a4e0 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,574 mnist_classifier_MNISTClassifier ugrpo1jt dda94180-5a6f-4fcf-bfc2-0526dd2edd2b -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,575 mnist_classifier_MNISTClassifier ugrpo1jt da1e6177-64ab-4d98-841a-29bdd90a6ac7 -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,577 mnist_classifier_MNISTClassifier ugrpo1jt 85cbecdf-ed3d-4fb2-8d63-039f7d5a9bfb -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,577 mnist_classifier_MNISTClassifier ugrpo1jt 28ef8751-b12c-41a9-9a73-d6b17a9da1cd -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,579 mnist_classifier_MNISTClassifier ugrpo1jt 7bceef0f-f9a9-45ae-8824-97b073710769 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,580 mnist_classifier_MNISTClassifier ugrpo1jt e42a8629-599e-432f-86d0-59c710c048fd -- POST / 200 254.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,581 mnist_classifier_MNISTClassifier ugrpo1jt d717a0e5-c6a7-456b-a04e-c0e9883acdbd -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,581 mnist_classifier_MNISTClassifier ugrpo1jt 8d9a96bd-a653-4e80-9c90-4abd8fdbbefb -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,583 mnist_classifier_MNISTClassifier ugrpo1jt 0826d1c8-5ab2-4e99-a44d-57b98cea0137 -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,587 mnist_classifier_MNISTClassifier ugrpo1jt 17d39cb9-4b4d-4bd0-8ba9-0cc7a5e58c42 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,589 mnist_classifier_MNISTClassifier ugrpo1jt 68036be1-a0db-4b01-80f1-ce4d4c051fde -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,591 mnist_classifier_MNISTClassifier ugrpo1jt 31dc7f6d-e99a-4eb8-8e6a-e0dd9b8088bf -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,595 mnist_classifier_MNISTClassifier ugrpo1jt 594cbbb4-3dc7-4fd4-9934-d47cf9fbe218 -- POST / 200 262.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,595 mnist_classifier_MNISTClassifier ugrpo1jt 0db1fbfd-9925-42b5-81fd-97f9b8a3fb26 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,596 mnist_classifier_MNISTClassifier ugrpo1jt 5d9b18c3-e400-445c-bbcc-af04391b9eaa -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,597 mnist_classifier_MNISTClassifier ugrpo1jt bb7bbc3a-1ae6-40cd-8379-ada41fa1b6cd -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,605 mnist_classifier_MNISTClassifier ugrpo1jt f878cd2d-820c-4e56-8036-af01ce3f5586 -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,616 mnist_classifier_MNISTClassifier ugrpo1jt b77575ee-ad10-456f-8b2f-0497a1768d08 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,618 mnist_classifier_MNISTClassifier ugrpo1jt 998213a1-5164-4083-993d-37842bfe132f -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,618 mnist_classifier_MNISTClassifier ugrpo1jt a66f4e4c-507a-4ea0-aa11-dc496bd738e5 -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,621 mnist_classifier_MNISTClassifier ugrpo1jt 00302f23-f75a-448d-a81b-f39cc2472ced -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,622 mnist_classifier_MNISTClassifier ugrpo1jt 7d2dc0dc-aeca-4116-a803-e616adde8062 -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,622 mnist_classifier_MNISTClassifier ugrpo1jt 2e6a46c3-3c6e-4272-851c-a640eff36cac -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,630 mnist_classifier_MNISTClassifier ugrpo1jt 01517084-a76d-4c27-8054-ca6a53e4de5c -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,633 mnist_classifier_MNISTClassifier ugrpo1jt 26c712c7-3101-4baf-b5be-6d694119dfb5 -- POST / 200 293.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,633 mnist_classifier_MNISTClassifier ugrpo1jt 8056693a-9f1e-4b0c-98be-4f0c57b9e52f -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,633 mnist_classifier_MNISTClassifier ugrpo1jt af7af137-bff0-4d06-a725-bb6901c01b2d -- POST / 200 291.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,634 mnist_classifier_MNISTClassifier ugrpo1jt 966a8cd5-9370-456e-8cf5-af30234f83d4 -- POST / 200 291.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,634 mnist_classifier_MNISTClassifier ugrpo1jt 34e4cd95-c30e-4c6a-bc1e-46627cd9db59 -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,635 mnist_classifier_MNISTClassifier ugrpo1jt 27c80840-9f91-4893-a41f-52a431c964f8 -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,635 mnist_classifier_MNISTClassifier ugrpo1jt d486d2b4-fb0e-4a77-9c95-30194baf44e2 -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,635 mnist_classifier_MNISTClassifier ugrpo1jt 99317447-b44d-4ba6-9d1d-0b21c932c6f7 -- POST / 200 289.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,635 mnist_classifier_MNISTClassifier ugrpo1jt 6584cc55-5961-4a86-b784-7121f4720421 -- POST / 200 288.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,636 mnist_classifier_MNISTClassifier ugrpo1jt 380602ac-cbbd-453f-8734-ee3eef5a986b -- POST / 200 289.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,637 mnist_classifier_MNISTClassifier ugrpo1jt 4e0c7d88-bddb-42ac-a51d-479e4388a941 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,637 mnist_classifier_MNISTClassifier ugrpo1jt 4e5266ef-ecf2-48ea-a8bc-ea1bab40261c -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,638 mnist_classifier_MNISTClassifier ugrpo1jt 242755d9-f18c-4afe-b7b7-ec2eae9dd1cd -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,638 mnist_classifier_MNISTClassifier ugrpo1jt 2c5238c7-e487-48cb-99e6-1766607fc0e1 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,642 mnist_classifier_MNISTClassifier ugrpo1jt 2eb32baf-895e-4a60-b705-643e63163ef2 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,642 mnist_classifier_MNISTClassifier ugrpo1jt 461a4c12-9457-429f-902f-f8ceabfa8662 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,646 mnist_classifier_MNISTClassifier ugrpo1jt a11638e6-c7f3-4a9b-8822-7d0c38e35594 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,647 mnist_classifier_MNISTClassifier ugrpo1jt 7c78ffb2-0dff-4b84-ad7f-a961df5219ce -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,647 mnist_classifier_MNISTClassifier ugrpo1jt dbf2cce4-4bc2-47b6-a050-61b938282338 -- POST / 200 283.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,648 mnist_classifier_MNISTClassifier ugrpo1jt 5fd9404a-1a95-461a-aa64-e54fab37fed5 -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,649 mnist_classifier_MNISTClassifier ugrpo1jt 26387fbc-82ba-434e-85d8-e6130b6cb33a -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,649 mnist_classifier_MNISTClassifier ugrpo1jt 9ecaf8cb-a1de-4c0d-b0f4-f50d80c5520b -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,650 mnist_classifier_MNISTClassifier ugrpo1jt 01db4ce1-b709-45ac-95c5-107ac9660c1b -- POST / 200 281.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,651 mnist_classifier_MNISTClassifier ugrpo1jt 68d4ba49-b052-4138-93a7-cf3684b688d5 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,748 mnist_classifier_MNISTClassifier ugrpo1jt 935192b8-2542-4042-a969-1d7122064710 -- POST / 200 306.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,750 mnist_classifier_MNISTClassifier ugrpo1jt 651886d1-1c1a-4670-b4ea-ca32d03d6367 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,751 mnist_classifier_MNISTClassifier ugrpo1jt 22c940f6-809b-480a-9adf-2a5cac882d7e -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,752 mnist_classifier_MNISTClassifier ugrpo1jt 59c6ec4e-2d20-4197-bd31-b33423de5c7a -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,753 mnist_classifier_MNISTClassifier ugrpo1jt ac82baa5-bb58-4986-b5df-21e0e43f1493 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,753 mnist_classifier_MNISTClassifier ugrpo1jt 38c0145e-dae6-43f3-a43e-c2faed93784d -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,755 mnist_classifier_MNISTClassifier ugrpo1jt acab2681-5866-4be7-8b9d-e9ca427c8d14 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,755 mnist_classifier_MNISTClassifier ugrpo1jt 55614556-5b17-4b38-85b2-64815d1e20f5 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,756 mnist_classifier_MNISTClassifier ugrpo1jt efd31ca1-ff18-4b1c-8da5-e8396b7a66d4 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,756 mnist_classifier_MNISTClassifier ugrpo1jt 3341cf9d-209a-46bf-8432-808e7be72e20 -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,758 mnist_classifier_MNISTClassifier ugrpo1jt 6dd478c0-8317-41bf-a86e-e2685cc4eb1e -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,762 mnist_classifier_MNISTClassifier ugrpo1jt 9a734c21-06ba-43a7-83cc-f10efe6c58cc -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,772 mnist_classifier_MNISTClassifier ugrpo1jt b0efd15c-31ba-421f-8ba9-e0ab020c2d9c -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,775 mnist_classifier_MNISTClassifier ugrpo1jt f89268c6-7e8e-44f9-bfa6-06cfdbc1f82f -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,777 mnist_classifier_MNISTClassifier ugrpo1jt 67ff9ca6-4797-469b-8a3f-6eacaa9bf42c -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,779 mnist_classifier_MNISTClassifier ugrpo1jt 85578c7a-b2b7-4e2b-9fca-eeda5297521b -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,781 mnist_classifier_MNISTClassifier ugrpo1jt ed9779a4-b31e-4419-933d-720bda964ee9 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,782 mnist_classifier_MNISTClassifier ugrpo1jt 2eeae41e-319c-4077-a01c-533ee0813e2b -- POST / 200 272.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,782 mnist_classifier_MNISTClassifier ugrpo1jt 0950ed78-9b24-4ff7-96c9-95c353b25b9d -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,782 mnist_classifier_MNISTClassifier ugrpo1jt 83fc9ac1-41a1-4a19-9938-194b5423c024 -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,783 mnist_classifier_MNISTClassifier ugrpo1jt 7f30e3b4-4973-4642-99d2-afe69fa1c6ec -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,783 mnist_classifier_MNISTClassifier ugrpo1jt 962a1d2c-98df-4ce3-88e8-2bc20e6be606 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,785 mnist_classifier_MNISTClassifier ugrpo1jt ea62a481-d52c-46d3-bc93-005016fff46e -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,786 mnist_classifier_MNISTClassifier ugrpo1jt fa8586f0-e06d-4b2c-95ab-acc36e06bace -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,803 mnist_classifier_MNISTClassifier ugrpo1jt 1958ff58-3724-4c5a-819e-f87c44abbdaa -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,804 mnist_classifier_MNISTClassifier ugrpo1jt 13aae354-8ded-4cd7-aa6a-19429691dacc -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,804 mnist_classifier_MNISTClassifier ugrpo1jt bcf16d3c-0a6d-441a-ba05-0374c531880e -- POST / 200 282.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,806 mnist_classifier_MNISTClassifier ugrpo1jt 420b56ce-6c0b-4a41-ad39-fb0d164bc571 -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,810 mnist_classifier_MNISTClassifier ugrpo1jt fbd68b0c-030f-4afb-9f02-c922f83af338 -- POST / 200 288.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,811 mnist_classifier_MNISTClassifier ugrpo1jt 497a0298-7c3a-49c2-8f04-3a006da60513 -- POST / 200 288.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,811 mnist_classifier_MNISTClassifier ugrpo1jt e5d7f05f-74d9-42fd-8d92-eccc20cb1e78 -- POST / 200 288.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,811 mnist_classifier_MNISTClassifier ugrpo1jt 53608a2c-d734-4db5-a4af-1701f1e4e20c -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,812 mnist_classifier_MNISTClassifier ugrpo1jt 66834215-c510-4032-a356-834034db1d5a -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,812 mnist_classifier_MNISTClassifier ugrpo1jt 2ec4d95d-b35d-4a38-a7de-eeed4b8d831d -- POST / 200 289.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,812 mnist_classifier_MNISTClassifier ugrpo1jt d60978aa-38a3-435c-aeb1-86332b1bfbc2 -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,813 mnist_classifier_MNISTClassifier ugrpo1jt 78888983-c4bb-4351-8623-24884b6980be -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,813 mnist_classifier_MNISTClassifier ugrpo1jt 08dbf540-2b69-4f76-835b-e4d1af747ae3 -- POST / 200 289.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,813 mnist_classifier_MNISTClassifier ugrpo1jt 847f7355-3307-4d9c-a82f-29b1963b6d13 -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,813 mnist_classifier_MNISTClassifier ugrpo1jt 5491a2d0-0691-46bb-a661-3f3b45f99677 -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,814 mnist_classifier_MNISTClassifier ugrpo1jt b76e2477-ff7f-4912-aa75-72dded215931 -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,815 mnist_classifier_MNISTClassifier ugrpo1jt df53089e-7889-439f-b456-da077a0bb15c -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,815 mnist_classifier_MNISTClassifier ugrpo1jt 1f53c105-3997-4099-9298-da108e02e10c -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,816 mnist_classifier_MNISTClassifier ugrpo1jt 5c6d5bef-7213-444c-8fb4-48d120ed60a5 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,816 mnist_classifier_MNISTClassifier ugrpo1jt 447596a6-74ae-4af3-914c-f117ddafcf2b -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,823 mnist_classifier_MNISTClassifier ugrpo1jt 7c2ad229-9ae4-410f-bff1-b7944a6eb336 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,823 mnist_classifier_MNISTClassifier ugrpo1jt 9bc4d5e4-970e-4542-9719-e99961dbff5d -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,823 mnist_classifier_MNISTClassifier ugrpo1jt ce2bd165-7134-432a-97ce-5dc71e2a050e -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,823 mnist_classifier_MNISTClassifier ugrpo1jt 30f36285-767c-428e-977d-b67d092763a6 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:01,823 mnist_classifier_MNISTClassifier ugrpo1jt 41080321-59d5-4e1d-98ec-86f63ea7315d -- POST / 200 178.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,028 mnist_classifier_MNISTClassifier ugrpo1jt b6a372eb-f6e1-4d72-b512-9120145066e7 -- POST / 200 398.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,030 mnist_classifier_MNISTClassifier ugrpo1jt 897e1e47-bd63-4b4b-93cd-dfce03157aa9 -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,030 mnist_classifier_MNISTClassifier ugrpo1jt 369e8b79-78ee-46fc-84ad-c63b112660c3 -- POST / 200 434.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,031 mnist_classifier_MNISTClassifier ugrpo1jt 6db51b1e-4a7e-41cf-ba27-951d6ecc53fd -- POST / 200 385.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,031 mnist_classifier_MNISTClassifier ugrpo1jt 7ecf4b89-8a7d-4297-88a1-e929e6900b6f -- POST / 200 385.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,032 mnist_classifier_MNISTClassifier ugrpo1jt e7706788-fd4a-400e-b99a-38d8079c4c71 -- POST / 200 380.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,033 mnist_classifier_MNISTClassifier ugrpo1jt 444fe6a6-6f10-43bf-92ac-ea6870eeac54 -- POST / 200 375.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,033 mnist_classifier_MNISTClassifier ugrpo1jt bfe79d76-4376-4a27-b3a5-1646238c528f -- POST / 200 374.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,035 mnist_classifier_MNISTClassifier ugrpo1jt dc81a1d3-aa79-4f7e-aeb1-ab20452a5be1 -- POST / 200 375.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,035 mnist_classifier_MNISTClassifier ugrpo1jt 42abb5f1-9a23-4ed1-886f-cee5a283eaf6 -- POST / 200 367.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,035 mnist_classifier_MNISTClassifier ugrpo1jt a51e200e-70cb-4c85-bba5-6c8de0cb6087 -- POST / 200 375.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,038 mnist_classifier_MNISTClassifier ugrpo1jt d1d4e997-6531-4475-a542-e00fcf29f9e7 -- POST / 200 376.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,040 mnist_classifier_MNISTClassifier ugrpo1jt e0731525-d6b7-48a7-aaa9-13bc245e4dcc -- POST / 200 376.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,045 mnist_classifier_MNISTClassifier ugrpo1jt 5f69ea6a-13f3-4cfc-95ea-6aa554a180ce -- POST / 200 381.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,047 mnist_classifier_MNISTClassifier ugrpo1jt df875e31-7bee-4ddb-9630-3c3c75a82ca1 -- POST / 200 380.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,049 mnist_classifier_MNISTClassifier ugrpo1jt 45509cc5-03b4-421d-b418-11769452f9c1 -- POST / 200 383.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,051 mnist_classifier_MNISTClassifier ugrpo1jt ac7a8495-c89a-4854-9b40-d996b80bccc7 -- POST / 200 384.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,052 mnist_classifier_MNISTClassifier ugrpo1jt 156f7eb1-7757-4c9a-ae35-3dcc63844e74 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,052 mnist_classifier_MNISTClassifier ugrpo1jt 7969cda0-a99a-4d41-9bba-1bba74e55c12 -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,052 mnist_classifier_MNISTClassifier ugrpo1jt b556e1a8-6c5b-46ee-82a2-2e713620ca9d -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,055 mnist_classifier_MNISTClassifier ugrpo1jt 7d0ad798-a6a0-492a-b796-4e341045f900 -- POST / 200 382.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,056 mnist_classifier_MNISTClassifier ugrpo1jt ef6529ec-22d6-4a9f-ba93-5ffac747593b -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,056 mnist_classifier_MNISTClassifier ugrpo1jt a51fa19c-b83a-4440-966a-b34eb0803fcd -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,057 mnist_classifier_MNISTClassifier ugrpo1jt 241b6c33-3162-4c58-a596-2d21462df7f4 -- POST / 200 382.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,058 mnist_classifier_MNISTClassifier ugrpo1jt 1701df68-371f-4c32-8947-52539d22d429 -- POST / 200 380.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,059 mnist_classifier_MNISTClassifier ugrpo1jt 60ca2f6e-9c66-48ec-bfb5-c4ede222457f -- POST / 200 382.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,059 mnist_classifier_MNISTClassifier ugrpo1jt 0f0468e2-e838-46eb-84b4-bc6adbc89320 -- POST / 200 381.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,062 mnist_classifier_MNISTClassifier ugrpo1jt 3d814423-0fcc-4cdf-a3d7-6cff86c753c9 -- POST / 200 383.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,064 mnist_classifier_MNISTClassifier ugrpo1jt 17f913a7-fbd1-45e2-8284-1ef2d4354c77 -- POST / 200 384.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,069 mnist_classifier_MNISTClassifier ugrpo1jt 234d7ef3-97e6-473e-9642-03ce051d5c92 -- POST / 200 387.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,072 mnist_classifier_MNISTClassifier ugrpo1jt fb929153-7e2b-4a3e-a383-f9bb0de8935d -- POST / 200 392.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,073 mnist_classifier_MNISTClassifier ugrpo1jt d9552f2f-60e9-4466-9554-a69234205acd -- POST / 200 389.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,074 mnist_classifier_MNISTClassifier ugrpo1jt 9863cc51-c2b2-4af8-afd1-5adb4fc6f2b0 -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,075 mnist_classifier_MNISTClassifier ugrpo1jt 52898f08-c6cf-47bb-b69d-93328664abcd -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,078 mnist_classifier_MNISTClassifier ugrpo1jt 347968b4-e35c-4f43-ad80-5fea024db088 -- POST / 200 393.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,078 mnist_classifier_MNISTClassifier ugrpo1jt 478b273e-4041-41f5-878f-041c8c93e4b5 -- POST / 200 393.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,079 mnist_classifier_MNISTClassifier ugrpo1jt 4b394064-86b2-4fc2-8f0d-4f445f22e31c -- POST / 200 393.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,079 mnist_classifier_MNISTClassifier ugrpo1jt bad8a9ea-7118-43ce-91bc-cf816a2fa41f -- POST / 200 394.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,079 mnist_classifier_MNISTClassifier ugrpo1jt 211254ed-dc44-49fb-aaf0-94fb1f715801 -- POST / 200 393.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,080 mnist_classifier_MNISTClassifier ugrpo1jt 6ba12699-0643-4b7a-9615-c7ab77203647 -- POST / 200 391.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,080 mnist_classifier_MNISTClassifier ugrpo1jt 829d4c94-c5b8-4fa1-b83f-a623ffaf0a03 -- POST / 200 384.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,081 mnist_classifier_MNISTClassifier ugrpo1jt 7b9e51b6-1aed-482f-ace4-6399b9da4689 -- POST / 200 381.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,081 mnist_classifier_MNISTClassifier ugrpo1jt 4f8bbb4b-990f-4e99-b878-743d43629c3e -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,082 mnist_classifier_MNISTClassifier ugrpo1jt 3d5ac748-b64c-45f6-93c7-7c92214aae5f -- POST / 200 381.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,083 mnist_classifier_MNISTClassifier ugrpo1jt 28c8759b-0cd8-4a51-a7fa-6c445a291525 -- POST / 200 380.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,083 mnist_classifier_MNISTClassifier ugrpo1jt 3a0bae70-8eb6-43ca-884b-7fc5841a0859 -- POST / 200 378.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,084 mnist_classifier_MNISTClassifier ugrpo1jt b5e78563-6143-4f0e-b55d-c958c0884e0d -- POST / 200 377.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,086 mnist_classifier_MNISTClassifier ugrpo1jt 02102c05-744e-4f07-9de6-e335088d79e0 -- POST / 200 378.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,087 mnist_classifier_MNISTClassifier ugrpo1jt 0b39c6c8-3eee-46af-a83a-aaa7700349a9 -- POST / 200 377.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,088 mnist_classifier_MNISTClassifier ugrpo1jt 0581bca1-244f-4b93-82a1-6a6b31045e75 -- POST / 200 378.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,089 mnist_classifier_MNISTClassifier ugrpo1jt 6dfe2a7d-45a3-44f0-b313-825d836c6edd -- POST / 200 376.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,197 mnist_classifier_MNISTClassifier ugrpo1jt 2829706b-2cc6-48ba-a3b8-ede6d0478966 -- POST / 200 382.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,199 mnist_classifier_MNISTClassifier ugrpo1jt 176912aa-2828-435e-97de-60613f8ac358 -- POST / 200 414.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,199 mnist_classifier_MNISTClassifier ugrpo1jt e5915c50-b8ba-4d48-a8c4-57f577c67410 -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,199 mnist_classifier_MNISTClassifier ugrpo1jt 4bdfcdc0-839c-4f0d-a032-b9a4aa71bba6 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,200 mnist_classifier_MNISTClassifier ugrpo1jt 776b7181-93e8-4c33-b756-8ec6cc21c8eb -- POST / 200 376.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,201 mnist_classifier_MNISTClassifier ugrpo1jt 82ccf40c-b6e9-4f57-ab03-1546e0e20e6c -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,202 mnist_classifier_MNISTClassifier ugrpo1jt c7b0c415-fc26-4568-a7c5-3089ed92ce9d -- POST / 200 372.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,202 mnist_classifier_MNISTClassifier ugrpo1jt 3e88d548-2665-4fcf-b8be-d64bf946254e -- POST / 200 371.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,203 mnist_classifier_MNISTClassifier ugrpo1jt e82ea374-f93f-4709-904a-864f8e2e7593 -- POST / 200 372.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,209 mnist_classifier_MNISTClassifier ugrpo1jt 29c9003d-baa6-42c5-9898-6d757425f9d1 -- POST / 200 376.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,209 mnist_classifier_MNISTClassifier ugrpo1jt a9766ab3-401c-480e-bad2-2e6463ded22c -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,210 mnist_classifier_MNISTClassifier ugrpo1jt e1ee939d-71dc-4780-a423-af6983a514c1 -- POST / 200 377.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,219 mnist_classifier_MNISTClassifier ugrpo1jt dffc5732-a743-41d9-ad5a-6efe38bde355 -- POST / 200 378.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,219 mnist_classifier_MNISTClassifier ugrpo1jt e2ab2887-1063-4a7d-af98-6d3b08ec7607 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,224 mnist_classifier_MNISTClassifier ugrpo1jt 891c2043-86cc-4e2e-af70-6e9a1856077d -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,228 mnist_classifier_MNISTClassifier ugrpo1jt a8182a93-ec1a-453e-b0ee-e0f440e0f6e2 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,231 mnist_classifier_MNISTClassifier ugrpo1jt 6abd9876-9447-4b2c-a3f6-ceae2c545edf -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,231 mnist_classifier_MNISTClassifier ugrpo1jt 8771f632-46e2-4de4-9b6a-29b7fc6b17d3 -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,232 mnist_classifier_MNISTClassifier ugrpo1jt 8ddb6d22-b8ad-46ac-81f9-7cea37367d9a -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,232 mnist_classifier_MNISTClassifier ugrpo1jt d9eb683c-1c22-414e-b744-fb9e7fa69907 -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,233 mnist_classifier_MNISTClassifier ugrpo1jt be237441-eaa7-44f9-ba17-5c055ce7d086 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,233 mnist_classifier_MNISTClassifier ugrpo1jt bb39524a-8435-4ac1-bedc-de4a7033a919 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,234 mnist_classifier_MNISTClassifier ugrpo1jt 78a0e05f-b665-4566-8e83-9cdac7df4998 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,234 mnist_classifier_MNISTClassifier ugrpo1jt 2bb6ca90-c5dc-4c94-b675-efd5470b714c -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,234 mnist_classifier_MNISTClassifier ugrpo1jt 3f6f1cad-4d76-430a-8b11-9dbabeec5e79 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,245 mnist_classifier_MNISTClassifier ugrpo1jt d903904f-bd10-4924-8397-be1764915a57 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,247 mnist_classifier_MNISTClassifier ugrpo1jt 068d9b51-ad17-420c-9d4e-0937dfa2c618 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,263 mnist_classifier_MNISTClassifier ugrpo1jt 096dd901-51dc-4b78-9432-339b3d66cf59 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,265 mnist_classifier_MNISTClassifier ugrpo1jt 5c1816d4-7a0b-42c0-ae2b-791cf283b330 -- POST / 200 282.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,266 mnist_classifier_MNISTClassifier ugrpo1jt db079e8d-ff3b-43f5-896f-dbb950e25546 -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,266 mnist_classifier_MNISTClassifier ugrpo1jt d877e494-8703-4a50-8ca3-d69984683abc -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,266 mnist_classifier_MNISTClassifier ugrpo1jt 56e7a7e1-8af5-4900-810d-769c2288caf7 -- POST / 200 278.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,267 mnist_classifier_MNISTClassifier ugrpo1jt fe076770-3093-48e5-8806-769c34c91615 -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,268 mnist_classifier_MNISTClassifier ugrpo1jt 4e61fa32-4af5-4b0f-afc1-be59078d3cd9 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,269 mnist_classifier_MNISTClassifier ugrpo1jt e50c7bfa-ff0b-4fa3-a803-b09d2bd88fc3 -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,269 mnist_classifier_MNISTClassifier ugrpo1jt 3c4ab2b5-387c-4293-96c6-f5919a422902 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,270 mnist_classifier_MNISTClassifier ugrpo1jt de4c2b13-e94a-4796-9dbf-910d2ad20946 -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,270 mnist_classifier_MNISTClassifier ugrpo1jt c024658b-728e-473f-b402-c4404733ea34 -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,321 mnist_classifier_MNISTClassifier ugrpo1jt 98b9cb54-1597-40d0-9a69-bd3a3baf3436 -- POST / 200 330.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,324 mnist_classifier_MNISTClassifier ugrpo1jt 6d77ed02-709a-426a-9b39-dc27b0c1292a -- POST / 200 332.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,328 mnist_classifier_MNISTClassifier ugrpo1jt 03b82b0d-8e89-48c9-949d-f4b952c50795 -- POST / 200 335.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,328 mnist_classifier_MNISTClassifier ugrpo1jt 2aee3346-2b24-4cd8-86c8-95b8b67d8dee -- POST / 200 334.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,332 mnist_classifier_MNISTClassifier ugrpo1jt 86b5afd2-de11-4584-ab0f-858ffac04771 -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,333 mnist_classifier_MNISTClassifier ugrpo1jt 87f6c1fc-0631-4726-9920-8cdd8afab3ab -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,334 mnist_classifier_MNISTClassifier ugrpo1jt e9aace5c-68d4-4f8f-acf4-8969b9fc7ff8 -- POST / 200 339.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,337 mnist_classifier_MNISTClassifier ugrpo1jt bf1efd0d-ad31-4cb4-9bba-db57870a3a70 -- POST / 200 341.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,339 mnist_classifier_MNISTClassifier ugrpo1jt 2f2a2c76-3c47-4671-9a41-bb435b4d8921 -- POST / 200 343.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,340 mnist_classifier_MNISTClassifier ugrpo1jt 6575f958-446e-41d5-a640-84755d98183b -- POST / 200 343.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,340 mnist_classifier_MNISTClassifier ugrpo1jt 280d8eb2-c156-466b-bc90-9ae3f2c504cf -- POST / 200 343.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,341 mnist_classifier_MNISTClassifier ugrpo1jt a1e03901-cc98-474a-a55a-9e041b67c84d -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,343 mnist_classifier_MNISTClassifier ugrpo1jt c89a26d1-b0b8-4a34-8b2c-be3097bd6838 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,343 mnist_classifier_MNISTClassifier ugrpo1jt 54d75db5-dc83-4dd3-93e6-b688e7eacc3e -- POST / 200 310.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,345 mnist_classifier_MNISTClassifier ugrpo1jt a19c43de-37c1-4cfb-84b2-b44d2a333a94 -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,345 mnist_classifier_MNISTClassifier ugrpo1jt 5219e29d-a7bc-4c42-b8a3-6094695475af -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,346 mnist_classifier_MNISTClassifier ugrpo1jt a90c1deb-99a3-4f61-bf2c-152f42b9a975 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,348 mnist_classifier_MNISTClassifier ugrpo1jt 596d2ce0-b4b6-439b-84cb-5328e43afa1d -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,348 mnist_classifier_MNISTClassifier ugrpo1jt b627e49c-15cc-4955-9fee-230656bd2466 -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,349 mnist_classifier_MNISTClassifier ugrpo1jt a89c4b8d-88cc-46a4-ae51-a8644c52b1ad -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,350 mnist_classifier_MNISTClassifier ugrpo1jt 3df90c48-ab43-4656-abe7-77c6640f97b0 -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,351 mnist_classifier_MNISTClassifier ugrpo1jt ac8ad977-9701-48ae-bc6b-85fdb0310b55 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,357 mnist_classifier_MNISTClassifier ugrpo1jt bbbc436b-2505-4375-8598-76f1d27e5411 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,362 mnist_classifier_MNISTClassifier ugrpo1jt 7851130a-b4d8-460f-a4c6-e83b28c31d35 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,362 mnist_classifier_MNISTClassifier ugrpo1jt bdef05f2-27b0-4005-90c2-0938fa22ab3a -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,363 mnist_classifier_MNISTClassifier ugrpo1jt 143192c8-2e33-4855-809c-52a366146ee8 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,365 mnist_classifier_MNISTClassifier ugrpo1jt 825b4109-c3e8-4c80-91b8-90012328a700 -- POST / 200 254.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,370 mnist_classifier_MNISTClassifier ugrpo1jt 45e806f5-40a6-4c30-a32d-9d3d72070bb3 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,373 mnist_classifier_MNISTClassifier ugrpo1jt 15f7fafb-6b24-4ab0-bbdc-967d77437abe -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,373 mnist_classifier_MNISTClassifier ugrpo1jt 09a7dd85-9e23-437e-b3b0-47308e48e099 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,373 mnist_classifier_MNISTClassifier ugrpo1jt 74d3cbd1-018c-4321-b179-484dc3ae599c -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,373 mnist_classifier_MNISTClassifier ugrpo1jt 928dc414-78f5-4749-a27e-50b025d41dcc -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,374 mnist_classifier_MNISTClassifier ugrpo1jt b469dce0-252f-4b24-a9b7-f6bd37f3b6e2 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,374 mnist_classifier_MNISTClassifier ugrpo1jt a70c3421-532f-4956-b076-cf898f7d2542 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,375 mnist_classifier_MNISTClassifier ugrpo1jt 17eb2a8c-4321-4e57-9bdf-b88f7f9c7e3e -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,375 mnist_classifier_MNISTClassifier ugrpo1jt 71f0c463-ee89-44dd-83b7-c5bdfb88086a -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,376 mnist_classifier_MNISTClassifier ugrpo1jt d8bc23e2-d08f-4587-8110-b62133b95b3f -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,377 mnist_classifier_MNISTClassifier ugrpo1jt 1affb7a5-25f0-45c6-a056-78085c67380e -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,377 mnist_classifier_MNISTClassifier ugrpo1jt 62562c8b-8560-46b4-bcbe-fbdb62dde61e -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,378 mnist_classifier_MNISTClassifier ugrpo1jt b6f0041e-29bc-4945-87d6-85285fe05984 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,378 mnist_classifier_MNISTClassifier ugrpo1jt 991c10e5-0bec-44da-a942-1b366ec15c02 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,384 mnist_classifier_MNISTClassifier ugrpo1jt 2e0e1d49-8cbf-4a45-a3c5-463015b91f3c -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,385 mnist_classifier_MNISTClassifier ugrpo1jt 44dd2d1c-7870-4ab3-95c4-1776e38a15ef -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,385 mnist_classifier_MNISTClassifier ugrpo1jt 2421eec2-3323-4850-8a99-799fbff6130b -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,386 mnist_classifier_MNISTClassifier ugrpo1jt c36b81ec-557f-45f4-9e95-88f912a82013 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,386 mnist_classifier_MNISTClassifier ugrpo1jt 6b6970a4-9944-40ef-adff-a5cfd29e88bf -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,386 mnist_classifier_MNISTClassifier ugrpo1jt 08292086-7935-4f56-b337-7656fda23734 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,387 mnist_classifier_MNISTClassifier ugrpo1jt f921991a-6262-43d7-b574-a0c6d48448bb -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,388 mnist_classifier_MNISTClassifier ugrpo1jt 9f138812-1d9a-498f-bcd3-c8dcaa7fcde1 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,388 mnist_classifier_MNISTClassifier ugrpo1jt be83ac77-62d9-4ba4-bc14-7b27e1642176 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,388 mnist_classifier_MNISTClassifier ugrpo1jt db37160f-4e1f-449c-ac84-c6b2a63a525a -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,389 mnist_classifier_MNISTClassifier ugrpo1jt ebdcf241-e4c7-4190-9342-5371ad89a605 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,389 mnist_classifier_MNISTClassifier ugrpo1jt cbdb76f7-96e2-4d91-8720-30aaa82c6835 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,389 mnist_classifier_MNISTClassifier ugrpo1jt f9f01d7d-ff76-410a-bcbd-247889316519 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,390 mnist_classifier_MNISTClassifier ugrpo1jt 300e7117-037e-4493-88d6-13d47a146fdf -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,390 mnist_classifier_MNISTClassifier ugrpo1jt 71f9ca0f-6863-4621-98c0-78e759ceee08 -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,391 mnist_classifier_MNISTClassifier ugrpo1jt 9926e627-0924-4155-bff9-78981c1841b8 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,391 mnist_classifier_MNISTClassifier ugrpo1jt 772bf963-1bad-4920-86b8-71d1bafff85d -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,391 mnist_classifier_MNISTClassifier ugrpo1jt 5937336e-bf8f-4df7-a344-0ce899b518dd -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,392 mnist_classifier_MNISTClassifier ugrpo1jt 460f2885-518d-4c2e-b4e9-9d04f113eba7 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,393 mnist_classifier_MNISTClassifier ugrpo1jt f363c8b3-83b8-4c32-b71c-e253ef9d6921 -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,394 mnist_classifier_MNISTClassifier ugrpo1jt 1d74a102-9207-40af-a5d1-16403183f129 -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,469 mnist_classifier_MNISTClassifier ugrpo1jt 59e78e32-5258-4ab3-85d2-80eef188ef31 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,482 mnist_classifier_MNISTClassifier ugrpo1jt 959e7605-1acc-4a1d-94d9-8d976738dfa3 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,486 mnist_classifier_MNISTClassifier ugrpo1jt fc91d621-cf44-4b73-a901-8004f839b7f3 -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,487 mnist_classifier_MNISTClassifier ugrpo1jt d033cc1b-896a-4820-a9f2-6914be39df79 -- POST / 200 214.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,489 mnist_classifier_MNISTClassifier ugrpo1jt 2e85fef1-d68d-4136-96fb-610efb664773 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,491 mnist_classifier_MNISTClassifier ugrpo1jt 23dfcd9a-a19c-4028-b196-a80cd6edff90 -- POST / 200 225.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,494 mnist_classifier_MNISTClassifier ugrpo1jt 33808c3e-53e8-45b1-8a3f-c2e8987073d8 -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,494 mnist_classifier_MNISTClassifier ugrpo1jt 4820895f-de74-470e-9a2b-518eed324d27 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,494 mnist_classifier_MNISTClassifier ugrpo1jt 8b5ef807-869c-488b-916f-e8d00c732c72 -- POST / 200 216.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,495 mnist_classifier_MNISTClassifier ugrpo1jt 6308356f-4d98-4814-a9f0-37f5d0620419 -- POST / 200 216.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,495 mnist_classifier_MNISTClassifier ugrpo1jt d22db169-2b6b-4c72-adde-c84f9e06c615 -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,496 mnist_classifier_MNISTClassifier ugrpo1jt 0204d918-2c4e-4401-ba23-45107c2570fc -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,496 mnist_classifier_MNISTClassifier ugrpo1jt 29d72289-a739-4d94-ae8e-b461b8adf231 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,496 mnist_classifier_MNISTClassifier ugrpo1jt 3d60775f-3009-4492-b75d-e0620e4ce00b -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,496 mnist_classifier_MNISTClassifier ugrpo1jt 71feca18-72f0-4c4d-8bc1-ce7790a84de3 -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,497 mnist_classifier_MNISTClassifier ugrpo1jt 22af9508-6b50-4b1a-a246-f9cabb24b5a0 -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,498 mnist_classifier_MNISTClassifier ugrpo1jt 26275d52-2300-441f-85b5-294f3ad6d988 -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,498 mnist_classifier_MNISTClassifier ugrpo1jt 5099d295-d8c2-49ee-aa90-1fe81b38c6d9 -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,499 mnist_classifier_MNISTClassifier ugrpo1jt 42f7152a-4706-4c02-827b-a4f9b5410618 -- POST / 200 212.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,500 mnist_classifier_MNISTClassifier ugrpo1jt ae14ccb1-a1b1-441d-bd68-4a3c8f94a219 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,500 mnist_classifier_MNISTClassifier ugrpo1jt 0218b660-7f4c-4c0b-95ba-628bc5618a0b -- POST / 200 211.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,500 mnist_classifier_MNISTClassifier ugrpo1jt e976d7df-6c20-4fa8-8354-3ff703378a95 -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,501 mnist_classifier_MNISTClassifier ugrpo1jt 936c5f32-b835-456c-bd58-979c06e86fc8 -- POST / 200 202.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,501 mnist_classifier_MNISTClassifier ugrpo1jt 1e4ab667-b981-4ec6-9f2f-a37ec4907f90 -- POST / 200 202.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,501 mnist_classifier_MNISTClassifier ugrpo1jt a42505c8-0db3-48ec-b234-1aec05bedfa9 -- POST / 200 201.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,502 mnist_classifier_MNISTClassifier ugrpo1jt 89bb98ca-2932-4065-a8c5-778f6a20a7de -- POST / 200 201.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,640 mnist_classifier_MNISTClassifier ugrpo1jt 81f687c3-d411-427a-8552-85dadc14e91f -- POST / 200 289.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,647 mnist_classifier_MNISTClassifier ugrpo1jt 18ec47be-b6c2-4b79-995b-03757335943d -- POST / 200 325.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,647 mnist_classifier_MNISTClassifier ugrpo1jt 45daf956-2f79-4329-b880-27986526a6c0 -- POST / 200 314.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,647 mnist_classifier_MNISTClassifier ugrpo1jt bd76f860-86eb-41a2-bfdf-77ea66f0673b -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,647 mnist_classifier_MNISTClassifier ugrpo1jt e3487ca6-c57e-442f-8ea9-382350215df2 -- POST / 200 303.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,649 mnist_classifier_MNISTClassifier ugrpo1jt 0bcbb5c6-72c0-4830-aba5-4324da1e55a0 -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,650 mnist_classifier_MNISTClassifier ugrpo1jt 889f0538-65a7-49da-9377-9a519f5aa04d -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,650 mnist_classifier_MNISTClassifier ugrpo1jt 4b90d0d7-0205-4781-b6b8-5685a9759952 -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,650 mnist_classifier_MNISTClassifier ugrpo1jt c8f9ba2e-b7fe-434f-b247-3d53e55853d8 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,650 mnist_classifier_MNISTClassifier ugrpo1jt b5980a0e-09d6-4a4f-bf68-d43b35e6e47c -- POST / 200 287.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,651 mnist_classifier_MNISTClassifier ugrpo1jt 6ced6a2e-22e3-450b-bd4c-bb452878ced3 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,651 mnist_classifier_MNISTClassifier ugrpo1jt b24bcf26-5054-4fca-b112-475fdfc40ef3 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,651 mnist_classifier_MNISTClassifier ugrpo1jt 27c65090-9028-4ef5-8047-c2e55803cb87 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,651 mnist_classifier_MNISTClassifier ugrpo1jt f5d87999-192c-42d6-9492-4ddc82a41373 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,652 mnist_classifier_MNISTClassifier ugrpo1jt ae71afc9-c2ba-421d-8297-424cd31f8f30 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,652 mnist_classifier_MNISTClassifier ugrpo1jt 1e6dcc1d-e902-4b4b-8e6b-98050f8d7dcc -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,653 mnist_classifier_MNISTClassifier ugrpo1jt 9b25929a-f738-4609-8ae0-d0cf379bc002 -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,653 mnist_classifier_MNISTClassifier ugrpo1jt d7d03aa9-4b1f-4ae7-b27e-7a26d5d731a8 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,653 mnist_classifier_MNISTClassifier ugrpo1jt e6fc51e3-6c09-46ed-b1d1-a08d59cf1c1e -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,654 mnist_classifier_MNISTClassifier ugrpo1jt 6a06551d-b866-4397-ab6e-4df08e850ce0 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,654 mnist_classifier_MNISTClassifier ugrpo1jt 39a439dd-db8e-4db4-89fd-37644faa55ca -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,655 mnist_classifier_MNISTClassifier ugrpo1jt 555c6ecc-88f1-46aa-bbec-5da7bdd23735 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,656 mnist_classifier_MNISTClassifier ugrpo1jt 34c0f8fa-b696-428b-87a7-497a785c8064 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,657 mnist_classifier_MNISTClassifier ugrpo1jt 009d01f7-257e-4249-aa77-8e438a45df50 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,657 mnist_classifier_MNISTClassifier ugrpo1jt e05843d5-2165-4b66-a286-3a38a1616a44 -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,659 mnist_classifier_MNISTClassifier ugrpo1jt a63c1f68-c107-4aeb-91a8-a9abe4fdee15 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,659 mnist_classifier_MNISTClassifier ugrpo1jt 1a65296c-067b-4828-8722-6beb7d66242d -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,659 mnist_classifier_MNISTClassifier ugrpo1jt 6db5e0c6-b755-455c-8adc-2c12d00e463b -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,660 mnist_classifier_MNISTClassifier ugrpo1jt eec6ab38-d37a-4fe9-8996-8490729c92eb -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,660 mnist_classifier_MNISTClassifier ugrpo1jt 074bfc1a-ec72-4db3-ad9f-e263a93b9ff2 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,661 mnist_classifier_MNISTClassifier ugrpo1jt 2ea80555-f118-4496-9bb9-c6770328e201 -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,661 mnist_classifier_MNISTClassifier ugrpo1jt aa4b32be-0519-4d92-aa8d-302f9d5d95b1 -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,662 mnist_classifier_MNISTClassifier ugrpo1jt a5c48a0f-0484-4fdd-aa9e-05d7685ba0c4 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,663 mnist_classifier_MNISTClassifier ugrpo1jt cc3d0cd2-12ec-442c-8b36-ffee6a053d76 -- POST / 200 205.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,663 mnist_classifier_MNISTClassifier ugrpo1jt 9b7ffb02-302c-469c-a311-c3df7fdec974 -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,665 mnist_classifier_MNISTClassifier ugrpo1jt 1db06832-8ebf-4c0a-959e-e6d237dd82c1 -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,665 mnist_classifier_MNISTClassifier ugrpo1jt 290a8121-28bb-4688-9070-50018628061f -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,666 mnist_classifier_MNISTClassifier ugrpo1jt 34c8f12a-ccc5-4338-9706-5d7651d386ca -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,668 mnist_classifier_MNISTClassifier ugrpo1jt e7692188-a4b0-45a0-aa24-b260e5a0a201 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,669 mnist_classifier_MNISTClassifier ugrpo1jt a6c90d43-f165-4f7d-ad00-ef41c01412e3 -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,669 mnist_classifier_MNISTClassifier ugrpo1jt 7ea6f87a-a709-4ec4-8f75-280258597f97 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,670 mnist_classifier_MNISTClassifier ugrpo1jt a321a8b3-ec47-47b1-adba-a3965df69a03 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,670 mnist_classifier_MNISTClassifier ugrpo1jt 1c640ce6-318d-4a74-8453-4da39f3bcda2 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,672 mnist_classifier_MNISTClassifier ugrpo1jt 0733f853-a6f5-4ff9-84cd-8f0bc584765a -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4531) INFO 2026-04-07 14:29:02,672 mnist_classifier_MNISTClassifier ugrpo1jt a1efe4c0-e33e-4465-8c6d-b00690290f78 -- POST / 200 240.4ms
Processed 1000 requests in 4.86 seconds
Throughput: 205.80 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance#

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment#

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion#

In this tutorial, you:

Deployed a PyTorch model using Ray Serve with production best practices.
Enabled dynamic request batching to optimize performance.
Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.
Tested the service with concurrent asynchronous requests.

Serve PyTorch models at scale with Ray Serve#

Setup#

Define a PyTorch model#

Define the Ray Serve deployment#

Configure autoscaling and resource allocation#

Test the endpoint with concurrent requests#

Fault tolerance#

Monitor the deployment#

Conclusion#

Further reading#

Docs

Tutorials

Resources