Rate this Page
★ ★ ★ ★ ★
beginner/serving_tutorial

Note

Go to the end to download the full example code.

Serve PyTorch models at scale with Ray Serve#

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

  • How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

  • How to configure an HTTP endpoint for the deployment using FastAPI

  • Enable dynamic request batching for higher throughput

  • Configure autoscaling and per-replica CPU/GPU resource allocation

  • Load test the service with concurrent requests and monitor it with the Ray dashboard

  • How Ray Serve deployments can self-heal from failures

  • Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

  • PyTorch v2.9+ and torchvision

  • Ray Serve (ray[serve]) v2.52.1+

  • A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup#

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model#

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment#

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation#

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests#

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-03-09 18:07:51,144 WARNING services.py:2137 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-03-09 18:07:51,329 INFO worker.py:2014 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2062: FutureWarning:

Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0

(ProxyActor pid=4546) INFO 2026-03-09 18:07:53,802 proxy 172.17.0.2 -- Proxy starting on node 953cc3252f300c88bd4e02270fa165104682e1798ed883e71c16b673 (HTTP port: 8000).
INFO 2026-03-09 18:07:53,869 serve 3864 -- Started Serve in namespace "serve".
(ServeController pid=4554) INFO 2026-03-09 18:07:53,881 controller 4554 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4554) INFO 2026-03-09 18:07:53,882 controller 4554 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4546) INFO 2026-03-09 18:07:53,865 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ProxyActor pid=4546) INFO 2026-03-09 18:07:53,885 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4546) INFO 2026-03-09 18:07:53,892 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f30a4334130>.
(ServeController pid=4554) INFO 2026-03-09 18:07:53,986 controller 4554 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4546) INFO 2026-03-09 18:07:57,706 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
INFO 2026-03-09 18:07:57,990 serve 3864 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,248 mnist_classifier_MNISTClassifier 5zkvkijf 2ba67825-0a86-46e0-bc8c-22344d2bccf1 -- POST / 200 525.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,250 mnist_classifier_MNISTClassifier 5zkvkijf e67276e9-a1db-492a-89db-758326efbb24 -- POST / 200 545.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,250 mnist_classifier_MNISTClassifier 5zkvkijf e6afc266-5d6e-4da2-a8b9-06998fa17178 -- POST / 200 532.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,251 mnist_classifier_MNISTClassifier 5zkvkijf 91d5b489-a6cc-42d2-8c5f-99c62c7ab786 -- POST / 200 531.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,254 mnist_classifier_MNISTClassifier 5zkvkijf 18a9cf5e-a468-4185-8ed1-a68c596d94ce -- POST / 200 531.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,255 mnist_classifier_MNISTClassifier 5zkvkijf 211617b9-4fbd-4480-8591-5171826dd46c -- POST / 200 525.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,256 mnist_classifier_MNISTClassifier 5zkvkijf 02c334c5-ccc7-49ee-94aa-b5bc94622b95 -- POST / 200 524.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,256 mnist_classifier_MNISTClassifier 5zkvkijf e4c06a08-330b-4b47-87a5-7d589fbbd748 -- POST / 200 523.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,258 mnist_classifier_MNISTClassifier 5zkvkijf 56c2e8c0-4472-4641-b915-8261ee348b02 -- POST / 200 523.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,259 mnist_classifier_MNISTClassifier 5zkvkijf f79181b3-c4c3-4872-988e-9ad15c673ff7 -- POST / 200 523.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,260 mnist_classifier_MNISTClassifier 5zkvkijf cdbb63e9-4fc5-4386-ae69-d8179e54722b -- POST / 200 521.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,261 mnist_classifier_MNISTClassifier 5zkvkijf fc77c80c-7403-48ec-8f84-4e9cfe58a584 -- POST / 200 523.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,262 mnist_classifier_MNISTClassifier 5zkvkijf d5d62a6b-02b1-4d9c-a623-e6cbef4892b6 -- POST / 200 521.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,265 mnist_classifier_MNISTClassifier 5zkvkijf 4d2b96bf-c75b-4fc7-a0d5-fb7d23df5854 -- POST / 200 522.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,265 mnist_classifier_MNISTClassifier 5zkvkijf 6100c211-bb8e-4803-97aa-1d67e62b9593 -- POST / 200 522.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,266 mnist_classifier_MNISTClassifier 5zkvkijf 484e8fdc-b7f5-4433-8938-0e829e40187e -- POST / 200 520.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,392 mnist_classifier_MNISTClassifier 5zkvkijf 9869e1d0-83d2-4165-99be-a223f32daf09 -- POST / 200 646.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,393 mnist_classifier_MNISTClassifier 5zkvkijf 7479d752-5bc8-4822-bf4b-d8cb2ab7db1f -- POST / 200 646.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,393 mnist_classifier_MNISTClassifier 5zkvkijf 65dd39e3-75c7-4882-bca3-6d5ed5af8eb4 -- POST / 200 646.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,394 mnist_classifier_MNISTClassifier 5zkvkijf 2c136ca8-bcd6-4ad2-a790-aa35ea52fa7c -- POST / 200 647.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,395 mnist_classifier_MNISTClassifier 5zkvkijf 79bd666b-1c1e-4cd8-9989-20f0c127ed4e -- POST / 200 644.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,395 mnist_classifier_MNISTClassifier 5zkvkijf 6a5e69dc-cadd-4896-96f0-8fa4b9ad3c0d -- POST / 200 641.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,395 mnist_classifier_MNISTClassifier 5zkvkijf b7e0b972-4284-4738-9f6c-d35ed86ed9b0 -- POST / 200 639.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,395 mnist_classifier_MNISTClassifier 5zkvkijf bfef472a-82b5-44f2-8313-d92d531c8bdd -- POST / 200 642.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,396 mnist_classifier_MNISTClassifier 5zkvkijf 3b2edeab-5f3c-48fc-952e-63d3750eb998 -- POST / 200 640.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,397 mnist_classifier_MNISTClassifier 5zkvkijf 3a9d9021-4750-49fd-a342-3113c5563e4f -- POST / 200 638.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,398 mnist_classifier_MNISTClassifier 5zkvkijf 611dd735-2b4b-4bad-9698-67453466f390 -- POST / 200 638.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,398 mnist_classifier_MNISTClassifier 5zkvkijf f7a05f25-c39b-41d7-9538-ff5a16d5ea46 -- POST / 200 636.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,399 mnist_classifier_MNISTClassifier 5zkvkijf dd000a09-b57a-40d4-ab5e-401a778401f0 -- POST / 200 633.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,399 mnist_classifier_MNISTClassifier 5zkvkijf 73f67efe-efda-4ae5-b0f9-a17eb0b190be -- POST / 200 634.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,400 mnist_classifier_MNISTClassifier 5zkvkijf 44890889-90bd-4081-a9e8-031622170d26 -- POST / 200 631.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,400 mnist_classifier_MNISTClassifier 5zkvkijf d747cd31-d63a-456f-a76f-0e2d36a016ca -- POST / 200 631.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,400 mnist_classifier_MNISTClassifier 5zkvkijf 5fa73ad8-e8ad-4d1d-8d01-483018006839 -- POST / 200 630.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,401 mnist_classifier_MNISTClassifier 5zkvkijf 73889aee-cb6d-4fe3-8929-1437773e0909 -- POST / 200 631.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,401 mnist_classifier_MNISTClassifier 5zkvkijf 70bb1b6f-bd18-4b79-a8dc-13152e1c1c46 -- POST / 200 631.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,403 mnist_classifier_MNISTClassifier 5zkvkijf b53b96a8-43d9-4d4a-b91e-74eb4b67b20a -- POST / 200 630.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,403 mnist_classifier_MNISTClassifier 5zkvkijf f93a9c91-9cc9-4849-a00f-6ddfd631ef6a -- POST / 200 632.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,405 mnist_classifier_MNISTClassifier 5zkvkijf 217b284c-e26e-41dc-9786-b364d672cc5e -- POST / 200 632.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,405 mnist_classifier_MNISTClassifier 5zkvkijf e6b0ec96-863b-49f3-8fac-628c1de6d364 -- POST / 200 632.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,407 mnist_classifier_MNISTClassifier 5zkvkijf 51bf1cfa-c3c8-44e5-9874-1fa5d3ce4dc7 -- POST / 200 633.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,408 mnist_classifier_MNISTClassifier 5zkvkijf bfe2deb6-8958-436c-baf6-b45550b43a74 -- POST / 200 625.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,410 mnist_classifier_MNISTClassifier 5zkvkijf db24ae2e-ae1e-44a1-b3b9-925d2b78a105 -- POST / 200 636.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,411 mnist_classifier_MNISTClassifier 5zkvkijf a796121a-0f4e-4235-8d23-10163916ed5a -- POST / 200 636.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,411 mnist_classifier_MNISTClassifier 5zkvkijf e691ceeb-508b-4630-b94a-59cb7184e421 -- POST / 200 635.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,411 mnist_classifier_MNISTClassifier 5zkvkijf 43b83bde-f7b4-4743-8ffd-24a3aeab9f12 -- POST / 200 635.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,412 mnist_classifier_MNISTClassifier 5zkvkijf 61c6a804-f9bd-4139-905b-3707ea73e9c1 -- POST / 200 635.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,412 mnist_classifier_MNISTClassifier 5zkvkijf 9d4c091b-31b4-475d-b6ca-25e52eb1cd2b -- POST / 200 634.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,413 mnist_classifier_MNISTClassifier 5zkvkijf 3e6271ee-2925-4e65-a6f3-f6978f242be9 -- POST / 200 635.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,416 mnist_classifier_MNISTClassifier 5zkvkijf c0f0c421-dbfd-427b-90db-f1f9208677af -- POST / 200 635.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,416 mnist_classifier_MNISTClassifier 5zkvkijf 94e271f9-b05c-40e5-b737-2696b0bdb4a8 -- POST / 200 632.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,417 mnist_classifier_MNISTClassifier 5zkvkijf c7945fec-36b6-4bba-9c87-d29bb4f9c847 -- POST / 200 632.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,417 mnist_classifier_MNISTClassifier 5zkvkijf 8e767a1c-a6ec-463a-a679-27faa1007a06 -- POST / 200 631.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,417 mnist_classifier_MNISTClassifier 5zkvkijf 6b217c30-bf35-48c1-84d1-a3b891b4af16 -- POST / 200 632.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,418 mnist_classifier_MNISTClassifier 5zkvkijf 10ba51a0-b023-49a0-99e6-bb5f7670fd80 -- POST / 200 632.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,418 mnist_classifier_MNISTClassifier 5zkvkijf d6768217-15e3-45df-bb49-c80654b65eae -- POST / 200 630.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,418 mnist_classifier_MNISTClassifier 5zkvkijf b417c768-eb48-4584-b724-f9874bd012d7 -- POST / 200 631.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,418 mnist_classifier_MNISTClassifier 5zkvkijf b4b1bf15-6c5b-4c59-8307-ed984f37fefc -- POST / 200 629.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,419 mnist_classifier_MNISTClassifier 5zkvkijf a6c9ec9b-a786-4c80-bbd4-0938a32b799a -- POST / 200 630.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,419 mnist_classifier_MNISTClassifier 5zkvkijf 62f83711-10aa-4e89-86df-80d9ac3848f9 -- POST / 200 630.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,419 mnist_classifier_MNISTClassifier 5zkvkijf f0e0ef61-4b08-4863-a499-f79b51f6629e -- POST / 200 627.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,419 mnist_classifier_MNISTClassifier 5zkvkijf 80e5cf5b-e594-43e0-a0cd-4c43a43a09c4 -- POST / 200 626.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,420 mnist_classifier_MNISTClassifier 5zkvkijf 2201bf60-c896-44bb-9d17-97cfc2fdea43 -- POST / 200 625.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,421 mnist_classifier_MNISTClassifier 5zkvkijf b34244c5-8a83-45ff-89a2-eaaad41e17f9 -- POST / 200 626.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,421 mnist_classifier_MNISTClassifier 5zkvkijf f8675d80-d3b3-445a-9303-31579be3f465 -- POST / 200 500.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,423 mnist_classifier_MNISTClassifier 5zkvkijf 1ffa46e8-764a-4eee-8975-03d86082eb0a -- POST / 200 476.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,435 mnist_classifier_MNISTClassifier 5zkvkijf fc5173c0-0d53-4471-b5d1-1a1cc6123c3e -- POST / 200 488.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,436 mnist_classifier_MNISTClassifier 5zkvkijf d551d9bb-b659-41f0-a2de-f72511db0e8a -- POST / 200 487.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,436 mnist_classifier_MNISTClassifier 5zkvkijf ba4eb0c0-e630-45aa-883a-41f2a34e1b5d -- POST / 200 485.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,436 mnist_classifier_MNISTClassifier 5zkvkijf 57b4d66d-6367-436d-b4a1-e07540a553ff -- POST / 200 485.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,437 mnist_classifier_MNISTClassifier 5zkvkijf 8dadf928-1fb0-4e4d-a063-02c03912e324 -- POST / 200 484.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,437 mnist_classifier_MNISTClassifier 5zkvkijf c47f68a5-688e-48aa-801c-6d75154ca813 -- POST / 200 486.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,439 mnist_classifier_MNISTClassifier 5zkvkijf 4b9e866b-6c17-4740-8544-162a470c98e5 -- POST / 200 485.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,439 mnist_classifier_MNISTClassifier 5zkvkijf 9f8fa156-13ba-49b0-b626-806604f2c3f0 -- POST / 200 486.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,441 mnist_classifier_MNISTClassifier 5zkvkijf c6343895-23a2-4611-8016-8444727ad6a2 -- POST / 200 487.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,441 mnist_classifier_MNISTClassifier 5zkvkijf 9d68d18b-97b6-4df7-a8da-0daa2bc768d5 -- POST / 200 488.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,441 mnist_classifier_MNISTClassifier 5zkvkijf 074322c7-dead-4790-8034-80aa7a37c2a1 -- POST / 200 487.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,442 mnist_classifier_MNISTClassifier 5zkvkijf 53639c90-b22a-4ac3-9cfa-cc74ff308f1b -- POST / 200 487.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,442 mnist_classifier_MNISTClassifier 5zkvkijf f7285ce8-924b-48bf-8449-9ad4c93673f1 -- POST / 200 195.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,447 mnist_classifier_MNISTClassifier 5zkvkijf bc79add2-9efb-41cd-8aff-f51f7ac87d11 -- POST / 200 526.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,448 mnist_classifier_MNISTClassifier 5zkvkijf 23e3c646-7652-45ad-b66f-825fca77df3c -- POST / 200 523.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,448 mnist_classifier_MNISTClassifier 5zkvkijf 7281b4e2-99f9-4ff8-bcc6-ca22cc80f4ae -- POST / 200 526.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,448 mnist_classifier_MNISTClassifier 5zkvkijf 7fc529f9-8f57-474e-a6f3-17c9a14524e1 -- POST / 200 520.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,448 mnist_classifier_MNISTClassifier 5zkvkijf ed42188d-1923-4b9d-a180-99179d163e8b -- POST / 200 518.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,448 mnist_classifier_MNISTClassifier 5zkvkijf fe05d8e8-3b75-4e4e-a3b1-c09c0555a29e -- POST / 200 518.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,448 mnist_classifier_MNISTClassifier 5zkvkijf dde1952a-b442-468a-819d-726969cabac5 -- POST / 200 517.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf 326bb73c-6013-4f2b-887d-cab208568e87 -- POST / 200 515.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf a96c9bc2-c179-4a49-b987-19b0c18c2766 -- POST / 200 515.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf 7b97d89c-236f-46ba-bd48-7516b7ff5953 -- POST / 200 515.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf a0459e75-5bb0-40b0-9969-7da4198f7a3a -- POST / 200 513.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf 91771ec5-6d56-4330-b268-1fe8d8a38ae1 -- POST / 200 511.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf 86e4ad54-b815-4a0c-9ab0-140342b9019b -- POST / 200 511.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,449 mnist_classifier_MNISTClassifier 5zkvkijf fbc412a6-eeff-478b-90f4-ccc7ef7209e7 -- POST / 200 510.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf bd51b012-611a-4ad3-9186-86de9750011a -- POST / 200 509.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf 5f88ba99-81cc-4c6a-9f72-3629e2e7c9bf -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf 22ce6988-5af2-4959-b638-264a1e4c89e0 -- POST / 200 508.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf 6c05d75b-ddcb-4cff-a7b4-ca9cfd9582a4 -- POST / 200 508.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf b2cf7ad1-083e-411e-9323-52a390de7b78 -- POST / 200 507.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf 5956897d-eb19-4b0a-9232-f9238d82750c -- POST / 200 506.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,450 mnist_classifier_MNISTClassifier 5zkvkijf 6c6231f6-ae8c-4467-b609-ff1f2db764ae -- POST / 200 506.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,451 mnist_classifier_MNISTClassifier 5zkvkijf 23e6f6c9-0e86-45b7-b4bb-f5a8230928f6 -- POST / 200 505.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,451 mnist_classifier_MNISTClassifier 5zkvkijf c7d362cb-7745-40eb-98aa-44464f54024b -- POST / 200 505.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,497 mnist_classifier_MNISTClassifier 5zkvkijf 5817dae8-722b-4fc0-8513-afd5d633038b -- POST / 200 219.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,524 mnist_classifier_MNISTClassifier 5zkvkijf bff2ebf7-aab9-49a0-b12d-23653edcd262 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,524 mnist_classifier_MNISTClassifier 5zkvkijf 5f413cd5-62b1-410e-8185-017854861608 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,525 mnist_classifier_MNISTClassifier 5zkvkijf 4d71e8ce-8391-49af-ab10-14f4616ce9a9 -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,525 mnist_classifier_MNISTClassifier 5zkvkijf 470267a7-1532-43f0-8283-2feb1669f962 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,526 mnist_classifier_MNISTClassifier 5zkvkijf d96d81d9-f0ec-4639-a5de-65f369ecba71 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,526 mnist_classifier_MNISTClassifier 5zkvkijf 6eefc7f1-8d0f-46f2-836f-e0d7fe0aff86 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,526 mnist_classifier_MNISTClassifier 5zkvkijf 45ab8125-1dc5-4be4-a66a-70f91d5ea5ad -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,526 mnist_classifier_MNISTClassifier 5zkvkijf e6869745-bff0-4dbf-89ad-cdf392a28556 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,527 mnist_classifier_MNISTClassifier 5zkvkijf 946ceb44-9efe-4fca-97b6-ca601139e43c -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,527 mnist_classifier_MNISTClassifier 5zkvkijf e3527839-8692-411b-8a1e-c7bed28852a6 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,527 mnist_classifier_MNISTClassifier 5zkvkijf f98d2625-c21a-4fc2-adc1-0d1160d62c1c -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,527 mnist_classifier_MNISTClassifier 5zkvkijf 9ca5490f-c2fa-48f1-8a23-7ad35e9406d6 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,527 mnist_classifier_MNISTClassifier 5zkvkijf 3079986f-1093-40c5-9de8-3afa9f89334d -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,528 mnist_classifier_MNISTClassifier 5zkvkijf c9484c52-2729-45b5-99ee-cac5af042395 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,704 mnist_classifier_MNISTClassifier 5zkvkijf 88b2d80c-42a4-4526-af0e-cf3899b13bb1 -- POST / 200 301.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,706 mnist_classifier_MNISTClassifier 5zkvkijf 62e880b2-2ddd-4085-b15c-5879e3154f52 -- POST / 200 298.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,725 mnist_classifier_MNISTClassifier 5zkvkijf b688e9b2-0765-4ef2-88ae-ed74833c2175 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,730 mnist_classifier_MNISTClassifier 5zkvkijf b2d5c4f8-f320-4867-a6e1-2447c1f4fe8b -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,730 mnist_classifier_MNISTClassifier 5zkvkijf 2e9fa854-34a9-4583-8f20-f50a68f97066 -- POST / 200 272.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,730 mnist_classifier_MNISTClassifier 5zkvkijf e9be6ff4-45eb-42b5-a8e0-ce4569a3db6b -- POST / 200 279.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,733 mnist_classifier_MNISTClassifier 5zkvkijf f921543f-5dad-4110-bd6d-d9e36826dd5a -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,734 mnist_classifier_MNISTClassifier 5zkvkijf acfd3553-4aad-4ba3-aaa8-926d6cb78168 -- POST / 200 277.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,734 mnist_classifier_MNISTClassifier 5zkvkijf 03890791-1037-4a62-bd62-37a7796f050e -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,735 mnist_classifier_MNISTClassifier 5zkvkijf ce0c31e5-024d-499e-937e-94c5b8647d64 -- POST / 200 278.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,736 mnist_classifier_MNISTClassifier 5zkvkijf c947d7b3-b309-488a-834d-5fc34ac492e1 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,736 mnist_classifier_MNISTClassifier 5zkvkijf 8f86d7c0-9300-49b7-a763-1628927fafcf -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,737 mnist_classifier_MNISTClassifier 5zkvkijf 76eb9da1-bf8b-432f-b891-6bc0b14a10a7 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,742 mnist_classifier_MNISTClassifier 5zkvkijf 5ebd0451-87f2-4da3-a2ad-9625de848268 -- POST / 200 279.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,742 mnist_classifier_MNISTClassifier 5zkvkijf 69fa85b6-a9d4-4532-bab9-dfe2fa6a6e18 -- POST / 200 280.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,743 mnist_classifier_MNISTClassifier 5zkvkijf e4d318c3-bfda-4da0-b61b-bf9092f56d52 -- POST / 200 278.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,743 mnist_classifier_MNISTClassifier 5zkvkijf 4737bb7f-c17b-4f5d-a1d0-0cb567cb0448 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,744 mnist_classifier_MNISTClassifier 5zkvkijf f98a5d7c-2f78-482e-ab77-4ebbb1a84777 -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,744 mnist_classifier_MNISTClassifier 5zkvkijf a799d07b-e2d9-4817-86ba-0df2023254bd -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,744 mnist_classifier_MNISTClassifier 5zkvkijf 24aa7572-eaf2-4864-868d-0ec0444efcc8 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,744 mnist_classifier_MNISTClassifier 5zkvkijf 383f30cc-89de-46f8-9540-81ce1346a54e -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,745 mnist_classifier_MNISTClassifier 5zkvkijf e2ce01be-6fc0-4ffd-9b75-825bfd065508 -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,745 mnist_classifier_MNISTClassifier 5zkvkijf 6779ad8e-12b7-461b-8066-fdf6139eadf8 -- POST / 200 275.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,746 mnist_classifier_MNISTClassifier 5zkvkijf d3318287-0cb1-4ad9-9b7a-fb3105b2cfb9 -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,746 mnist_classifier_MNISTClassifier 5zkvkijf 393c1b29-e027-472a-8603-82730c7431b0 -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,809 mnist_classifier_MNISTClassifier 5zkvkijf 660b7c04-cb7d-43e7-839a-1a69ab9aba0e -- POST / 200 335.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,810 mnist_classifier_MNISTClassifier 5zkvkijf 84fa7b31-9ded-4d59-b97a-5901c07d4246 -- POST / 200 336.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,812 mnist_classifier_MNISTClassifier 5zkvkijf ea0a5123-249d-470d-a8c4-091d91fa8a93 -- POST / 200 337.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,813 mnist_classifier_MNISTClassifier 5zkvkijf beafcd23-2e30-4bf7-849c-d77a84b1d4d7 -- POST / 200 335.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,814 mnist_classifier_MNISTClassifier 5zkvkijf fab5d795-a851-45f5-8e76-ae748b67eafc -- POST / 200 335.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,816 mnist_classifier_MNISTClassifier 5zkvkijf c3d41d20-7192-4e89-98c4-0a203143c847 -- POST / 200 332.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,817 mnist_classifier_MNISTClassifier 5zkvkijf ebe8d2df-73b1-4f6f-92f8-4c264f7d887a -- POST / 200 332.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,818 mnist_classifier_MNISTClassifier 5zkvkijf 27ad59c9-f59a-4549-876f-8bb66090c780 -- POST / 200 333.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,819 mnist_classifier_MNISTClassifier 5zkvkijf 6672eacd-4302-44f0-84ae-55c73de147b3 -- POST / 200 288.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,819 mnist_classifier_MNISTClassifier 5zkvkijf ee164e3f-e590-4278-bc87-0f64bd75339c -- POST / 200 288.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,820 mnist_classifier_MNISTClassifier 5zkvkijf 3ac43974-9ce0-4640-b8aa-d173fa90587a -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,821 mnist_classifier_MNISTClassifier 5zkvkijf 73003b8b-9ec0-4170-a78b-1b0f1603f264 -- POST / 200 289.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,822 mnist_classifier_MNISTClassifier 5zkvkijf 25ef5e8f-ff3e-4ae0-8f60-1a2c5bc3deee -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,825 mnist_classifier_MNISTClassifier 5zkvkijf f7c1fd88-9fe9-40b6-a89f-c9d8304138a7 -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,826 mnist_classifier_MNISTClassifier 5zkvkijf 6f6e8542-395a-4d4d-9036-5bb3cfbd261b -- POST / 200 294.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,829 mnist_classifier_MNISTClassifier 5zkvkijf 415ec07a-e7dc-408c-aade-b1db04083bbc -- POST / 200 296.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,830 mnist_classifier_MNISTClassifier 5zkvkijf 78795a6b-baa5-445d-b8ae-5d83f8b94f96 -- POST / 200 296.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,831 mnist_classifier_MNISTClassifier 5zkvkijf d3fbd7fe-8390-4dd1-9b7c-3ea426a2c611 -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,832 mnist_classifier_MNISTClassifier 5zkvkijf 1ce1deef-ae49-414b-95ec-3b0f4fb1f11f -- POST / 200 297.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,833 mnist_classifier_MNISTClassifier 5zkvkijf f984592b-1913-488d-a294-8cfee66ca5ff -- POST / 200 297.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,834 mnist_classifier_MNISTClassifier 5zkvkijf 645ef029-72a3-409e-9e61-cf4f59433c3d -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,835 mnist_classifier_MNISTClassifier 5zkvkijf 761b0d82-5196-415c-bccb-e9709ac67271 -- POST / 200 297.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,837 mnist_classifier_MNISTClassifier 5zkvkijf e8707f15-2365-4e2a-8db9-5578775424a2 -- POST / 200 299.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,840 mnist_classifier_MNISTClassifier 5zkvkijf e2ed9a13-f8b9-4261-93c7-8dd7448bdc87 -- POST / 200 299.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,842 mnist_classifier_MNISTClassifier 5zkvkijf 10f60e1d-5a08-4ea2-adba-4d7909743517 -- POST / 200 301.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,842 mnist_classifier_MNISTClassifier 5zkvkijf 1b763018-8206-41a7-a055-02dd6bf76877 -- POST / 200 300.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,844 mnist_classifier_MNISTClassifier 5zkvkijf fc4d207f-9099-493f-b00d-020bdd209c6e -- POST / 200 302.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,844 mnist_classifier_MNISTClassifier 5zkvkijf 9febe7a6-143c-4032-9529-1071468d13fd -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,845 mnist_classifier_MNISTClassifier 5zkvkijf e7ef8cd3-cda0-4f23-ad7f-cfb527537e93 -- POST / 200 300.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,846 mnist_classifier_MNISTClassifier 5zkvkijf 3ff89ecb-0d63-463f-8636-c08c98b5e552 -- POST / 200 302.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,847 mnist_classifier_MNISTClassifier 5zkvkijf d5237424-53b5-4cb1-a99a-25e0f52fad08 -- POST / 200 300.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,849 mnist_classifier_MNISTClassifier 5zkvkijf e214ff8b-34d4-41b8-a5fc-8b1e263b34b8 -- POST / 200 302.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,850 mnist_classifier_MNISTClassifier 5zkvkijf d2e53d2f-fdaf-419f-9143-e74f7536dd06 -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,850 mnist_classifier_MNISTClassifier 5zkvkijf d72ff8cc-ea54-463f-b330-889aa11017c7 -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,851 mnist_classifier_MNISTClassifier 5zkvkijf 6b3c93b5-325c-47f5-8fa8-13c652f893bd -- POST / 200 301.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,852 mnist_classifier_MNISTClassifier 5zkvkijf 2b142a01-ca37-4f90-bdd4-132c9dc318d9 -- POST / 200 298.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,856 mnist_classifier_MNISTClassifier 5zkvkijf 790fd89f-c679-4be3-940f-2bca2105abf6 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,859 mnist_classifier_MNISTClassifier 5zkvkijf 2e1e5543-6f4e-4016-a480-455b19ac5c11 -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,863 mnist_classifier_MNISTClassifier 5zkvkijf 334425e1-2ee9-4b23-8c39-64df7099e2f4 -- POST / 200 305.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,864 mnist_classifier_MNISTClassifier 5zkvkijf 14e4e1f1-a65c-4e11-9ce7-da63adbb6771 -- POST / 200 305.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,865 mnist_classifier_MNISTClassifier 5zkvkijf e40c5bcd-7198-45e4-956c-3e9ff3e63e27 -- POST / 200 305.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,865 mnist_classifier_MNISTClassifier 5zkvkijf 1f67e3e6-5d79-4eee-bdc0-91770bcb1e64 -- POST / 200 305.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,866 mnist_classifier_MNISTClassifier 5zkvkijf 49c828d0-dc1d-46ed-9042-ec1051da592e -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,866 mnist_classifier_MNISTClassifier 5zkvkijf 14f1b02e-d3da-449b-8366-1ea780c08d51 -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,866 mnist_classifier_MNISTClassifier 5zkvkijf a2a00017-52e6-4ad3-bf2a-a073d2fc48dc -- POST / 200 302.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,866 mnist_classifier_MNISTClassifier 5zkvkijf 8200dffd-aabc-4ec1-b175-355bcef6632d -- POST / 200 302.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,866 mnist_classifier_MNISTClassifier 5zkvkijf d46651b6-2a22-4dfc-9fa6-fd4953c4932a -- POST / 200 300.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,867 mnist_classifier_MNISTClassifier 5zkvkijf 98dbe53a-6945-4d79-bc1c-2585dc5328e6 -- POST / 200 300.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,867 mnist_classifier_MNISTClassifier 5zkvkijf 7bda1d91-12a7-4823-9d65-255d17fea65f -- POST / 200 299.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,867 mnist_classifier_MNISTClassifier 5zkvkijf d29b5bfb-a010-4b4b-84fa-cdd10ae56c79 -- POST / 200 298.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,867 mnist_classifier_MNISTClassifier 5zkvkijf 9e87f3ec-877f-4170-b549-c7fe136ef0a8 -- POST / 200 297.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,867 mnist_classifier_MNISTClassifier 5zkvkijf 4553f51e-a0b7-41c7-a27a-f47074d3d780 -- POST / 200 297.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,868 mnist_classifier_MNISTClassifier 5zkvkijf b026f971-0286-46ca-8765-cc7f4d25ec46 -- POST / 200 296.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,868 mnist_classifier_MNISTClassifier 5zkvkijf 9bd550ba-df94-459c-b008-1a93fda1bf8b -- POST / 200 295.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,868 mnist_classifier_MNISTClassifier 5zkvkijf 2c6a50c2-7426-44bb-8760-02250f41bcb8 -- POST / 200 294.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,868 mnist_classifier_MNISTClassifier 5zkvkijf 75786b71-3d6f-4892-be16-49977f74d9da -- POST / 200 293.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,868 mnist_classifier_MNISTClassifier 5zkvkijf b8f58d2e-226c-4781-9bfc-adbd4f76f52d -- POST / 200 293.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,868 mnist_classifier_MNISTClassifier 5zkvkijf 5dabd648-b2f5-4471-b217-2fc5fabd01f2 -- POST / 200 292.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,869 mnist_classifier_MNISTClassifier 5zkvkijf dcfe45aa-cf2b-4fca-a833-accff85d7ad9 -- POST / 200 292.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,869 mnist_classifier_MNISTClassifier 5zkvkijf ae19045a-fd28-4a4d-ae5d-2b50d6cacc76 -- POST / 200 291.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,869 mnist_classifier_MNISTClassifier 5zkvkijf c03ecae2-b93b-4921-8177-14621a847dd1 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,869 mnist_classifier_MNISTClassifier 5zkvkijf 3339cd45-6805-419f-bf26-54ad67b50be2 -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,869 mnist_classifier_MNISTClassifier 5zkvkijf b588fc70-85cd-4b8c-86d1-39cea79501df -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf e51ac942-9497-46c4-9ae3-3fe0be2cc5cd -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf 1a438546-990d-481c-96bc-7623233d952e -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf 7715f2d5-5f94-4da8-ae0a-3cf882e76091 -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf 7aa68d58-c79f-4fa9-ab1c-223343771df6 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf 3f69efe8-9a26-4503-b5c1-b23c30dc3d57 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf eaef63d2-2825-40c6-96f6-f33e9d7a5e4e -- POST / 200 237.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,870 mnist_classifier_MNISTClassifier 5zkvkijf edb5b070-be6b-4672-8147-fe84c7ff656d -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,872 mnist_classifier_MNISTClassifier 5zkvkijf d73b1cf7-5b84-477b-9e4e-80852dfd508c -- POST / 200 237.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,872 mnist_classifier_MNISTClassifier 5zkvkijf 3753ca8d-1fd7-48ba-968b-a8d3ec1826f4 -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,872 mnist_classifier_MNISTClassifier 5zkvkijf 645ca941-dc89-406a-8174-90f49a25b2a9 -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,876 mnist_classifier_MNISTClassifier 5zkvkijf 0af49ab4-18d9-4454-b4a3-824e51822adb -- POST / 200 237.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,876 mnist_classifier_MNISTClassifier 5zkvkijf cd9309d9-1e87-4261-9618-225dec455c2f -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,876 mnist_classifier_MNISTClassifier 5zkvkijf 022cc8d4-b783-4dbd-9728-489e09138393 -- POST / 200 189.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,877 mnist_classifier_MNISTClassifier 5zkvkijf c8fc27f5-4320-4327-953e-3614774146d8 -- POST / 200 186.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,877 mnist_classifier_MNISTClassifier 5zkvkijf 563f1fca-2606-47d6-9756-092ad3792a71 -- POST / 200 185.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,877 mnist_classifier_MNISTClassifier 5zkvkijf 01e79dcd-0c21-49f5-98ba-4f5f88225b1d -- POST / 200 177.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,880 mnist_classifier_MNISTClassifier 5zkvkijf 853e980e-c18f-4d99-afe1-d9f4bcd985a6 -- POST / 200 178.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,881 mnist_classifier_MNISTClassifier 5zkvkijf da645a3e-36fb-4831-bd68-b3ec817cc340 -- POST / 200 177.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,883 mnist_classifier_MNISTClassifier 5zkvkijf ae589363-a770-420a-b00b-f2334b469075 -- POST / 200 135.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,885 mnist_classifier_MNISTClassifier 5zkvkijf 52a9b0e3-d6db-4018-a980-4ec7c7bd433c -- POST / 200 136.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,885 mnist_classifier_MNISTClassifier 5zkvkijf 9fa18b88-03d5-4b6e-87fa-e618e73c8c4a -- POST / 200 129.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,935 mnist_classifier_MNISTClassifier 5zkvkijf f03488c1-dceb-4b3d-b2b4-cabdcf764d47 -- POST / 200 173.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,965 mnist_classifier_MNISTClassifier 5zkvkijf 0cd366f5-de5b-451c-85fa-f2681a965a65 -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,966 mnist_classifier_MNISTClassifier 5zkvkijf e0d50d3d-aae1-4625-a4ab-a32ef6e28411 -- POST / 200 201.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,976 mnist_classifier_MNISTClassifier 5zkvkijf 41aebbae-461d-4c87-9238-6b494b7d2059 -- POST / 200 208.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,977 mnist_classifier_MNISTClassifier 5zkvkijf 5503611b-f895-4d61-91db-7ebe1541c634 -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,977 mnist_classifier_MNISTClassifier 5zkvkijf bce08b6a-9125-4065-a981-cf23d3ea5fbe -- POST / 200 208.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,977 mnist_classifier_MNISTClassifier 5zkvkijf 085f8a81-1dad-4c5d-b05c-8299bafc285e -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,977 mnist_classifier_MNISTClassifier 5zkvkijf ada2d548-4d5f-4f56-89ab-c547dd9d588f -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,978 mnist_classifier_MNISTClassifier 5zkvkijf c8bd34b5-f8a7-433f-b14f-68d7d0173dd9 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,978 mnist_classifier_MNISTClassifier 5zkvkijf e6edeb16-876c-4fd2-91b3-16e775af1fd4 -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,978 mnist_classifier_MNISTClassifier 5zkvkijf fc96e905-5f84-4d5e-81bf-e10b8fdc3bb0 -- POST / 200 207.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,978 mnist_classifier_MNISTClassifier 5zkvkijf 4d582ec6-7356-435d-976e-400401df3f3e -- POST / 200 207.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,978 mnist_classifier_MNISTClassifier 5zkvkijf b1fb2ff8-731d-4cfc-959c-5ea85ad0e0e8 -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,978 mnist_classifier_MNISTClassifier 5zkvkijf e7b45ec1-b9fd-4619-8771-a719669c1392 -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,979 mnist_classifier_MNISTClassifier 5zkvkijf 3918eb84-5b44-4dd4-b3ee-4bc34e2cfe59 -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,979 mnist_classifier_MNISTClassifier 5zkvkijf 29b786e9-fbc4-45bc-b62a-cd4d157243ed -- POST / 200 206.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:07:59,979 mnist_classifier_MNISTClassifier 5zkvkijf 02586dad-d055-41c7-bd2f-a1fcd4bc0ed9 -- POST / 200 162.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,190 mnist_classifier_MNISTClassifier 5zkvkijf 56ee8016-69cf-463e-9be4-a3ebcdd50abe -- POST / 200 368.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,191 mnist_classifier_MNISTClassifier 5zkvkijf 3c56fc16-b6d9-4528-be03-074fa2cb52c7 -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,195 mnist_classifier_MNISTClassifier 5zkvkijf 570adbc8-a8ce-4113-b46f-2ef79b65bb94 -- POST / 200 346.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,196 mnist_classifier_MNISTClassifier 5zkvkijf c1ca479d-e125-4e1c-ab40-f38724613292 -- POST / 200 334.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,197 mnist_classifier_MNISTClassifier 5zkvkijf 9f5947d9-579f-4775-8ae0-b960595f3f1e -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,305 mnist_classifier_MNISTClassifier 5zkvkijf 1c88027a-93f0-4c58-b48d-e8785c056f45 -- POST / 200 418.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,305 mnist_classifier_MNISTClassifier 5zkvkijf 159bbd74-8d6a-4883-adaa-02125c16bb32 -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,306 mnist_classifier_MNISTClassifier 5zkvkijf d36a6c9f-5cfe-4e33-acfc-e4fdd610df4d -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,306 mnist_classifier_MNISTClassifier 5zkvkijf 74d51f32-06bc-4c86-9b41-06ed33311878 -- POST / 200 417.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,307 mnist_classifier_MNISTClassifier 5zkvkijf 6cc8eced-4ced-4b18-ad99-bfb33af4bac5 -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,309 mnist_classifier_MNISTClassifier 5zkvkijf d7e157d2-b4e7-4309-9162-6edf53030309 -- POST / 200 410.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,309 mnist_classifier_MNISTClassifier 5zkvkijf a758c780-ed4a-47c3-89aa-2cf6f4ea4b91 -- POST / 200 405.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,309 mnist_classifier_MNISTClassifier 5zkvkijf 4daec56c-156f-44a4-8fa5-937ef0f95335 -- POST / 200 410.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,310 mnist_classifier_MNISTClassifier 5zkvkijf 913b6f46-079f-4042-90a6-9f78095f11d9 -- POST / 200 407.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,310 mnist_classifier_MNISTClassifier 5zkvkijf 93fda2b0-80d0-4f5e-8dd8-9ff6b625d21b -- POST / 200 406.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,311 mnist_classifier_MNISTClassifier 5zkvkijf c5415641-6b81-4c8d-8f25-ad998cdb71dc -- POST / 200 401.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,311 mnist_classifier_MNISTClassifier 5zkvkijf 68758774-d303-4474-aa85-9d5a13e56179 -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,313 mnist_classifier_MNISTClassifier 5zkvkijf 58958ffa-dd22-4f0c-aa93-363d0452ea67 -- POST / 200 406.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,314 mnist_classifier_MNISTClassifier 5zkvkijf 372f9cf7-aed2-43cc-b88f-aafea4697284 -- POST / 200 404.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,314 mnist_classifier_MNISTClassifier 5zkvkijf a32729ef-aed0-423e-9a2c-5c1d4b95cbca -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,315 mnist_classifier_MNISTClassifier 5zkvkijf ceb6660f-4bc0-4210-8059-07bcc56c8a04 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,315 mnist_classifier_MNISTClassifier 5zkvkijf 70445c6d-76ee-419c-8d02-f8a76ab0eed1 -- POST / 200 402.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,316 mnist_classifier_MNISTClassifier 5zkvkijf 9893453b-46cb-4d8e-9c3c-c68964519d1b -- POST / 200 402.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,316 mnist_classifier_MNISTClassifier 5zkvkijf ed9a9519-aaa7-45a6-ba32-6a52903e3aa6 -- POST / 200 400.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,316 mnist_classifier_MNISTClassifier 5zkvkijf 3f5227fd-78b0-4b4a-b2c6-702ff4c09222 -- POST / 200 400.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,317 mnist_classifier_MNISTClassifier 5zkvkijf f77ba079-6300-4900-ba4e-afcbc0f5f074 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,317 mnist_classifier_MNISTClassifier 5zkvkijf 9977d71e-1658-43b2-a0c8-657d38688bac -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,317 mnist_classifier_MNISTClassifier 5zkvkijf f1e709a5-c330-46b9-872f-e360fcb20098 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,318 mnist_classifier_MNISTClassifier 5zkvkijf 5baa18f7-ba49-4a31-9cc6-5d8d115befd5 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,318 mnist_classifier_MNISTClassifier 5zkvkijf 081bd01d-105f-4226-8217-335a3c929922 -- POST / 200 400.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,318 mnist_classifier_MNISTClassifier 5zkvkijf 83fd6880-f58d-481c-ae72-867ec4d7629a -- POST / 200 400.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,319 mnist_classifier_MNISTClassifier 5zkvkijf b8ac57a4-1a73-4463-bbc7-90be6f0c1243 -- POST / 200 400.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,319 mnist_classifier_MNISTClassifier 5zkvkijf 62c837b9-91a7-47c9-ab4d-c39744718a17 -- POST / 200 400.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,319 mnist_classifier_MNISTClassifier 5zkvkijf 580dd48c-73da-4551-ba3e-ba8289715f55 -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,320 mnist_classifier_MNISTClassifier 5zkvkijf c4b7c077-6817-43b0-a754-3bc2634211d7 -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,320 mnist_classifier_MNISTClassifier 5zkvkijf 6af9ca1d-637c-496d-a54a-4354009b860e -- POST / 200 356.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,320 mnist_classifier_MNISTClassifier 5zkvkijf c4223b45-3c83-4023-b7d8-3f72e86bca84 -- POST / 200 340.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,321 mnist_classifier_MNISTClassifier 5zkvkijf d7c4317c-5266-4117-92d9-bd2f32f89f1c -- POST / 200 341.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,321 mnist_classifier_MNISTClassifier 5zkvkijf 09e14f44-629a-4e3f-87b9-3b1272c97b45 -- POST / 200 341.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,321 mnist_classifier_MNISTClassifier 5zkvkijf 200e4a62-3bbd-439c-98f6-8fc17496966c -- POST / 200 341.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,322 mnist_classifier_MNISTClassifier 5zkvkijf 0e27ff6b-dabd-4268-93bd-8f913cad0d45 -- POST / 200 341.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,322 mnist_classifier_MNISTClassifier 5zkvkijf 5d9a3d23-daf1-4185-8e49-2819fa5ed954 -- POST / 200 341.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,322 mnist_classifier_MNISTClassifier 5zkvkijf 2e821dfc-430b-4afe-a014-a90a32ff0a69 -- POST / 200 341.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,323 mnist_classifier_MNISTClassifier 5zkvkijf c8d05d12-3cc1-4e1e-a1b5-748a4be1e820 -- POST / 200 342.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,323 mnist_classifier_MNISTClassifier 5zkvkijf 9d4db42c-8b6d-4838-abfc-283587bb55e7 -- POST / 200 339.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,324 mnist_classifier_MNISTClassifier 5zkvkijf cceb3ef8-d753-4d72-a957-a83a910b24f2 -- POST / 200 339.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,326 mnist_classifier_MNISTClassifier 5zkvkijf efc7febc-7b9a-44c9-97ec-922e154f6d00 -- POST / 200 340.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,326 mnist_classifier_MNISTClassifier 5zkvkijf 47b76432-2f51-411e-9780-76b1ca59d8cb -- POST / 200 341.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,329 mnist_classifier_MNISTClassifier 5zkvkijf 31f5c57f-e0b3-457c-a990-0e1c90828ee1 -- POST / 200 343.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,334 mnist_classifier_MNISTClassifier 5zkvkijf 171ea995-58ca-49e4-bcb2-cc72c2adb680 -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,334 mnist_classifier_MNISTClassifier 5zkvkijf 4bc76dac-25a7-46be-93ba-953f04a4fe72 -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,337 mnist_classifier_MNISTClassifier 5zkvkijf afd669f7-1e7d-498e-822d-8d9e899628d3 -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,337 mnist_classifier_MNISTClassifier 5zkvkijf 3db00b09-2ed4-4e35-9977-a9f020019781 -- POST / 200 204.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,337 mnist_classifier_MNISTClassifier 5zkvkijf e7ac6bee-ebf6-4130-9e3b-02c30781c407 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,338 mnist_classifier_MNISTClassifier 5zkvkijf 29277922-092e-4683-9499-82cc13146bba -- POST / 200 203.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,341 mnist_classifier_MNISTClassifier 5zkvkijf 8484d5e7-f79e-42e2-97e5-87562f9f579e -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,342 mnist_classifier_MNISTClassifier 5zkvkijf 9242609d-b2c6-4d4a-b85c-490dc92ec019 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,342 mnist_classifier_MNISTClassifier 5zkvkijf e4410d66-02a6-4b8d-9554-494e03595874 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,342 mnist_classifier_MNISTClassifier 5zkvkijf 1ad782a8-604f-4a37-98ac-bbe6b5c4116a -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,342 mnist_classifier_MNISTClassifier 5zkvkijf 97d1b8bc-5bcf-44f0-b816-654070077652 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf 6a4f78ed-75e6-4326-8aef-86daf03cfefa -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf 48578fe2-a75a-4847-97d9-2d65aa38f140 -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf 27c0d613-5ce1-4344-9ba7-a61b3705af24 -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf 16076f9d-b773-4486-8ec1-e40fe62c6900 -- POST / 200 202.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf f7961eee-4a3c-418d-b75b-dbc6bd50c220 -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf c8ef0610-820a-45d7-a590-9d70db84c539 -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,343 mnist_classifier_MNISTClassifier 5zkvkijf 4106078a-5c13-4068-92c2-e203663688ad -- POST / 200 201.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,344 mnist_classifier_MNISTClassifier 5zkvkijf 1b37a6f4-aaa4-41ee-b0ec-9f287c30137b -- POST / 200 200.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,344 mnist_classifier_MNISTClassifier 5zkvkijf 5aa01367-ef27-4606-bd1d-bfaf040ffb9e -- POST / 200 199.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,344 mnist_classifier_MNISTClassifier 5zkvkijf ba6f2dec-ad76-4a0a-9890-098f8b3ea6da -- POST / 200 199.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,344 mnist_classifier_MNISTClassifier 5zkvkijf 3a5bdc98-a51e-4a2d-aeb3-c3ae894bc3d5 -- POST / 200 199.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,344 mnist_classifier_MNISTClassifier 5zkvkijf 0fc416cf-e525-45bc-8db5-161055cd87b0 -- POST / 200 196.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,345 mnist_classifier_MNISTClassifier 5zkvkijf 5db92fe9-0eb3-4b0e-842a-3acdd6a45d5c -- POST / 200 198.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,345 mnist_classifier_MNISTClassifier 5zkvkijf 6085d134-ed0b-4d92-a456-6d1e93f19c9d -- POST / 200 199.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,346 mnist_classifier_MNISTClassifier 5zkvkijf 9946a3d4-82c0-4ba3-9bd2-27af80ed744a -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,346 mnist_classifier_MNISTClassifier 5zkvkijf c7bf7838-4650-4378-b39f-6cde9a4c60c8 -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,346 mnist_classifier_MNISTClassifier 5zkvkijf 7cde171c-d058-4b04-ae62-ec44f9d46250 -- POST / 200 194.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,346 mnist_classifier_MNISTClassifier 5zkvkijf 21d4b681-de7a-4e3e-bae2-01fa4728b99b -- POST / 200 194.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,346 mnist_classifier_MNISTClassifier 5zkvkijf 80c1776f-248d-4388-b222-1dd893965cf2 -- POST / 200 194.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,346 mnist_classifier_MNISTClassifier 5zkvkijf 475e6885-2461-4532-ba74-bea859a0173a -- POST / 200 193.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,347 mnist_classifier_MNISTClassifier 5zkvkijf ff6c4b7f-b605-4126-b50a-fa13ac80a8be -- POST / 200 193.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,348 mnist_classifier_MNISTClassifier 5zkvkijf f75e0c96-e512-4e5c-96b3-844de054d131 -- POST / 200 194.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,348 mnist_classifier_MNISTClassifier 5zkvkijf 0ee4c33a-ff27-4891-8bbc-4d2b73a901e9 -- POST / 200 194.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,350 mnist_classifier_MNISTClassifier 5zkvkijf 49dbb8c4-80aa-483c-8350-5f0e71233709 -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,351 mnist_classifier_MNISTClassifier 5zkvkijf c9ed6d0a-89eb-4c71-af16-7c2c87f787ac -- POST / 200 196.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,353 mnist_classifier_MNISTClassifier 5zkvkijf d0bb2950-bafb-45ee-ac07-1ed1fb136259 -- POST / 200 194.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,353 mnist_classifier_MNISTClassifier 5zkvkijf f2775437-9f09-48df-ba3e-1bb0c65de77d -- POST / 200 195.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,362 mnist_classifier_MNISTClassifier 5zkvkijf 4ce5df32-6f93-488d-9bee-5b4ee2ee89f5 -- POST / 200 202.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,362 mnist_classifier_MNISTClassifier 5zkvkijf 4771afc2-9eb8-4034-9845-b518676d1538 -- POST / 200 201.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,364 mnist_classifier_MNISTClassifier 5zkvkijf 9a2856c5-5ffd-4270-81e8-460afcc49cd6 -- POST / 200 203.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,366 mnist_classifier_MNISTClassifier 5zkvkijf 8f194d95-1a4c-434a-801a-0e3ce7eadc29 -- POST / 200 204.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,366 mnist_classifier_MNISTClassifier 5zkvkijf c1c89783-dfe9-4fc1-8e63-0662be0e8b9a -- POST / 200 204.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,367 mnist_classifier_MNISTClassifier 5zkvkijf 12279438-eeaa-4a55-82aa-53d8e8bc4aed -- POST / 200 204.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,368 mnist_classifier_MNISTClassifier 5zkvkijf 9c8d5a32-eb10-4573-854a-97e88c260b6d -- POST / 200 205.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,369 mnist_classifier_MNISTClassifier 5zkvkijf da8d325c-db90-47ac-805a-e49b8951fb53 -- POST / 200 205.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,370 mnist_classifier_MNISTClassifier 5zkvkijf 71628c74-2791-47eb-bf4d-44376be40410 -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,370 mnist_classifier_MNISTClassifier 5zkvkijf f5bfc387-1421-4a3b-9f2d-736344c07148 -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,372 mnist_classifier_MNISTClassifier 5zkvkijf f3f3c188-0604-4657-862e-05f1d503b721 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,373 mnist_classifier_MNISTClassifier 5zkvkijf 6e942888-def8-48a5-9119-7056a698710a -- POST / 200 207.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,426 mnist_classifier_MNISTClassifier 5zkvkijf 37d804cd-e56d-4a2b-bb34-1aface9ec5dd -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,447 mnist_classifier_MNISTClassifier 5zkvkijf 42acb904-9ae5-4daa-b10f-e1b53b2aa86b -- POST / 200 235.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,447 mnist_classifier_MNISTClassifier 5zkvkijf b0e41d87-c5b0-4271-9ee6-c6325f863e30 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,451 mnist_classifier_MNISTClassifier 5zkvkijf 69c81002-7ea2-48d1-add0-79611ce094c1 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,452 mnist_classifier_MNISTClassifier 5zkvkijf 859ba4f2-bfe5-4ebb-97ab-1b0e75c5e054 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,453 mnist_classifier_MNISTClassifier 5zkvkijf f24213fa-c3e0-44aa-85d7-4d66876739f2 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,588 mnist_classifier_MNISTClassifier 5zkvkijf 1d770735-debc-4609-9981-d1775a96555b -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,590 mnist_classifier_MNISTClassifier 5zkvkijf e9691029-cd74-4b51-8ef7-f4a1f6e55c5e -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,590 mnist_classifier_MNISTClassifier 5zkvkijf 5283485a-66c7-4e54-b58b-d09c8d1980d4 -- POST / 200 212.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,590 mnist_classifier_MNISTClassifier 5zkvkijf 17e0a49d-e140-45b4-b32e-64222a4546a9 -- POST / 200 207.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,593 mnist_classifier_MNISTClassifier 5zkvkijf 6aa5e413-7ebe-443a-9217-268450079077 -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,594 mnist_classifier_MNISTClassifier 5zkvkijf eef15182-12af-48d7-991f-2cd6895db5fc -- POST / 200 207.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,600 mnist_classifier_MNISTClassifier 5zkvkijf 2e424580-8841-487f-9552-a473be9c05bd -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,600 mnist_classifier_MNISTClassifier 5zkvkijf 7e05a206-5dcd-4cfb-be90-7abdc7ef4be8 -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,601 mnist_classifier_MNISTClassifier 5zkvkijf bb51591b-5fd2-414b-89a3-c0694bd5e99e -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,736 mnist_classifier_MNISTClassifier 5zkvkijf ee091477-4189-4f8b-9e6f-e177c15692cf -- POST / 200 346.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,736 mnist_classifier_MNISTClassifier 5zkvkijf 2f36bc67-1391-4d9b-b500-c7bfb20cbbc5 -- POST / 200 327.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,737 mnist_classifier_MNISTClassifier 5zkvkijf c605674a-8464-4f1e-bc6f-f6d3917a51b7 -- POST / 200 347.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,738 mnist_classifier_MNISTClassifier 5zkvkijf 64e1fbf0-8afc-4413-846b-945f9c29c446 -- POST / 200 347.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,738 mnist_classifier_MNISTClassifier 5zkvkijf a5b6974a-2f25-4cd5-b144-06574905d8e8 -- POST / 200 347.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,739 mnist_classifier_MNISTClassifier 5zkvkijf f233816c-4de3-4d08-a817-f21c70a62bde -- POST / 200 347.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,739 mnist_classifier_MNISTClassifier 5zkvkijf 38aad8c8-a751-466f-b679-70cc6e47984e -- POST / 200 347.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,740 mnist_classifier_MNISTClassifier 5zkvkijf eb894d08-6967-4099-9778-9701867ed24c -- POST / 200 347.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,740 mnist_classifier_MNISTClassifier 5zkvkijf 8e43a554-cc2f-4885-b726-e68bb0194cb2 -- POST / 200 346.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,741 mnist_classifier_MNISTClassifier 5zkvkijf c77996b2-4c2f-42d1-ae8f-8523f5c275ab -- POST / 200 346.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,742 mnist_classifier_MNISTClassifier 5zkvkijf a762b0cb-4bf5-462e-883d-a454394da8b0 -- POST / 200 346.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,742 mnist_classifier_MNISTClassifier 5zkvkijf 06b3d673-ee53-45b6-af41-97586df9ff56 -- POST / 200 345.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,742 mnist_classifier_MNISTClassifier 5zkvkijf 45263027-5a0b-45c5-aa08-b56d82e18668 -- POST / 200 344.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,743 mnist_classifier_MNISTClassifier 5zkvkijf 2146e190-84a7-48ba-937c-72d5a4a73f2e -- POST / 200 345.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,743 mnist_classifier_MNISTClassifier 5zkvkijf eddefcb7-5bb5-4aff-8704-bbb7c5130b98 -- POST / 200 345.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,744 mnist_classifier_MNISTClassifier 5zkvkijf 8a515a5a-f391-41ff-9087-fbb281498fe2 -- POST / 200 344.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,744 mnist_classifier_MNISTClassifier 5zkvkijf 97f28a57-10be-43ab-8e90-c7a9314b2b88 -- POST / 200 344.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,745 mnist_classifier_MNISTClassifier 5zkvkijf 4d588a1c-e7ab-472f-aa30-6b1170622160 -- POST / 200 344.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,745 mnist_classifier_MNISTClassifier 5zkvkijf db24becb-1d7d-4a1c-b056-cf77bf426a87 -- POST / 200 344.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,746 mnist_classifier_MNISTClassifier 5zkvkijf 473380aa-71ee-4bb2-bcea-e73b37e479ea -- POST / 200 345.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,747 mnist_classifier_MNISTClassifier 5zkvkijf fa6902eb-06f6-41aa-b6bb-3530f7234a7f -- POST / 200 345.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,747 mnist_classifier_MNISTClassifier 5zkvkijf 8fdd8f8e-e632-4c1d-a904-e7508cd68658 -- POST / 200 344.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,748 mnist_classifier_MNISTClassifier 5zkvkijf 3736a539-b612-48f0-8ffa-109801f2a0fc -- POST / 200 343.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,749 mnist_classifier_MNISTClassifier 5zkvkijf d3449992-fbe0-43a9-9f2d-6aa103c580b1 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,749 mnist_classifier_MNISTClassifier 5zkvkijf fd0e0c01-a04d-44b3-af79-d73358975467 -- POST / 200 343.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,750 mnist_classifier_MNISTClassifier 5zkvkijf 9fb3b2ee-c07d-4303-bb3b-eb887ca9cab6 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,750 mnist_classifier_MNISTClassifier 5zkvkijf 2828f017-e067-4108-a166-bbabd03457c3 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,756 mnist_classifier_MNISTClassifier 5zkvkijf b72fac43-2094-45bc-a236-e9a27e430d56 -- POST / 200 349.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,762 mnist_classifier_MNISTClassifier 5zkvkijf 45836f03-86db-4b22-bf90-0a7c5011baee -- POST / 200 355.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,764 mnist_classifier_MNISTClassifier 5zkvkijf a60c9c4e-9886-483a-ac0b-4133e1ade93b -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,783 mnist_classifier_MNISTClassifier 5zkvkijf a3d063b0-fc46-4183-9503-801da8a39e9b -- POST / 200 292.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,784 mnist_classifier_MNISTClassifier 5zkvkijf 29a5ad86-2857-4226-91f5-7ac3681ff685 -- POST / 200 292.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,785 mnist_classifier_MNISTClassifier 5zkvkijf 3774a5ea-8597-4a43-8f9c-f051a9b601f8 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,785 mnist_classifier_MNISTClassifier 5zkvkijf 5523b115-9294-4a74-9630-4a6aafcd7e9f -- POST / 200 291.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,785 mnist_classifier_MNISTClassifier 5zkvkijf 08ab64a8-3eda-4e49-8c92-8b730f7dd707 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,786 mnist_classifier_MNISTClassifier 5zkvkijf 348a2c0f-27d1-4ee3-b05a-a8fc72c2d396 -- POST / 200 292.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,787 mnist_classifier_MNISTClassifier 5zkvkijf d4f0f729-ab6f-42e8-8a47-12a88d1ab3a8 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,787 mnist_classifier_MNISTClassifier 5zkvkijf 3e551980-767c-43eb-a07f-f7e5a5ee8060 -- POST / 200 292.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,788 mnist_classifier_MNISTClassifier 5zkvkijf 3eaf62c8-ddc9-4c9b-8360-d693e8494e22 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,788 mnist_classifier_MNISTClassifier 5zkvkijf 498b6d8a-0c17-4981-a8a2-c2086710c0a2 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,788 mnist_classifier_MNISTClassifier 5zkvkijf 84a8f8ac-235e-48cb-abdc-daca2acf09bc -- POST / 200 275.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,789 mnist_classifier_MNISTClassifier 5zkvkijf 4cf54121-834d-41a5-8f96-e22b21c1a320 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf 45f2e53f-fff9-4400-b5fd-f00edcdbe45c -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf 2c4f6483-e3e0-4d40-94f4-b1ce5910eeaf -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf ef76b35d-f72e-4b68-a82d-a64216598dff -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf d27a92c7-779e-42cf-9aeb-353880194d8d -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf 5f75503b-c73b-47f6-b6c3-ba53e9133675 -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf b0766836-4e9d-400e-a798-bb1530402709 -- POST / 200 225.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,790 mnist_classifier_MNISTClassifier 5zkvkijf 9e878163-c30c-42ba-974b-ec6270cfe82b -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,791 mnist_classifier_MNISTClassifier 5zkvkijf 5203e6dc-a4f4-4c27-8b9b-b8b1d37694f6 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,791 mnist_classifier_MNISTClassifier 5zkvkijf 13992f19-88d0-4746-a8c0-66fa9f1ba6b0 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,791 mnist_classifier_MNISTClassifier 5zkvkijf bad0f4d7-85f4-43b5-8749-b6d8c7b9bca5 -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,791 mnist_classifier_MNISTClassifier 5zkvkijf 1cd450a1-b174-4b58-81d2-8f564b7059e3 -- POST / 200 176.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,792 mnist_classifier_MNISTClassifier 5zkvkijf a39ce6ec-a1a7-471c-a1ac-73ebc81bb019 -- POST / 200 175.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,792 mnist_classifier_MNISTClassifier 5zkvkijf 0edcfb14-6f6f-49a2-9ac1-a11a4cd5ed47 -- POST / 200 174.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,795 mnist_classifier_MNISTClassifier 5zkvkijf 08f7fd3d-374d-4333-a031-2be41310ddc6 -- POST / 200 171.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,796 mnist_classifier_MNISTClassifier 5zkvkijf 1e25b554-ac59-4f48-bcb9-16d12445a0f1 -- POST / 200 170.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,796 mnist_classifier_MNISTClassifier 5zkvkijf 73f1cb88-eeb5-45f2-b223-35574500c66e -- POST / 200 170.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,796 mnist_classifier_MNISTClassifier 5zkvkijf b2544341-1929-4332-b770-eb1f9897e3db -- POST / 200 170.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,797 mnist_classifier_MNISTClassifier 5zkvkijf dc3ab20b-7773-4f42-a2e8-13958657f14c -- POST / 200 169.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,797 mnist_classifier_MNISTClassifier 5zkvkijf 408974c4-184c-4f21-b4aa-e6795f1547bd -- POST / 200 169.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,798 mnist_classifier_MNISTClassifier 5zkvkijf 6bc8d97e-71cb-4f6e-995b-b53f1582e7cb -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,798 mnist_classifier_MNISTClassifier 5zkvkijf a0997b9d-a1c2-4ebe-8dab-02a9ad68a53e -- POST / 200 389.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,799 mnist_classifier_MNISTClassifier 5zkvkijf 9fa0959f-df2d-4caa-a062-026962fd8f3a -- POST / 200 334.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,800 mnist_classifier_MNISTClassifier 5zkvkijf 5bdf8dd9-2e38-4f9e-ba07-6c96b96f0ec3 -- POST / 200 334.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,800 mnist_classifier_MNISTClassifier 5zkvkijf 8a4ab4ba-974a-4c15-90e4-2312d62f2239 -- POST / 200 334.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,800 mnist_classifier_MNISTClassifier 5zkvkijf 5c992d60-b194-4240-aa85-bf2038aa6579 -- POST / 200 326.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,801 mnist_classifier_MNISTClassifier 5zkvkijf c387688e-374e-469d-82e7-5b33e14bc5c8 -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,801 mnist_classifier_MNISTClassifier 5zkvkijf 899f47ef-8d90-4694-ba83-b7799ffe984a -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,801 mnist_classifier_MNISTClassifier 5zkvkijf 10d78307-a19b-4605-ba37-bd9bda392ca6 -- POST / 200 320.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,802 mnist_classifier_MNISTClassifier 5zkvkijf 9ddbc790-583a-49ce-bb91-d6ba1298f963 -- POST / 200 319.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,802 mnist_classifier_MNISTClassifier 5zkvkijf 95ac77b1-d8f3-4227-ae21-32b48f966add -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,802 mnist_classifier_MNISTClassifier 5zkvkijf 436d8d59-5463-4de2-89f2-bcf6df1f2c4a -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,802 mnist_classifier_MNISTClassifier 5zkvkijf 298479c8-1b67-45c0-a7b9-0e6eb9bb3c65 -- POST / 200 345.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,803 mnist_classifier_MNISTClassifier 5zkvkijf e951828b-0f8a-472a-b735-bd3965f6f3be -- POST / 200 345.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,803 mnist_classifier_MNISTClassifier 5zkvkijf 1835ef35-0076-4772-9339-426f96e9a3c0 -- POST / 200 346.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,803 mnist_classifier_MNISTClassifier 5zkvkijf 93fa459e-f30e-4dcd-90ad-083e56086e4c -- POST / 200 346.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,804 mnist_classifier_MNISTClassifier 5zkvkijf b7271e0e-4d22-4ca7-9e69-d3e0eec6b3af -- POST / 200 346.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,804 mnist_classifier_MNISTClassifier 5zkvkijf ec48e820-67c8-48f8-bb09-e2066e0c996d -- POST / 200 346.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,804 mnist_classifier_MNISTClassifier 5zkvkijf b9dafb7d-7e66-4363-aafb-7a8f54b6e8cf -- POST / 200 346.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,804 mnist_classifier_MNISTClassifier 5zkvkijf a733cf10-7365-49d3-8090-4f0880924c37 -- POST / 200 346.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,805 mnist_classifier_MNISTClassifier 5zkvkijf d9ad049b-ad53-43b0-8e99-b06afd4c08bd -- POST / 200 346.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,805 mnist_classifier_MNISTClassifier 5zkvkijf 537c697b-7ba5-45b4-9d0c-ca95a6f491f1 -- POST / 200 346.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,805 mnist_classifier_MNISTClassifier 5zkvkijf 14978a94-abff-4650-9bc6-8133f714bcf6 -- POST / 200 346.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,806 mnist_classifier_MNISTClassifier 5zkvkijf 5a8b4dd2-d6db-416c-9113-a05555e2b36c -- POST / 200 346.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,806 mnist_classifier_MNISTClassifier 5zkvkijf d1ebe6f2-a112-4741-9358-1900f733c769 -- POST / 200 347.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,806 mnist_classifier_MNISTClassifier 5zkvkijf 4290c14f-3b1c-40d1-84a2-6a9c41eb5d34 -- POST / 200 347.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,807 mnist_classifier_MNISTClassifier 5zkvkijf b38c9862-3d7c-4f95-af4f-093563b27c3e -- POST / 200 347.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,807 mnist_classifier_MNISTClassifier 5zkvkijf 466a75c3-2adb-4773-bfd8-57489f4b90a6 -- POST / 200 347.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,807 mnist_classifier_MNISTClassifier 5zkvkijf 864a8cf6-6ed2-495b-bfdf-ab3299b431cf -- POST / 200 346.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,807 mnist_classifier_MNISTClassifier 5zkvkijf 6d58d82b-a751-4c79-8410-590358c32063 -- POST / 200 345.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,808 mnist_classifier_MNISTClassifier 5zkvkijf d017b971-91ed-4b20-87e4-717f62893410 -- POST / 200 345.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,808 mnist_classifier_MNISTClassifier 5zkvkijf a411effa-3c35-41e8-9479-150c45cd1c90 -- POST / 200 345.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,808 mnist_classifier_MNISTClassifier 5zkvkijf 080ea186-2297-4596-abb7-c8517088eff4 -- POST / 200 343.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,809 mnist_classifier_MNISTClassifier 5zkvkijf 03912761-2141-45dc-a321-b080c4d80f00 -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,809 mnist_classifier_MNISTClassifier 5zkvkijf a3243fbd-05a6-430a-968e-f286eadb37da -- POST / 200 326.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,809 mnist_classifier_MNISTClassifier 5zkvkijf 37bf59a5-5865-4b08-a395-869f93673191 -- POST / 200 323.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,809 mnist_classifier_MNISTClassifier 5zkvkijf a4d541cb-8561-47ad-b4f6-f54cf4790e97 -- POST / 200 322.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,809 mnist_classifier_MNISTClassifier 5zkvkijf 9bc3c778-c758-457e-b9d6-a1c9fa6fe4bd -- POST / 200 322.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:00,810 mnist_classifier_MNISTClassifier 5zkvkijf 17d138ca-52f4-40a3-aea7-a43f1df79c60 -- POST / 200 322.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,094 mnist_classifier_MNISTClassifier 5zkvkijf 7a0f3c59-8b30-4104-90dc-47b10573ddc2 -- POST / 200 351.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,245 mnist_classifier_MNISTClassifier 5zkvkijf 0ca568b5-3ec6-488e-b284-59a8a62c1d30 -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,246 mnist_classifier_MNISTClassifier 5zkvkijf 3481306b-5925-4956-af86-5f7bd3b8559e -- POST / 200 430.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,246 mnist_classifier_MNISTClassifier 5zkvkijf 6a943d0c-9458-4748-99b8-d068d9105dd5 -- POST / 200 430.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,247 mnist_classifier_MNISTClassifier 5zkvkijf 2c8df1fb-d247-4206-aee5-091e34277a00 -- POST / 200 423.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,247 mnist_classifier_MNISTClassifier 5zkvkijf e0c234a3-6578-467b-b385-2717dbe87c5b -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,248 mnist_classifier_MNISTClassifier 5zkvkijf 9a3c6808-92e2-46ce-bbf3-0b8c6d749d3d -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,249 mnist_classifier_MNISTClassifier 5zkvkijf 80a5801e-8974-448a-8573-bf5e6500a1b4 -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,250 mnist_classifier_MNISTClassifier 5zkvkijf ede7e256-a800-4668-9ab3-5aa791757ca3 -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,250 mnist_classifier_MNISTClassifier 5zkvkijf d59f29c3-a910-4be7-b98d-20b5051dcfc0 -- POST / 200 432.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,253 mnist_classifier_MNISTClassifier 5zkvkijf ff2ea82b-e7b9-4dcd-9b44-f8243e327a6b -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,254 mnist_classifier_MNISTClassifier 5zkvkijf b71f20ed-606b-4e1f-8473-2553dc77b803 -- POST / 200 436.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,254 mnist_classifier_MNISTClassifier 5zkvkijf 91275eea-fdcb-4465-9992-6ff64d07f2f9 -- POST / 200 436.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,255 mnist_classifier_MNISTClassifier 5zkvkijf fe49b686-353b-4cf8-aa9b-7516c00ed7b4 -- POST / 200 436.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,255 mnist_classifier_MNISTClassifier 5zkvkijf 0d03a1a2-e270-401d-8d48-a9cc8b1a8a1a -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,255 mnist_classifier_MNISTClassifier 5zkvkijf 448773ee-97bd-413b-b6a6-66f690d53d88 -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,256 mnist_classifier_MNISTClassifier 5zkvkijf 39cc8561-8dd6-4f1a-adc7-918c4bf98147 -- POST / 200 436.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,256 mnist_classifier_MNISTClassifier 5zkvkijf b2aff77e-6211-4a8f-9d91-219caacd7c55 -- POST / 200 436.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,257 mnist_classifier_MNISTClassifier 5zkvkijf e542afc5-f585-4e2f-b5c7-5f0b19c9443c -- POST / 200 436.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,257 mnist_classifier_MNISTClassifier 5zkvkijf 9ade552b-dda0-40fd-8c57-f3c8c9516b42 -- POST / 200 435.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,257 mnist_classifier_MNISTClassifier 5zkvkijf af46785b-8fa6-46f3-92da-53e837c6dd02 -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,257 mnist_classifier_MNISTClassifier 5zkvkijf 6b803d5a-f061-4672-b1b1-a0f230ff4c6a -- POST / 200 433.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,257 mnist_classifier_MNISTClassifier 5zkvkijf abc648f7-ed86-46fc-b52c-88a4660c6590 -- POST / 200 433.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,258 mnist_classifier_MNISTClassifier 5zkvkijf 8debc899-2e8a-47a2-9af4-9eb55445d667 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,258 mnist_classifier_MNISTClassifier 5zkvkijf 5295cee2-76c5-4a79-8341-ec92b5f63c95 -- POST / 200 431.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,258 mnist_classifier_MNISTClassifier 5zkvkijf 8fb2fb30-2088-4944-a280-8a3a3cd928bc -- POST / 200 430.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,258 mnist_classifier_MNISTClassifier 5zkvkijf a308197e-c6c5-4482-8c72-9d58c8074e84 -- POST / 200 430.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,260 mnist_classifier_MNISTClassifier 5zkvkijf 37497b10-12f2-450c-a3eb-e447d16f97cf -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,260 mnist_classifier_MNISTClassifier 5zkvkijf 4729ee64-2bed-4999-b06c-7080b461a50f -- POST / 200 431.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,261 mnist_classifier_MNISTClassifier 5zkvkijf 6a35e8d0-87a4-4bbd-adff-217f0f6ade52 -- POST / 200 431.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,262 mnist_classifier_MNISTClassifier 5zkvkijf c85a0436-fd14-48e6-a0c3-67949651b62c -- POST / 200 430.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,262 mnist_classifier_MNISTClassifier 5zkvkijf c5993a09-c047-4f08-bbf5-992534630e53 -- POST / 200 410.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,263 mnist_classifier_MNISTClassifier 5zkvkijf 2e2de2b8-4966-4190-ad65-f599ae6ba0aa -- POST / 200 400.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,264 mnist_classifier_MNISTClassifier 5zkvkijf 36b70124-f1d1-43bd-9b75-38a22c1c2e4f -- POST / 200 400.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,265 mnist_classifier_MNISTClassifier 5zkvkijf 53343e47-a882-483d-a43f-dbf11ee020b4 -- POST / 200 399.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,266 mnist_classifier_MNISTClassifier 5zkvkijf cffd959f-bcf1-496d-9e64-7d4c2e102ad5 -- POST / 200 399.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,266 mnist_classifier_MNISTClassifier 5zkvkijf c05b4dea-bca3-45fb-890f-f170b4c216e3 -- POST / 200 399.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,266 mnist_classifier_MNISTClassifier 5zkvkijf 8ded3d27-1d47-43db-87a6-3398ebfc3cdc -- POST / 200 397.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,267 mnist_classifier_MNISTClassifier 5zkvkijf 08304d92-59a4-4ba5-88b8-759bea5d7001 -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,268 mnist_classifier_MNISTClassifier 5zkvkijf 74ccbddc-0a63-4da3-a3d4-4cb2429be3d3 -- POST / 200 391.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,269 mnist_classifier_MNISTClassifier 5zkvkijf 617e0958-dfff-4063-ad33-f794ccc1382e -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,269 mnist_classifier_MNISTClassifier 5zkvkijf ed07e023-a37b-4b07-98fb-89b68d13fe1c -- POST / 200 389.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,269 mnist_classifier_MNISTClassifier 5zkvkijf 42c961e5-9fdd-4e87-bb89-668786823a0b -- POST / 200 388.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,270 mnist_classifier_MNISTClassifier 5zkvkijf 4e85d75d-87b5-47a2-aeb4-ad14be487042 -- POST / 200 370.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,270 mnist_classifier_MNISTClassifier 5zkvkijf 0c0ba21c-e8ef-42db-a356-6c3d7bc3e482 -- POST / 200 365.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,271 mnist_classifier_MNISTClassifier 5zkvkijf b30fa381-3f61-4c8b-a8b6-7891870fe358 -- POST / 200 364.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,271 mnist_classifier_MNISTClassifier 5zkvkijf 5fdbeb08-47de-484f-9339-3e293f569070 -- POST / 200 363.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,272 mnist_classifier_MNISTClassifier 5zkvkijf 1ca1e000-aa78-4856-82e4-b4749e8d8ed9 -- POST / 200 362.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,272 mnist_classifier_MNISTClassifier 5zkvkijf ae9e5c52-76b5-41c9-b3f3-9cb4b54d9658 -- POST / 200 361.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,273 mnist_classifier_MNISTClassifier 5zkvkijf e71f3da6-fc90-47e5-8f0a-fca46de25011 -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,273 mnist_classifier_MNISTClassifier 5zkvkijf 3a800a51-1b71-4fa6-8aa1-cb156495c416 -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,275 mnist_classifier_MNISTClassifier 5zkvkijf 84d2a018-b5ce-47b6-bd8d-6d6ee5185f69 -- POST / 200 232.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,275 mnist_classifier_MNISTClassifier 5zkvkijf 375e39b4-ddb1-4c0e-8033-bb610bfc7d27 -- POST / 200 232.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,279 mnist_classifier_MNISTClassifier 5zkvkijf aa880f07-6081-485e-9837-ae17793a7212 -- POST / 200 235.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,279 mnist_classifier_MNISTClassifier 5zkvkijf 57df2b54-3164-4888-b00f-e56fe55f8683 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,281 mnist_classifier_MNISTClassifier 5zkvkijf b8744e20-3f72-4099-a294-e7492c36f87f -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,282 mnist_classifier_MNISTClassifier 5zkvkijf 31c50a73-f152-445a-bf6e-77b73d7067d5 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,283 mnist_classifier_MNISTClassifier 5zkvkijf 08ed30b8-191b-48f0-bdb0-00284dd42796 -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,299 mnist_classifier_MNISTClassifier 5zkvkijf 2896d4c6-3011-4f1b-8793-0215c283c53f -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,300 mnist_classifier_MNISTClassifier 5zkvkijf 52d02018-96a3-493b-bead-ed0bec533162 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,300 mnist_classifier_MNISTClassifier 5zkvkijf 05ef0809-9dfc-449f-be2e-e4720c37fbb9 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,300 mnist_classifier_MNISTClassifier 5zkvkijf f3bf883a-baf8-4deb-9097-a4bd5794a4dc -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,302 mnist_classifier_MNISTClassifier 5zkvkijf 3ab13e13-560f-4b29-817b-ac0e172ef50e -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,303 mnist_classifier_MNISTClassifier 5zkvkijf 6bcdd614-13e4-41ff-95fb-a3f283865617 -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,303 mnist_classifier_MNISTClassifier 5zkvkijf 9857c382-912f-428e-9d44-73b90de011f2 -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,303 mnist_classifier_MNISTClassifier 5zkvkijf 0457114d-1a1b-41a9-ab1b-372142c16f62 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,304 mnist_classifier_MNISTClassifier 5zkvkijf 168eb696-2b22-45a7-ad00-3a99c7771913 -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,304 mnist_classifier_MNISTClassifier 5zkvkijf 86c3ffde-eb45-43fb-afcc-90a01caac914 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,304 mnist_classifier_MNISTClassifier 5zkvkijf cf994b05-e36f-4131-8234-8c0a404ff61f -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,304 mnist_classifier_MNISTClassifier 5zkvkijf 32d90e85-f9f2-40a6-a8f2-4429b463939e -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,304 mnist_classifier_MNISTClassifier 5zkvkijf b75462ec-2840-4933-9a10-8e909b84a4bd -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,305 mnist_classifier_MNISTClassifier 5zkvkijf 72641daa-b9f6-42f7-9837-0e44b6e357f7 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,305 mnist_classifier_MNISTClassifier 5zkvkijf f3bc0119-7344-44be-bdbb-1d5c8a4dbb85 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,305 mnist_classifier_MNISTClassifier 5zkvkijf 82d909f2-b195-4f1f-b737-af3d7cc4fac9 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,305 mnist_classifier_MNISTClassifier 5zkvkijf 309a18c0-61b7-4c6f-b29c-11ae0e06da23 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,305 mnist_classifier_MNISTClassifier 5zkvkijf 41e93589-0f56-4aa0-b0eb-e4b3aaad2f4b -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,306 mnist_classifier_MNISTClassifier 5zkvkijf 1a1de590-6378-40ce-a877-45e2a0e2a6b9 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,307 mnist_classifier_MNISTClassifier 5zkvkijf dd6bbc9b-7998-45b0-b7a2-6868e72df3c2 -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,307 mnist_classifier_MNISTClassifier 5zkvkijf 886517c9-7661-4f98-8832-ab51ac3a34fe -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,307 mnist_classifier_MNISTClassifier 5zkvkijf e4650573-5fe5-4de5-9457-0866c8bf3153 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,310 mnist_classifier_MNISTClassifier 5zkvkijf 5fe63b82-857c-4299-8992-69a04d259d84 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,318 mnist_classifier_MNISTClassifier 5zkvkijf e7375f49-53bb-4951-ba57-8da66f5a41ff -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,319 mnist_classifier_MNISTClassifier 5zkvkijf 7035bc92-f9dc-4af4-a170-7a4cce4d955a -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,320 mnist_classifier_MNISTClassifier 5zkvkijf fba47087-eb81-40a3-b523-b7622353dca0 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,321 mnist_classifier_MNISTClassifier 5zkvkijf 0e7f880a-9a36-4baf-940a-4f00f0c19964 -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,323 mnist_classifier_MNISTClassifier 5zkvkijf 57ba0028-0f71-40ea-9f6a-022ed76579ab -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,324 mnist_classifier_MNISTClassifier 5zkvkijf ae49c660-c7ca-45d1-83ec-5e4221ba6c74 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,328 mnist_classifier_MNISTClassifier 5zkvkijf 04f874f8-4b33-40a3-b3bb-2ab3179dc151 -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,328 mnist_classifier_MNISTClassifier 5zkvkijf 41fdfb61-05bb-416b-b1ff-7b2652b5bdce -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,328 mnist_classifier_MNISTClassifier 5zkvkijf d6a3127e-6f88-4d1a-9680-c1326b1185ef -- POST / 200 218.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,330 mnist_classifier_MNISTClassifier 5zkvkijf 6d0022ed-e9b0-421b-9b22-f001b9fdb2d2 -- POST / 200 282.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,330 mnist_classifier_MNISTClassifier 5zkvkijf da89c596-2153-4a09-b71a-2016ceba3b91 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,330 mnist_classifier_MNISTClassifier 5zkvkijf 37970b3f-5c2e-4582-ae73-9d16e05c78c6 -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,333 mnist_classifier_MNISTClassifier 5zkvkijf 881652d7-d275-4833-a404-1377c31126e1 -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,333 mnist_classifier_MNISTClassifier 5zkvkijf 1f60021f-32f9-43bb-b6a0-1a050c2a71f9 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,333 mnist_classifier_MNISTClassifier 5zkvkijf 82a2b174-633e-4418-9bb0-f6291012786f -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,334 mnist_classifier_MNISTClassifier 5zkvkijf 5739aa73-7d51-45e5-b664-1bca16f53d6b -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,334 mnist_classifier_MNISTClassifier 5zkvkijf e41f2407-ca14-4e72-b04f-60151cbddace -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,334 mnist_classifier_MNISTClassifier 5zkvkijf 26065da8-4fe1-40c8-8f36-9740d568391a -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,335 mnist_classifier_MNISTClassifier 5zkvkijf b9a144ca-f547-4bf5-9e96-a7913310d126 -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,335 mnist_classifier_MNISTClassifier 5zkvkijf 91a8f022-6c8e-4384-965b-4179261ef488 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,581 mnist_classifier_MNISTClassifier 5zkvkijf d13da1b0-80c3-4084-874c-0cb58278dd48 -- POST / 200 321.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,582 mnist_classifier_MNISTClassifier 5zkvkijf c14e1934-f3b8-41a0-9108-378b6ef7b1b6 -- POST / 200 314.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,583 mnist_classifier_MNISTClassifier 5zkvkijf efb0cc53-f7e3-457c-888e-c41b30e8351e -- POST / 200 314.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,593 mnist_classifier_MNISTClassifier 5zkvkijf b96d7aa3-5dec-4181-92f8-4410f0f2b8f4 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,593 mnist_classifier_MNISTClassifier 5zkvkijf 47cce866-f2f6-429c-9e94-2834656e3970 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,594 mnist_classifier_MNISTClassifier 5zkvkijf 81020c4a-49a7-447e-aa1b-920448d66d62 -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,594 mnist_classifier_MNISTClassifier 5zkvkijf 5804fd72-e001-482e-9795-095e6b38b758 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,594 mnist_classifier_MNISTClassifier 5zkvkijf 8cc65236-c0e7-45b0-a097-9526175d0b59 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,594 mnist_classifier_MNISTClassifier 5zkvkijf 415a15d4-bf9c-4457-99c6-ff896f65fb72 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,595 mnist_classifier_MNISTClassifier 5zkvkijf 1d12ebce-c140-4795-bc85-030e57e27145 -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,595 mnist_classifier_MNISTClassifier 5zkvkijf efc6945b-284f-4709-8ed4-edb2d23b742f -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,595 mnist_classifier_MNISTClassifier 5zkvkijf b40f3fe5-2bbf-4d4a-ab9c-c601b50b341e -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,596 mnist_classifier_MNISTClassifier 5zkvkijf 9fa3dfd6-2a15-4af8-8e5f-0c13a22ceb92 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,596 mnist_classifier_MNISTClassifier 5zkvkijf fbcd0cf2-4777-46c3-83ca-76cc48a6b0ac -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,596 mnist_classifier_MNISTClassifier 5zkvkijf 47347ed8-99a7-4251-a238-605b0d161b71 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,596 mnist_classifier_MNISTClassifier 5zkvkijf 1ddc0d04-cdb8-44b7-bebb-4003239702a4 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,597 mnist_classifier_MNISTClassifier 5zkvkijf e7e49fc7-dd94-435a-9931-f58c9b4e3368 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,597 mnist_classifier_MNISTClassifier 5zkvkijf d515e985-164b-47da-9b22-957a08a54d7f -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,597 mnist_classifier_MNISTClassifier 5zkvkijf b9614466-6fb8-4b8c-bd07-584251d34092 -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,598 mnist_classifier_MNISTClassifier 5zkvkijf 250b9a15-f239-48b7-b3b7-6aabfc72744c -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,598 mnist_classifier_MNISTClassifier 5zkvkijf 1c6ce6f7-5e8d-46d0-9a2e-c6ae80a16060 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,598 mnist_classifier_MNISTClassifier 5zkvkijf 05006e93-cf04-49ef-b355-7bcaef58c664 -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,598 mnist_classifier_MNISTClassifier 5zkvkijf 62969fdf-3b3e-4687-aaf2-b876d2dc75cd -- POST / 200 241.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,599 mnist_classifier_MNISTClassifier 5zkvkijf ebfc8b3a-36b0-4334-8878-13b69faa0c3e -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,599 mnist_classifier_MNISTClassifier 5zkvkijf f9c0e25a-39e4-4d3a-b094-c5bce5f546f1 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,600 mnist_classifier_MNISTClassifier 5zkvkijf 145cef29-b429-44c4-b741-1f01c936fd04 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,601 mnist_classifier_MNISTClassifier 5zkvkijf 97f99584-702b-4389-bf37-44b87fba92fa -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,602 mnist_classifier_MNISTClassifier 5zkvkijf 45b58f07-6246-4f8b-a9c9-3092946c1068 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,602 mnist_classifier_MNISTClassifier 5zkvkijf 3473c004-4c07-4db8-84db-10447b7e9598 -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,602 mnist_classifier_MNISTClassifier 5zkvkijf 8ba8fc8c-b212-477d-961b-9bde013ea502 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,603 mnist_classifier_MNISTClassifier 5zkvkijf e9796314-f1d2-4a1e-be35-1b8908d3a044 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,604 mnist_classifier_MNISTClassifier 5zkvkijf b1225fc1-0a3e-445d-b398-241f1f3be7e9 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,604 mnist_classifier_MNISTClassifier 5zkvkijf 04c7ba9e-6883-4c0e-acba-24301c7a7d53 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,605 mnist_classifier_MNISTClassifier 5zkvkijf 3e0821ca-0deb-48f7-89c2-12db0df4d3ba -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,606 mnist_classifier_MNISTClassifier 5zkvkijf 7742fcd3-2511-48aa-a779-fa494af858e9 -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,607 mnist_classifier_MNISTClassifier 5zkvkijf 2e7bc414-83dc-4743-840a-585a70c8bf66 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,608 mnist_classifier_MNISTClassifier 5zkvkijf e90d2986-fae6-48a4-b8ea-574bebedda81 -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,609 mnist_classifier_MNISTClassifier 5zkvkijf 177cb741-5da6-45d4-96e4-dc80d370a819 -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,610 mnist_classifier_MNISTClassifier 5zkvkijf 60802933-ebca-40af-a361-df4ddc825cc9 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,610 mnist_classifier_MNISTClassifier 5zkvkijf 49dbe894-a657-4d9f-8188-8befc9a60416 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,610 mnist_classifier_MNISTClassifier 5zkvkijf b0ef9fa3-98fc-4231-9e72-1fd49c2477ea -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,611 mnist_classifier_MNISTClassifier 5zkvkijf c88c336a-cdc1-4516-b37d-1a77c034259e -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,612 mnist_classifier_MNISTClassifier 5zkvkijf 189ac279-c9c0-44fa-b2c2-c3d565bf472e -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,612 mnist_classifier_MNISTClassifier 5zkvkijf 48b4d39c-f193-4dfb-8fa5-bb7d1efccfaf -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,612 mnist_classifier_MNISTClassifier 5zkvkijf 42b07446-0e4f-4fd2-a9d4-ecde9d37922c -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,613 mnist_classifier_MNISTClassifier 5zkvkijf 5e96c05c-195b-4b2c-ad01-c39c33a95585 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,613 mnist_classifier_MNISTClassifier 5zkvkijf 3511e3b6-7719-4189-a44d-09dd5fcf2ba0 -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,699 mnist_classifier_MNISTClassifier 5zkvkijf 4e76754a-268f-4253-87c0-0e58ab51bf9a -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,705 mnist_classifier_MNISTClassifier 5zkvkijf 7473d162-5313-45c4-a445-ff82bcaf742e -- POST / 200 330.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,705 mnist_classifier_MNISTClassifier 5zkvkijf cc58abdd-8b0f-45f1-b2ad-10ec33422133 -- POST / 200 330.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,706 mnist_classifier_MNISTClassifier 5zkvkijf 7ee6f859-9053-409f-8d48-a2e1d7d6a93c -- POST / 200 329.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,706 mnist_classifier_MNISTClassifier 5zkvkijf d558a38d-6d46-4831-93cd-36d1a2f8b8ab -- POST / 200 329.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,706 mnist_classifier_MNISTClassifier 5zkvkijf 1fc4564e-51ee-47c1-9e2d-e9b5414cd312 -- POST / 200 329.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,707 mnist_classifier_MNISTClassifier 5zkvkijf 669c8268-7d44-4584-9c12-171bc5ce26aa -- POST / 200 328.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,708 mnist_classifier_MNISTClassifier 5zkvkijf 3fd74e88-69f8-41c3-9246-f04c9789f241 -- POST / 200 325.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,708 mnist_classifier_MNISTClassifier 5zkvkijf e1fe8cae-1d00-4ee7-96b3-44832b698e07 -- POST / 200 318.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,708 mnist_classifier_MNISTClassifier 5zkvkijf 16c56907-eedb-4cbe-8a3f-4ed9abd1b8d1 -- POST / 200 316.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,711 mnist_classifier_MNISTClassifier 5zkvkijf 8b5ff6bb-4d6c-4ea2-830f-d90cc1e37af7 -- POST / 200 319.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,713 mnist_classifier_MNISTClassifier 5zkvkijf edca6f91-0bba-408c-86d8-d11b978f5d3b -- POST / 200 316.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,716 mnist_classifier_MNISTClassifier 5zkvkijf a1c1c90c-e96f-42c0-b168-daa2b76fcc1c -- POST / 200 317.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,716 mnist_classifier_MNISTClassifier 5zkvkijf d1ca1558-6f69-4280-adae-f868e8468db9 -- POST / 200 317.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,716 mnist_classifier_MNISTClassifier 5zkvkijf 039fd839-db55-4de4-959d-17dc8723a4ed -- POST / 200 296.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,718 mnist_classifier_MNISTClassifier 5zkvkijf 102908e1-e1b1-45c1-934b-5c089f041e65 -- POST / 200 295.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,718 mnist_classifier_MNISTClassifier 5zkvkijf df159ad0-47ed-4149-ba33-710919f315c1 -- POST / 200 294.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,719 mnist_classifier_MNISTClassifier 5zkvkijf 226c8484-81b2-4056-af47-686614b189d0 -- POST / 200 293.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,721 mnist_classifier_MNISTClassifier 5zkvkijf 19773a31-c5e7-4326-8566-045d5561b8a4 -- POST / 200 294.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,721 mnist_classifier_MNISTClassifier 5zkvkijf f0e08ec3-7268-4226-adff-bbce3a8bf350 -- POST / 200 294.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,725 mnist_classifier_MNISTClassifier 5zkvkijf 65c4a162-fbe0-401b-be87-3ba981c7ec3e -- POST / 200 294.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,730 mnist_classifier_MNISTClassifier 5zkvkijf 1ee7835a-01d6-4171-a0d9-091bd90eacd3 -- POST / 200 297.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,732 mnist_classifier_MNISTClassifier 5zkvkijf 3fe9a58b-fb12-4f4a-ae67-a762610f8866 -- POST / 200 298.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,733 mnist_classifier_MNISTClassifier 5zkvkijf e264f531-98e8-4934-8c16-10bc50cdc711 -- POST / 200 298.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,734 mnist_classifier_MNISTClassifier 5zkvkijf e7c43548-5c10-4679-8576-d01a2b2c3b69 -- POST / 200 299.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,736 mnist_classifier_MNISTClassifier 5zkvkijf 2debbc33-858b-4d11-84c5-bdc62f072459 -- POST / 200 299.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,738 mnist_classifier_MNISTClassifier 5zkvkijf 1509d7b8-c950-484f-9e99-f439d148e127 -- POST / 200 301.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,739 mnist_classifier_MNISTClassifier 5zkvkijf edc9fcce-1bd2-4b6c-ace4-9453b5a72c03 -- POST / 200 290.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,739 mnist_classifier_MNISTClassifier 5zkvkijf 5a46178e-d93c-4a17-8e12-1f36b982f44f -- POST / 200 288.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,741 mnist_classifier_MNISTClassifier 5zkvkijf 0dec1037-19f2-444b-839e-7198a1ce62fa -- POST / 200 287.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,741 mnist_classifier_MNISTClassifier 5zkvkijf 870a45fb-5a29-4155-99e5-e53f6ac9f93a -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,742 mnist_classifier_MNISTClassifier 5zkvkijf a86eaa12-0bd4-4bcc-a553-24dde31835a1 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,742 mnist_classifier_MNISTClassifier 5zkvkijf bdbd0ffa-6292-4d99-a75e-5d587d72c151 -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,743 mnist_classifier_MNISTClassifier 5zkvkijf 52250e8b-99f8-4606-a6f0-ee5cfa619bb2 -- POST / 200 284.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,743 mnist_classifier_MNISTClassifier 5zkvkijf e07db8c8-a645-4acd-83d4-31bd571ccfc5 -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,744 mnist_classifier_MNISTClassifier 5zkvkijf 4b6f35a2-df9b-4581-b5c7-447b4d2e6ae2 -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,744 mnist_classifier_MNISTClassifier 5zkvkijf 010ad00e-cdf7-485a-b260-bd2bd9118285 -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,745 mnist_classifier_MNISTClassifier 5zkvkijf 4c130fa4-711c-4c8b-b032-00d2f38ad332 -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,745 mnist_classifier_MNISTClassifier 5zkvkijf 533182b4-c4cd-48c3-8a1a-909abe310f77 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,745 mnist_classifier_MNISTClassifier 5zkvkijf 41394937-1bad-453b-9379-74480006d23b -- POST / 200 283.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,747 mnist_classifier_MNISTClassifier 5zkvkijf 19425d84-a1fc-4d55-9b0c-feef7580987a -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,748 mnist_classifier_MNISTClassifier 5zkvkijf 2d2a83c4-04fc-4457-8f28-2c162d34d539 -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,748 mnist_classifier_MNISTClassifier 5zkvkijf 8549ec73-00a6-4295-8747-20c2ae2df84f -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,749 mnist_classifier_MNISTClassifier 5zkvkijf 36a87512-6e3d-4509-a314-8e788ca9a744 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,750 mnist_classifier_MNISTClassifier 5zkvkijf ffe1e9d6-6866-47f1-a7f6-a16c097c77b3 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,750 mnist_classifier_MNISTClassifier 5zkvkijf c14a9a90-2bb6-4f27-816a-858844d9adce -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,750 mnist_classifier_MNISTClassifier 5zkvkijf 7e568308-5b72-4506-aba6-0c7bf7636ed5 -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,751 mnist_classifier_MNISTClassifier 5zkvkijf 90cc375d-cd3b-45ff-a6db-bfee5e45c01f -- POST / 200 280.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,751 mnist_classifier_MNISTClassifier 5zkvkijf 44f1e54f-09e2-49c5-b397-b1656a85815e -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,756 mnist_classifier_MNISTClassifier 5zkvkijf 63254e34-cc8c-4cb0-9b23-fb526b3eeaa7 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,758 mnist_classifier_MNISTClassifier 5zkvkijf aa2a6233-e44d-4a4f-a5aa-f55e745f4d89 -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,758 mnist_classifier_MNISTClassifier 5zkvkijf 89143468-0617-4cf7-ad6d-7b22c67a4cac -- POST / 200 282.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,759 mnist_classifier_MNISTClassifier 5zkvkijf 9f119b3a-51a1-4a39-8020-a3f347f79322 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,983 mnist_classifier_MNISTClassifier 5zkvkijf 34c3818d-ae06-44f7-97a9-e85670d3044b -- POST / 200 412.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,986 mnist_classifier_MNISTClassifier 5zkvkijf 024da839-21b0-443d-b444-f078e4c62ade -- POST / 200 418.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,988 mnist_classifier_MNISTClassifier 5zkvkijf 3d78c41a-b361-4c69-a37b-5a3abee9820f -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,988 mnist_classifier_MNISTClassifier 5zkvkijf f2e9e0d1-933b-4bff-920a-ee6294b27021 -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,989 mnist_classifier_MNISTClassifier 5zkvkijf eb059bca-2590-45b6-ae9d-3a26de7dfc66 -- POST / 200 372.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,989 mnist_classifier_MNISTClassifier 5zkvkijf 254fa9da-769d-4f16-9fc3-9b5d71b474ae -- POST / 200 361.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,989 mnist_classifier_MNISTClassifier 5zkvkijf bb3f6dbf-c69d-4c57-a2f7-e6f7746b092b -- POST / 200 372.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,989 mnist_classifier_MNISTClassifier 5zkvkijf 7eace075-4e3c-4146-a7ac-ba5b4614958e -- POST / 200 372.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,991 mnist_classifier_MNISTClassifier 5zkvkijf 295a958c-69dc-4d4f-a18b-b5738c2b0a0d -- POST / 200 373.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,991 mnist_classifier_MNISTClassifier 5zkvkijf 5a70457c-d243-45b5-902d-0474104f26bc -- POST / 200 366.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,991 mnist_classifier_MNISTClassifier 5zkvkijf 97662d74-1133-4816-9bb8-2df2c3b87bae -- POST / 200 366.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,992 mnist_classifier_MNISTClassifier 5zkvkijf a29f9517-80ca-4ff4-9cca-38216cf66610 -- POST / 200 362.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,992 mnist_classifier_MNISTClassifier 5zkvkijf dd152145-06a8-4789-a058-e93ef7d2757f -- POST / 200 363.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,993 mnist_classifier_MNISTClassifier 5zkvkijf d2aff74e-a794-4ee6-bc57-7dc390c873e3 -- POST / 200 362.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,994 mnist_classifier_MNISTClassifier 5zkvkijf d92fa15e-ed97-42a4-be35-fd618417fd21 -- POST / 200 364.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:01,997 mnist_classifier_MNISTClassifier 5zkvkijf 0c9f9216-39b2-499f-9057-dc03b1d6107f -- POST / 200 366.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,003 mnist_classifier_MNISTClassifier 5zkvkijf 52f93889-72ed-4782-9604-74a2e247fb36 -- POST / 200 370.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,009 mnist_classifier_MNISTClassifier 5zkvkijf 71ee258b-2b4d-4185-9c34-dd037be8bfd2 -- POST / 200 376.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,012 mnist_classifier_MNISTClassifier 5zkvkijf 038ec4c9-afdd-4d7b-ac2b-dba12282c7fb -- POST / 200 376.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,014 mnist_classifier_MNISTClassifier 5zkvkijf 128f9892-9cc5-4f2f-a222-7c6d88a45a4f -- POST / 200 380.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,015 mnist_classifier_MNISTClassifier 5zkvkijf 9d7c8e4b-9feb-4c60-a4f7-533ba5e06e0c -- POST / 200 379.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,016 mnist_classifier_MNISTClassifier 5zkvkijf 5fd66741-084a-43fa-a239-b2ee7061367a -- POST / 200 381.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,018 mnist_classifier_MNISTClassifier 5zkvkijf 30918dcc-3b7f-474a-b3ae-1e6558a0ed9d -- POST / 200 381.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,019 mnist_classifier_MNISTClassifier 5zkvkijf fffa977f-42fe-4d01-8410-47fb7ae8a163 -- POST / 200 380.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,022 mnist_classifier_MNISTClassifier 5zkvkijf e582cf84-2082-4900-b5bb-a7708e13453f -- POST / 200 383.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,025 mnist_classifier_MNISTClassifier 5zkvkijf 952d7595-d00c-4a5c-a042-15d467c91045 -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,026 mnist_classifier_MNISTClassifier 5zkvkijf 29226af8-0d5f-415f-9f93-cfb4d4ef92e9 -- POST / 200 383.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,026 mnist_classifier_MNISTClassifier 5zkvkijf c349beeb-455e-4e5a-a8d8-2fbd71134190 -- POST / 200 382.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,027 mnist_classifier_MNISTClassifier 5zkvkijf 7a6993b6-a2e5-45e9-80e0-81cf08111ce0 -- POST / 200 383.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,027 mnist_classifier_MNISTClassifier 5zkvkijf 4a0dfe8b-e8a8-4622-9efe-3663cd92588c -- POST / 200 383.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,028 mnist_classifier_MNISTClassifier 5zkvkijf ff7732c5-9f56-4f3f-9ea3-06d23413471c -- POST / 200 382.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,028 mnist_classifier_MNISTClassifier 5zkvkijf b2e5c677-14b3-4e8b-9755-e23652dd9266 -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,029 mnist_classifier_MNISTClassifier 5zkvkijf 763bc7b1-3bd7-4c6b-a0ef-22ad69e6eeb5 -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,029 mnist_classifier_MNISTClassifier 5zkvkijf 96b9d195-1292-481a-a922-3896e6572db2 -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,029 mnist_classifier_MNISTClassifier 5zkvkijf 53272db9-1084-4b36-b07d-fdbe97215ecd -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,096 mnist_classifier_MNISTClassifier 5zkvkijf dd440613-e07f-4b43-bb96-cddb88ebcd99 -- POST / 200 444.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,101 mnist_classifier_MNISTClassifier 5zkvkijf f7535b0d-7252-4682-88c5-913f1744c974 -- POST / 200 447.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,107 mnist_classifier_MNISTClassifier 5zkvkijf 6398cbf1-2c57-468b-9e9c-7c3f9361a7e0 -- POST / 200 450.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,109 mnist_classifier_MNISTClassifier 5zkvkijf 088ea0e9-d401-4636-831b-c70427dcb1e3 -- POST / 200 449.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,111 mnist_classifier_MNISTClassifier 5zkvkijf 455bdb65-6fb8-4e35-b029-2076644bcf61 -- POST / 200 450.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,112 mnist_classifier_MNISTClassifier 5zkvkijf f6afbabd-fdb2-4ac2-9314-52cd09ba1ceb -- POST / 200 449.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,113 mnist_classifier_MNISTClassifier 5zkvkijf 2e03e363-6e2b-46fb-bbf3-ad5b975d55ae -- POST / 200 445.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,113 mnist_classifier_MNISTClassifier 5zkvkijf 23b7c458-4f7f-40ad-a636-1d91523d9233 -- POST / 200 447.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,114 mnist_classifier_MNISTClassifier 5zkvkijf 07198457-a670-496a-bde3-cfb3d72ea264 -- POST / 200 446.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,115 mnist_classifier_MNISTClassifier 5zkvkijf 1436c31d-94a2-4d91-a41e-7ceef7c36081 -- POST / 200 446.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,116 mnist_classifier_MNISTClassifier 5zkvkijf cc54cc88-8f7f-4732-9d3e-f37c78a09f97 -- POST / 200 446.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,119 mnist_classifier_MNISTClassifier 5zkvkijf 2130689d-a476-4f55-9368-c13f40142481 -- POST / 200 441.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,121 mnist_classifier_MNISTClassifier 5zkvkijf eff58dc4-09ac-4667-b2c5-337efe4a043f -- POST / 200 380.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,122 mnist_classifier_MNISTClassifier 5zkvkijf 977aa412-1386-4e49-9ca2-3a11f37e245d -- POST / 200 373.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,124 mnist_classifier_MNISTClassifier 5zkvkijf 092299fc-6454-44cf-a0c8-33dc6dd418b2 -- POST / 200 367.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,126 mnist_classifier_MNISTClassifier 5zkvkijf a71294a5-4362-4a99-b418-f0367771ff0f -- POST / 200 366.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,126 mnist_classifier_MNISTClassifier 5zkvkijf e8c0acff-d11c-4944-8b98-d78cc1e1c5a6 -- POST / 200 366.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,127 mnist_classifier_MNISTClassifier 5zkvkijf 3c9e69bb-fbcd-4357-8d8b-3c2a91e19cb4 -- POST / 200 362.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,128 mnist_classifier_MNISTClassifier 5zkvkijf 563d511b-8243-48f7-b4e5-7aedf4ae1461 -- POST / 200 360.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,130 mnist_classifier_MNISTClassifier 5zkvkijf 6f9d23d2-a72b-4217-b39e-9e23e9533182 -- POST / 200 360.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,152 mnist_classifier_MNISTClassifier 5zkvkijf 769d259a-78c2-4e4a-9df9-435234d15282 -- POST / 200 383.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,153 mnist_classifier_MNISTClassifier 5zkvkijf 369bf902-b0a6-4753-8e58-1b399d8b3af8 -- POST / 200 381.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,154 mnist_classifier_MNISTClassifier 5zkvkijf 3aa9cf1d-e3cf-43a3-9ce3-debb831e2684 -- POST / 200 378.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,155 mnist_classifier_MNISTClassifier 5zkvkijf 4af0c280-c18a-487a-ae9b-89118c5e9add -- POST / 200 380.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,155 mnist_classifier_MNISTClassifier 5zkvkijf f075c84e-cac1-4de8-b258-eb1f46446017 -- POST / 200 381.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,155 mnist_classifier_MNISTClassifier 5zkvkijf 446bea0f-872b-4cc4-9215-451e63d2f4ce -- POST / 200 380.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,157 mnist_classifier_MNISTClassifier 5zkvkijf 3d95844a-c048-48e7-9cc4-ed814a4d59b6 -- POST / 200 380.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,161 mnist_classifier_MNISTClassifier 5zkvkijf 7c28a34c-36a9-440e-b2c5-6fc788f208b6 -- POST / 200 383.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,254 mnist_classifier_MNISTClassifier 5zkvkijf 8a975119-9050-42b4-af63-bd27a46625fe -- POST / 200 475.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,255 mnist_classifier_MNISTClassifier 5zkvkijf 9679c6ed-b317-4bff-94d8-361aa3dc0e26 -- POST / 200 476.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,258 mnist_classifier_MNISTClassifier 5zkvkijf 1daac75e-0daf-42db-ba2f-4c1d4dc87a81 -- POST / 200 475.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,259 mnist_classifier_MNISTClassifier 5zkvkijf 9c734f98-0439-4aa4-be62-fadfdd956458 -- POST / 200 319.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,260 mnist_classifier_MNISTClassifier 5zkvkijf 644eb006-b7cc-4f7b-b6a1-5c89b3faa572 -- POST / 200 476.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,260 mnist_classifier_MNISTClassifier 5zkvkijf 5536d3c8-04cb-4f46-b8e9-94ca3a18cfc7 -- POST / 200 476.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,260 mnist_classifier_MNISTClassifier 5zkvkijf 7737c98e-f1ed-4693-b26e-0893a218fd23 -- POST / 200 476.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,261 mnist_classifier_MNISTClassifier 5zkvkijf 007b6b41-05d1-47f6-8020-324b089475e8 -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,261 mnist_classifier_MNISTClassifier 5zkvkijf 62d82891-8a4c-4a9d-a414-b1d8181e398b -- POST / 200 335.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,262 mnist_classifier_MNISTClassifier 5zkvkijf c7c77abc-ccfd-4445-85b2-f604b6da0a9d -- POST / 200 336.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,263 mnist_classifier_MNISTClassifier 5zkvkijf 51588920-aad0-466f-84b4-e445892da6e5 -- POST / 200 336.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,263 mnist_classifier_MNISTClassifier 5zkvkijf 21b6d20a-1804-42e1-88a9-5cc6461d05f7 -- POST / 200 337.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,265 mnist_classifier_MNISTClassifier 5zkvkijf 5ec892f5-ba6a-424d-aded-46fc362bc401 -- POST / 200 338.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,265 mnist_classifier_MNISTClassifier 5zkvkijf 67763cec-4697-4df4-b0ed-44e702eb8594 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,265 mnist_classifier_MNISTClassifier 5zkvkijf dac77935-b981-4432-8558-4b07178af9e2 -- POST / 200 337.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,266 mnist_classifier_MNISTClassifier 5zkvkijf 5e2a2a18-45e8-4278-ae41-0a91e2ba16eb -- POST / 200 337.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,266 mnist_classifier_MNISTClassifier 5zkvkijf d08e46c9-8dbd-4bcf-b26c-9b257dbedb5b -- POST / 200 337.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,267 mnist_classifier_MNISTClassifier 5zkvkijf e3c696fd-c5da-4ba2-bace-09c9fb6453ca -- POST / 200 337.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,267 mnist_classifier_MNISTClassifier 5zkvkijf 3c431f27-2975-4950-8914-54c0c47ab7e8 -- POST / 200 337.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,268 mnist_classifier_MNISTClassifier 5zkvkijf e663c69a-1674-4ce2-8ec2-db96cabe2602 -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,269 mnist_classifier_MNISTClassifier 5zkvkijf 58d6193d-34ea-4111-97f6-8aaaa4fab03b -- POST / 200 337.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,269 mnist_classifier_MNISTClassifier 5zkvkijf c656f9b4-fe48-4d62-b489-b2346684ee35 -- POST / 200 337.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,269 mnist_classifier_MNISTClassifier 5zkvkijf eb19f505-dfd8-452f-adb2-a8482bd4edf1 -- POST / 200 337.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,270 mnist_classifier_MNISTClassifier 5zkvkijf dcf586c6-a8b2-4fca-964f-91f4c3700c78 -- POST / 200 338.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,272 mnist_classifier_MNISTClassifier 5zkvkijf 0b2f9007-34af-4b26-b300-c5a075c61dd7 -- POST / 200 339.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,273 mnist_classifier_MNISTClassifier 5zkvkijf ced01635-7e98-4ba5-baa8-8054d36ebf66 -- POST / 200 338.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,275 mnist_classifier_MNISTClassifier 5zkvkijf bb7e8623-819d-483d-8846-bbbc3285e5ee -- POST / 200 340.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,276 mnist_classifier_MNISTClassifier 5zkvkijf 1d011e38-8926-4174-8d52-3dc9c9d22b1a -- POST / 200 340.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,285 mnist_classifier_MNISTClassifier 5zkvkijf 376622ec-7654-4713-8cc8-1a8034d9a6a1 -- POST / 200 349.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,286 mnist_classifier_MNISTClassifier 5zkvkijf 491b32e0-4bf6-4352-bda7-f52f3c1057f3 -- POST / 200 348.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,288 mnist_classifier_MNISTClassifier 5zkvkijf 43d725a7-68cc-4578-8d46-2463e4c6a68f -- POST / 200 349.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,291 mnist_classifier_MNISTClassifier 5zkvkijf 9b4d7dc3-0a4f-42bd-b536-7813368f7826 -- POST / 200 351.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,291 mnist_classifier_MNISTClassifier 5zkvkijf 724e2e7f-6abc-45e3-b40a-f91a918c83ab -- POST / 200 352.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,291 mnist_classifier_MNISTClassifier 5zkvkijf 7bcee709-6ddf-4fd4-abd8-254fb22f77cf -- POST / 200 351.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,292 mnist_classifier_MNISTClassifier 5zkvkijf 27e7675d-bd90-42b2-9529-e51aa503d2b7 -- POST / 200 350.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,293 mnist_classifier_MNISTClassifier 5zkvkijf 5dc71316-f934-4777-a0f7-223f78c88250 -- POST / 200 352.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,294 mnist_classifier_MNISTClassifier 5zkvkijf 167fe093-1857-4415-9cbb-fac1220889d2 -- POST / 200 353.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,294 mnist_classifier_MNISTClassifier 5zkvkijf 4eba0937-2fb3-4ca3-aad7-616ec116884b -- POST / 200 318.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,295 mnist_classifier_MNISTClassifier 5zkvkijf 6132eb79-f297-4595-94ec-150ecfa3f9cd -- POST / 200 312.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,296 mnist_classifier_MNISTClassifier 5zkvkijf e3b0772f-919c-4031-821d-5ea55b77c6bd -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,296 mnist_classifier_MNISTClassifier 5zkvkijf db2223bf-7a84-496a-830a-d6381aefa0a2 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,297 mnist_classifier_MNISTClassifier 5zkvkijf 79a52ed6-b596-4556-9b92-c8890b444b8f -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,298 mnist_classifier_MNISTClassifier 5zkvkijf 9302b8f5-82da-48c5-8f57-2fac763c6c67 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,298 mnist_classifier_MNISTClassifier 5zkvkijf 73740f08-f4b5-441a-ade9-0cde8ee70431 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,298 mnist_classifier_MNISTClassifier 5zkvkijf a91f6610-6c45-445a-90e8-4f7c5a0de8ec -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,299 mnist_classifier_MNISTClassifier 5zkvkijf 36497c66-e179-4057-aa01-dfb446cf6e8b -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,299 mnist_classifier_MNISTClassifier 5zkvkijf a12bd92a-63b2-4403-86ce-7d80da950187 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,300 mnist_classifier_MNISTClassifier 5zkvkijf 9eca2083-c0eb-4379-a7e1-58771f89d746 -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,301 mnist_classifier_MNISTClassifier 5zkvkijf 9d8cffb8-b9f2-43a9-ad13-49a91095e06e -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,301 mnist_classifier_MNISTClassifier 5zkvkijf e9f8339a-10f3-4363-8600-9027e10a3f2a -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,303 mnist_classifier_MNISTClassifier 5zkvkijf d9deb5a1-d838-4799-aa08-39b2fc1b3ab5 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,303 mnist_classifier_MNISTClassifier 5zkvkijf d4d8e567-e3e7-4789-a52c-93da6fb7ca1d -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,304 mnist_classifier_MNISTClassifier 5zkvkijf f4d75343-b308-4e3c-a9cf-488beb1f31e6 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,307 mnist_classifier_MNISTClassifier 5zkvkijf db6b33c7-7073-4457-95f0-0d3ec9f1aa1b -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,308 mnist_classifier_MNISTClassifier 5zkvkijf a9fe0b11-c0ef-43f3-9bf2-eb42b6297cfc -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,308 mnist_classifier_MNISTClassifier 5zkvkijf 262a3fdd-3489-41e3-b03b-62fe44be900f -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,308 mnist_classifier_MNISTClassifier 5zkvkijf c0080477-4a5d-4c0f-9f8a-dd09514bc95a -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,308 mnist_classifier_MNISTClassifier 5zkvkijf 81ef7f66-4e17-49bb-aca9-cb6b0472ee9a -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,309 mnist_classifier_MNISTClassifier 5zkvkijf 2fdcd2c5-b366-45b6-a960-56b4954d66b3 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,309 mnist_classifier_MNISTClassifier 5zkvkijf 7cd5ebbb-d59e-4d1f-841a-6ec417b26944 -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,309 mnist_classifier_MNISTClassifier 5zkvkijf b33161b7-950d-4113-b496-5eb0fb2ec08f -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,311 mnist_classifier_MNISTClassifier 5zkvkijf 172926eb-057d-411f-b2dc-496fa98702e7 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,313 mnist_classifier_MNISTClassifier 5zkvkijf a5b2e65a-ae2f-4a48-a17d-e6a30740f19a -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,314 mnist_classifier_MNISTClassifier 5zkvkijf bd511bd8-76c2-49be-b3b4-2bfb292ba271 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,315 mnist_classifier_MNISTClassifier 5zkvkijf c7c06da9-0fd1-459b-a870-cac48d515f8c -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,315 mnist_classifier_MNISTClassifier 5zkvkijf aaad98fe-b06f-4b13-b6c6-a1cd7901446e -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,315 mnist_classifier_MNISTClassifier 5zkvkijf f07525a5-54f3-47c4-8053-a8431ab51fcb -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,316 mnist_classifier_MNISTClassifier 5zkvkijf 38f42c4f-298e-440a-8cdd-90a7cce4a522 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,316 mnist_classifier_MNISTClassifier 5zkvkijf d63cc3d2-10f4-4968-852d-21f5bd51139f -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,316 mnist_classifier_MNISTClassifier 5zkvkijf 3c7c952e-0b40-4253-9c5f-be3a45f09684 -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,316 mnist_classifier_MNISTClassifier 5zkvkijf 4f6dab93-930d-43a8-a9b2-32e9cb4ba78d -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,317 mnist_classifier_MNISTClassifier 5zkvkijf d2a8fee0-0a24-4e98-92c7-9d1964ecfdc0 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,411 mnist_classifier_MNISTClassifier 5zkvkijf 0b554498-cb40-4714-91ce-098c11a5db67 -- POST / 200 295.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,429 mnist_classifier_MNISTClassifier 5zkvkijf f45e6bc3-fe77-48d1-b78f-28899d11550c -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,430 mnist_classifier_MNISTClassifier 5zkvkijf 3fc451cc-2ed3-4db3-a62d-288b6a3d9fad -- POST / 200 278.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,431 mnist_classifier_MNISTClassifier 5zkvkijf be0d2239-f7d4-4a5c-b9a3-a8d684c87136 -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,432 mnist_classifier_MNISTClassifier 5zkvkijf 0dba4017-8c98-469f-86f8-97291c4cd6d9 -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,432 mnist_classifier_MNISTClassifier 5zkvkijf 6be568b5-f2fe-44ca-92fe-7955eb5838b5 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,432 mnist_classifier_MNISTClassifier 5zkvkijf 2b62db3d-1d15-40d8-b0f0-0a919f0153e4 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,432 mnist_classifier_MNISTClassifier 5zkvkijf 90828344-be1b-44e4-840a-67264bbe600b -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf 6eedc397-bce3-46fa-985b-9a6f18ced7bf -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf 759e0753-f353-432e-b8af-41370a260de7 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf 9ecbb928-61dc-430d-8f8a-4b0d43374512 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf 02680396-b5ee-4f29-acb7-9c373131b3ff -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf b444453f-e870-47e0-978a-bc8d1af2a019 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf 4e75a59f-ca24-486e-8485-7b994c64dbb0 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,433 mnist_classifier_MNISTClassifier 5zkvkijf 646016a7-7894-476f-8ee1-a8504de241b2 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,434 mnist_classifier_MNISTClassifier 5zkvkijf 2c0447be-e90c-439b-8e16-dc24a9c13a02 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,434 mnist_classifier_MNISTClassifier 5zkvkijf 51eebb83-01c6-4b56-b67e-54e016bdc6f9 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,434 mnist_classifier_MNISTClassifier 5zkvkijf e7fb7038-85e2-4304-9477-2288045ceb09 -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,435 mnist_classifier_MNISTClassifier 5zkvkijf ea398ccf-04a7-41d1-923c-e1b034b2f829 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,438 mnist_classifier_MNISTClassifier 5zkvkijf 0571fe97-2a75-4e38-b7d4-761367d4a4ce -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,438 mnist_classifier_MNISTClassifier 5zkvkijf de443b81-7b63-49b3-884a-4cddeae587a4 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,438 mnist_classifier_MNISTClassifier 5zkvkijf e8d297bd-c206-4f5a-b9c0-c5b9e6bf0fac -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,438 mnist_classifier_MNISTClassifier 5zkvkijf a61b212f-426d-495a-bd5d-04a2ab9dcff2 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf aa1e5510-e1ba-462b-892e-87c9037eeefd -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf ca492c78-d9dc-4d23-b148-e6db894d55a6 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf 89b22830-6f25-4749-8062-d24a1352f80b -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf 6f7bf58c-dd5f-402b-9438-1a141264ab25 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf 25491505-7d37-40ab-bd2e-0e7cba49befe -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf 14db8e97-cd15-4326-a2ae-00f816e1a38e -- POST / 200 186.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,439 mnist_classifier_MNISTClassifier 5zkvkijf a768da36-2beb-4305-951d-e1b80cb42f16 -- POST / 200 175.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,440 mnist_classifier_MNISTClassifier 5zkvkijf ca9749d9-1f4c-4f93-982b-ff7c7820138e -- POST / 200 190.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,440 mnist_classifier_MNISTClassifier 5zkvkijf 821311b3-2a78-4ed9-8f8d-efc8f6d11bab -- POST / 200 128.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,440 mnist_classifier_MNISTClassifier 5zkvkijf e13b22a3-8864-4acc-ac16-44ee06bb60c4 -- POST / 200 137.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,440 mnist_classifier_MNISTClassifier 5zkvkijf e560eab6-6c16-4380-9c00-24626f587f51 -- POST / 200 142.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,558 mnist_classifier_MNISTClassifier 5zkvkijf fcf6a5fe-3962-4e08-a9c8-72682286e197 -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,559 mnist_classifier_MNISTClassifier 5zkvkijf fee19344-afb0-4db8-a5db-9a4528eae613 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,560 mnist_classifier_MNISTClassifier 5zkvkijf 36204e52-bce3-4953-890a-3b79c7217c87 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,560 mnist_classifier_MNISTClassifier 5zkvkijf 32b3449c-26c7-4dde-ba42-1a9dc05ecd07 -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,586 mnist_classifier_MNISTClassifier 5zkvkijf eec00e8d-5525-4f1d-b851-065e8875aca0 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,589 mnist_classifier_MNISTClassifier 5zkvkijf 9d7e663f-22d0-42ac-8e2c-899edb6c417e -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,589 mnist_classifier_MNISTClassifier 5zkvkijf aa12ec00-b289-4b82-b0ca-dd559d52a565 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,589 mnist_classifier_MNISTClassifier 5zkvkijf 1768e144-d884-4251-9d1f-aa6176284c9d -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,590 mnist_classifier_MNISTClassifier 5zkvkijf 47d0a253-f4ad-45e2-92bd-0d56eb493c78 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,590 mnist_classifier_MNISTClassifier 5zkvkijf 50f43663-702e-46ff-bb25-5b5ec9fc9460 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,590 mnist_classifier_MNISTClassifier 5zkvkijf 2b2c1ef1-42b4-4fa5-ac96-20f4266bb931 -- POST / 200 261.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,591 mnist_classifier_MNISTClassifier 5zkvkijf 533e7c51-b044-4f6e-9915-b47d3e4d375b -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,591 mnist_classifier_MNISTClassifier 5zkvkijf 7f26f15f-d53b-46f6-a4e9-9c78dd1b3daa -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,596 mnist_classifier_MNISTClassifier 5zkvkijf 0abb9d29-4a76-4e3d-b94e-c9a263f50e8b -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,596 mnist_classifier_MNISTClassifier 5zkvkijf 7e238fbe-9f20-4f81-9830-c7956afdb417 -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,597 mnist_classifier_MNISTClassifier 5zkvkijf bc7d97af-302a-414a-9ce9-e9287332cfe0 -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,598 mnist_classifier_MNISTClassifier 5zkvkijf 3b46b224-9554-41b1-844a-6a9b4d51cd5a -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,598 mnist_classifier_MNISTClassifier 5zkvkijf dbbd68b2-226a-45c6-b84b-5464d3cf28e9 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,599 mnist_classifier_MNISTClassifier 5zkvkijf cb74bb2c-974e-49aa-a411-75d26063dfea -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,599 mnist_classifier_MNISTClassifier 5zkvkijf a4134c85-db73-4fb2-b66e-03e8d0911c4d -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,604 mnist_classifier_MNISTClassifier 5zkvkijf 16045f35-d550-4ce6-a8c4-986fade52c51 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,605 mnist_classifier_MNISTClassifier 5zkvkijf 4505844a-4abd-4d1d-b382-d67a2fffd69b -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,606 mnist_classifier_MNISTClassifier 5zkvkijf f67f9faf-486c-4e1f-ab9a-972f647aa6e3 -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,606 mnist_classifier_MNISTClassifier 5zkvkijf 1a36c809-063f-4b34-84f8-a392a91f4d60 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,607 mnist_classifier_MNISTClassifier 5zkvkijf de4a7bf1-8fd9-47b3-b578-468814b41ec0 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,607 mnist_classifier_MNISTClassifier 5zkvkijf 49f72ee8-ebdb-4650-ba1f-1f5b7200d9c3 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,607 mnist_classifier_MNISTClassifier 5zkvkijf c2cbd098-8ac3-4777-876c-4324a87e3e18 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,608 mnist_classifier_MNISTClassifier 5zkvkijf 7434e216-92fd-4f44-8209-da1531f30bf0 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,608 mnist_classifier_MNISTClassifier 5zkvkijf 5414a952-dd1e-4ab5-b5e8-12fc7c789dd0 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,608 mnist_classifier_MNISTClassifier 5zkvkijf 0d977131-df0f-4613-9392-fd663cd0c56b -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,608 mnist_classifier_MNISTClassifier 5zkvkijf d923b9c1-51fe-4341-b9ae-88f186f45669 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,608 mnist_classifier_MNISTClassifier 5zkvkijf 9d421e25-3f7f-42ce-b230-d15767b11ea0 -- POST / 200 241.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,608 mnist_classifier_MNISTClassifier 5zkvkijf b2a15278-1760-409b-97b2-25dd5f025c2f -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,728 mnist_classifier_MNISTClassifier 5zkvkijf 0e86e1a0-f72d-4cd3-95c3-4166d6c3f2f4 -- POST / 200 352.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,732 mnist_classifier_MNISTClassifier 5zkvkijf e2d91c2b-c717-465c-afc1-dbfc3844f1d9 -- POST / 200 360.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,738 mnist_classifier_MNISTClassifier 5zkvkijf fd06fdaa-37b4-41ae-8019-71c15ffec72e -- POST / 200 362.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,880 mnist_classifier_MNISTClassifier 5zkvkijf e9139d66-fad9-4681-ac90-f1e8de15ff0f -- POST / 200 492.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,882 mnist_classifier_MNISTClassifier 5zkvkijf 9d3d7991-a82a-4e8d-a340-49179d4e619e -- POST / 200 505.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,882 mnist_classifier_MNISTClassifier 5zkvkijf cf474f0f-7545-4fa2-805e-d3adc53a0b1f -- POST / 200 500.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,883 mnist_classifier_MNISTClassifier 5zkvkijf 920e3aca-1564-44cd-9136-cbbf5d6f4463 -- POST / 200 498.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,883 mnist_classifier_MNISTClassifier 5zkvkijf 086fa91e-b200-4b68-b615-fa9f74174946 -- POST / 200 498.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,883 mnist_classifier_MNISTClassifier 5zkvkijf 472704d9-dc3c-4c19-94c4-d233d6fd121e -- POST / 200 495.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,884 mnist_classifier_MNISTClassifier 5zkvkijf b6d33f2d-e0f0-491b-b165-337bbd076c51 -- POST / 200 491.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,884 mnist_classifier_MNISTClassifier 5zkvkijf f8636f40-9960-455a-8c20-52a6c376f6e8 -- POST / 200 490.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,884 mnist_classifier_MNISTClassifier 5zkvkijf b7743524-7508-49c4-bb70-4874e24d7588 -- POST / 200 489.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,885 mnist_classifier_MNISTClassifier 5zkvkijf b6541adf-7048-4aba-b433-9590fcf5709c -- POST / 200 486.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,885 mnist_classifier_MNISTClassifier 5zkvkijf 065c5361-7d00-4308-94ec-56b97a9979bc -- POST / 200 485.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,885 mnist_classifier_MNISTClassifier 5zkvkijf a01883f1-82f3-4a3c-9b24-4b8529e330c4 -- POST / 200 474.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,886 mnist_classifier_MNISTClassifier 5zkvkijf fd296144-d0f4-4183-b15d-550fb30a5daf -- POST / 200 458.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,886 mnist_classifier_MNISTClassifier 5zkvkijf 9ec83827-4e25-463f-995d-2fe6245106ab -- POST / 200 458.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,886 mnist_classifier_MNISTClassifier 5zkvkijf 193ac417-da36-466a-be48-a64ca6fc9c10 -- POST / 200 458.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,887 mnist_classifier_MNISTClassifier 5zkvkijf 3aac52f2-860f-44e4-a68e-1b0ff3f4c940 -- POST / 200 445.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,887 mnist_classifier_MNISTClassifier 5zkvkijf f9a35453-21b3-41a7-bf2b-d24ccd4f9ecb -- POST / 200 445.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,888 mnist_classifier_MNISTClassifier 5zkvkijf f55c2078-b463-4044-b7eb-3714a9bfcc73 -- POST / 200 445.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,888 mnist_classifier_MNISTClassifier 5zkvkijf 5dbdc6d7-a2ce-4003-85ad-796b1a6e46ce -- POST / 200 446.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,888 mnist_classifier_MNISTClassifier 5zkvkijf 54ebf39b-0df2-4f22-9abd-ab56c2ac2446 -- POST / 200 445.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,889 mnist_classifier_MNISTClassifier 5zkvkijf 51059a0c-ed35-4b77-9634-868b663e4563 -- POST / 200 446.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,890 mnist_classifier_MNISTClassifier 5zkvkijf 007a42af-c68c-4f1e-b110-bbe6a6a0eb8f -- POST / 200 446.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,890 mnist_classifier_MNISTClassifier 5zkvkijf dca65a9e-1aad-4b02-961f-cdd9ad2018d6 -- POST / 200 447.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,891 mnist_classifier_MNISTClassifier 5zkvkijf 42b77250-f05a-4c24-8deb-e980ce0f6bc9 -- POST / 200 448.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,892 mnist_classifier_MNISTClassifier 5zkvkijf 607837d2-77bb-4cb1-b141-5b4974d61f54 -- POST / 200 442.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,893 mnist_classifier_MNISTClassifier 5zkvkijf f781fd92-ee1e-4b44-b23a-891703e9c494 -- POST / 200 448.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,893 mnist_classifier_MNISTClassifier 5zkvkijf 94db9e4f-a4e6-45a3-ad40-01db738a728d -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,893 mnist_classifier_MNISTClassifier 5zkvkijf 702bec57-8303-492e-af87-4ac460cf8f99 -- POST / 200 410.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,894 mnist_classifier_MNISTClassifier 5zkvkijf fb34d600-8140-49a2-81bb-10a64d38c775 -- POST / 200 410.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,895 mnist_classifier_MNISTClassifier 5zkvkijf 542d3aca-6dfd-49ff-9b21-0ab3b6f7fdfd -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,902 mnist_classifier_MNISTClassifier 5zkvkijf 7e7b3b25-f790-4a38-a58a-bda30987894f -- POST / 200 411.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,904 mnist_classifier_MNISTClassifier 5zkvkijf acf2c9a0-fcdf-498d-a0a2-9fca24626850 -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,904 mnist_classifier_MNISTClassifier 5zkvkijf a1590006-ff6c-43d4-8457-ad5f3df68beb -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,904 mnist_classifier_MNISTClassifier 5zkvkijf cf632595-4cb2-4665-bfc1-2f5bb9570be1 -- POST / 200 404.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,905 mnist_classifier_MNISTClassifier 5zkvkijf a4b0bbee-93ab-4922-8b36-9edb83d5b1d3 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,905 mnist_classifier_MNISTClassifier 5zkvkijf a8dbe45e-beed-4651-b9d4-3528194a13ab -- POST / 200 404.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,906 mnist_classifier_MNISTClassifier 5zkvkijf c87a5896-6841-4601-9db0-28fd2c09ddd5 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,906 mnist_classifier_MNISTClassifier 5zkvkijf 52f6d93e-f779-4563-9f93-6a5f956e05d7 -- POST / 200 404.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,907 mnist_classifier_MNISTClassifier 5zkvkijf c4f097f8-df76-49f7-9b05-d5bdb670d70d -- POST / 200 405.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,907 mnist_classifier_MNISTClassifier 5zkvkijf 2656d61a-8eb8-4535-9734-15c27f885656 -- POST / 200 401.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,908 mnist_classifier_MNISTClassifier 5zkvkijf 33f5575a-f190-4a1e-8d6a-a2028a29afd1 -- POST / 200 398.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,908 mnist_classifier_MNISTClassifier 5zkvkijf 8444d88e-ae7d-433e-8577-52add147f146 -- POST / 200 397.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,909 mnist_classifier_MNISTClassifier 5zkvkijf 54bd34d2-cfb8-4709-855a-59f8ea54c87f -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,909 mnist_classifier_MNISTClassifier 5zkvkijf 44490cfe-6088-4b26-9937-324281ccc9ba -- POST / 200 387.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,910 mnist_classifier_MNISTClassifier 5zkvkijf 6b91af9d-55bb-49b2-86bd-6f4f4a4357d5 -- POST / 200 393.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,911 mnist_classifier_MNISTClassifier 5zkvkijf bd95568d-3786-442e-81fc-01618b77079a -- POST / 200 392.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,911 mnist_classifier_MNISTClassifier 5zkvkijf 84cf2a2b-cd8c-497b-8273-528a7c408cc2 -- POST / 200 391.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,912 mnist_classifier_MNISTClassifier 5zkvkijf 3abcf1b4-bb21-435f-b1c8-4dded2fa154d -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,912 mnist_classifier_MNISTClassifier 5zkvkijf 3c74ac85-b307-4a65-85c4-8d7bc9c3ee45 -- POST / 200 386.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,913 mnist_classifier_MNISTClassifier 5zkvkijf b9633d14-7f61-4917-9062-8d3280eef6c1 -- POST / 200 386.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,913 mnist_classifier_MNISTClassifier 5zkvkijf 274d451f-42ac-40a3-92d6-63812042c558 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,915 mnist_classifier_MNISTClassifier 5zkvkijf 9aa222ab-11f1-425a-9793-bd865fdb65fa -- POST / 200 387.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,916 mnist_classifier_MNISTClassifier 5zkvkijf e0d58406-3937-440f-9c16-c11c2c6d84c6 -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,916 mnist_classifier_MNISTClassifier 5zkvkijf 246c8c07-3efc-448a-bc72-2ba358d8cacf -- POST / 200 386.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,916 mnist_classifier_MNISTClassifier 5zkvkijf 8dae875e-6996-4a56-96cc-fa0cd2920ab1 -- POST / 200 386.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,917 mnist_classifier_MNISTClassifier 5zkvkijf 8f3a3415-f1f7-461b-804d-14fcdd6470b3 -- POST / 200 386.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,918 mnist_classifier_MNISTClassifier 5zkvkijf b67a5d8d-2c48-4179-b3e7-35277d7274f2 -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,920 mnist_classifier_MNISTClassifier 5zkvkijf 3cf3c198-7de3-4675-9a2c-cc8862516c30 -- POST / 200 388.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,921 mnist_classifier_MNISTClassifier 5zkvkijf 9affda6f-7181-4bcc-b284-a492c67ef3c9 -- POST / 200 389.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,921 mnist_classifier_MNISTClassifier 5zkvkijf 14bb8718-7b9b-47f1-b97c-0de3eec979c5 -- POST / 200 388.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,979 mnist_classifier_MNISTClassifier 5zkvkijf a442af6d-8a78-4503-bf95-94d11675be44 -- POST / 200 445.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,981 mnist_classifier_MNISTClassifier 5zkvkijf 7d653410-c67e-47c7-bc06-26ebffcfaa0f -- POST / 200 446.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,982 mnist_classifier_MNISTClassifier 5zkvkijf 70e10af3-a362-48f3-99f6-971954633ec9 -- POST / 200 446.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,982 mnist_classifier_MNISTClassifier 5zkvkijf 91045989-7109-455c-9270-62855964fc75 -- POST / 200 446.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,984 mnist_classifier_MNISTClassifier 5zkvkijf 3dbd0f61-6499-493c-a6af-043c50171989 -- POST / 200 372.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,985 mnist_classifier_MNISTClassifier 5zkvkijf 178008d8-6800-48a8-980b-4c2ab5188a7a -- POST / 200 372.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,985 mnist_classifier_MNISTClassifier 5zkvkijf a08510ed-4f57-4391-ae15-09efd91554df -- POST / 200 372.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,986 mnist_classifier_MNISTClassifier 5zkvkijf fa7888e4-0bfc-4bf6-8288-6eb3ec68ed2e -- POST / 200 373.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,987 mnist_classifier_MNISTClassifier 5zkvkijf d3391edd-5108-42ad-b40b-5f83de3e9c8f -- POST / 200 373.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,991 mnist_classifier_MNISTClassifier 5zkvkijf 4fbc5bad-83b2-47fc-948d-c94129d89cb0 -- POST / 200 375.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,993 mnist_classifier_MNISTClassifier 5zkvkijf a31c2fc3-e5ed-4e68-abf6-f380156afeb7 -- POST / 200 375.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,994 mnist_classifier_MNISTClassifier 5zkvkijf 744a985d-d922-44aa-90f1-3c731fbae2bd -- POST / 200 375.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,996 mnist_classifier_MNISTClassifier 5zkvkijf c7237e8d-aefd-42fc-abb8-9885184ed728 -- POST / 200 376.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,997 mnist_classifier_MNISTClassifier 5zkvkijf f2ce5726-9097-4a1e-b364-6db75583cac2 -- POST / 200 376.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,999 mnist_classifier_MNISTClassifier 5zkvkijf dac646c3-2c9f-435c-a34b-1425069ee5b4 -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,999 mnist_classifier_MNISTClassifier 5zkvkijf 79f4198a-e1c7-4a1c-9b89-795c00ec63c2 -- POST / 200 376.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:02,999 mnist_classifier_MNISTClassifier 5zkvkijf 40a8d4e4-ee7d-49d6-97d8-4a469dbf018a -- POST / 200 375.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,000 mnist_classifier_MNISTClassifier 5zkvkijf 940d3e50-c9dc-4204-9563-21ad1d8f44a1 -- POST / 200 372.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,010 mnist_classifier_MNISTClassifier 5zkvkijf 558afe0f-8c61-4e4c-b19e-aee72325d0fa -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,011 mnist_classifier_MNISTClassifier 5zkvkijf af0be70a-12c0-45fb-9d9d-ad0c82d3a0ad -- POST / 200 381.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,017 mnist_classifier_MNISTClassifier 5zkvkijf 41870aad-22d4-4114-8d7f-685c8e3dbb3c -- POST / 200 384.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,023 mnist_classifier_MNISTClassifier 5zkvkijf 78c1701a-51d5-41ef-a8b2-65b437c2cfdf -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,024 mnist_classifier_MNISTClassifier 5zkvkijf f757831e-fb41-4bdc-8d5c-d7f52c99b387 -- POST / 200 390.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,026 mnist_classifier_MNISTClassifier 5zkvkijf 5eb0a5db-c8c0-42fd-8c31-42bbfffb7c97 -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,027 mnist_classifier_MNISTClassifier 5zkvkijf 9768242b-1803-4ad1-8945-f3e01f3f00bf -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,028 mnist_classifier_MNISTClassifier 5zkvkijf cdb618e0-3683-4694-9bdf-ccdf20bcc2d1 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,028 mnist_classifier_MNISTClassifier 5zkvkijf f5375b3f-7043-429c-abb7-b6b786e3e7f4 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,028 mnist_classifier_MNISTClassifier 5zkvkijf 0c5f7599-5389-43eb-a29e-7dbfbd0ba8b6 -- POST / 200 389.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,029 mnist_classifier_MNISTClassifier 5zkvkijf 33702fe3-2820-472d-a357-9e73adfbc598 -- POST / 200 387.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,030 mnist_classifier_MNISTClassifier 5zkvkijf 604aa1d1-c034-4df1-b752-2dfff4578baf -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,031 mnist_classifier_MNISTClassifier 5zkvkijf fb092466-4f87-4114-96f5-bf90498c61c9 -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,031 mnist_classifier_MNISTClassifier 5zkvkijf e7a4a90a-4206-487a-a56b-620e2bc3b577 -- POST / 200 385.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,032 mnist_classifier_MNISTClassifier 5zkvkijf 6f92f7c4-483a-4de0-be35-43bd109e40c3 -- POST / 200 384.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,033 mnist_classifier_MNISTClassifier 5zkvkijf 9aad0c80-ae21-465e-a5c8-c72da48acd5e -- POST / 200 383.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,033 mnist_classifier_MNISTClassifier 5zkvkijf ebed95d1-94a9-4397-835e-55dbbee931be -- POST / 200 383.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,034 mnist_classifier_MNISTClassifier 5zkvkijf bf15812f-18bb-4e4f-8c83-534ef6185023 -- POST / 200 382.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,035 mnist_classifier_MNISTClassifier 5zkvkijf d7439883-2273-402c-917b-bdc2e4edd506 -- POST / 200 383.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,137 mnist_classifier_MNISTClassifier 5zkvkijf 08bdfb74-fd77-4686-bff2-db7426400b60 -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,138 mnist_classifier_MNISTClassifier 5zkvkijf c5242adb-f2f9-47c3-927b-b006b28678e9 -- POST / 200 430.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,138 mnist_classifier_MNISTClassifier 5zkvkijf 256b6484-1b90-4980-8835-6b7b02bb58c2 -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,138 mnist_classifier_MNISTClassifier 5zkvkijf c00e56f2-7ec2-4873-905d-8c308a7e7948 -- POST / 200 424.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,139 mnist_classifier_MNISTClassifier 5zkvkijf 80eb23e4-e7c3-4008-bc57-db915bdaea67 -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,139 mnist_classifier_MNISTClassifier 5zkvkijf 6b9e5552-ccac-412d-ac51-0a61ea8ae41d -- POST / 200 423.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,139 mnist_classifier_MNISTClassifier 5zkvkijf 035b8143-3176-46c0-b9ba-3e43f3c8db57 -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,140 mnist_classifier_MNISTClassifier 5zkvkijf 427ee02e-c4e9-41a1-8f73-4ac0e1976886 -- POST / 200 215.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,140 mnist_classifier_MNISTClassifier 5zkvkijf a898ec64-7797-4393-b027-c5e189a64469 -- POST / 200 215.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,141 mnist_classifier_MNISTClassifier 5zkvkijf c0f3ba09-f3c6-4ea7-8847-5c88f6146237 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,142 mnist_classifier_MNISTClassifier 5zkvkijf 08978edf-f5d7-4874-883a-db7b3839894b -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,143 mnist_classifier_MNISTClassifier 5zkvkijf 0062e963-b8fa-4513-884c-dc06649d5b5e -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,144 mnist_classifier_MNISTClassifier 5zkvkijf 3aa63eb5-0405-4448-8d29-93879fe4ff28 -- POST / 200 208.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,144 mnist_classifier_MNISTClassifier 5zkvkijf 1a9651f4-5fcb-4a50-9b25-cace5bdf181f -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,145 mnist_classifier_MNISTClassifier 5zkvkijf e82a78fc-cf88-4244-9caf-165d850d42e6 -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,146 mnist_classifier_MNISTClassifier 5zkvkijf b6fdb5b0-73b6-4829-906a-a938212bdb37 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,146 mnist_classifier_MNISTClassifier 5zkvkijf 7bd2bcf5-f169-4304-91b3-f838557e1eb4 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,146 mnist_classifier_MNISTClassifier 5zkvkijf d0eedaca-d237-4643-9c4b-0d6abfeff4c7 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,147 mnist_classifier_MNISTClassifier 5zkvkijf ae0bd0e1-ab4b-4306-abba-468122873e6c -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,148 mnist_classifier_MNISTClassifier 5zkvkijf 1329612b-2a0e-4809-aca8-b84ac759c886 -- POST / 200 208.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,148 mnist_classifier_MNISTClassifier 5zkvkijf f6a1f600-4260-4b3f-b082-5051e9ebc823 -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,149 mnist_classifier_MNISTClassifier 5zkvkijf fc082e20-bd08-461d-8056-0482df0eee4d -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,150 mnist_classifier_MNISTClassifier 5zkvkijf d7e23ec5-b6c6-43e0-8483-48646dd7717a -- POST / 200 207.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,150 mnist_classifier_MNISTClassifier 5zkvkijf 14597c21-0072-4438-b43c-2a738787e6b6 -- POST / 200 207.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,151 mnist_classifier_MNISTClassifier 5zkvkijf d7975bf6-b793-49f9-9f73-b5901f8fceca -- POST / 200 207.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,152 mnist_classifier_MNISTClassifier 5zkvkijf 8e0f0d3d-fbf0-4a0d-819b-4465e991090d -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,152 mnist_classifier_MNISTClassifier 5zkvkijf 50af65ba-1ad8-4fcb-95f6-97e873d2535d -- POST / 200 207.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,153 mnist_classifier_MNISTClassifier 5zkvkijf 291966ac-629a-4ddd-adc5-5ce213fbda83 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,153 mnist_classifier_MNISTClassifier 5zkvkijf 26ad4906-4c10-4c08-89f3-2c46d05c6512 -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,154 mnist_classifier_MNISTClassifier 5zkvkijf 90f461df-d5a2-49ac-934c-67f3afc9504b -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,155 mnist_classifier_MNISTClassifier 5zkvkijf 21adaa9c-9d35-4116-86fa-255e7e733492 -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,159 mnist_classifier_MNISTClassifier 5zkvkijf d04eadcf-ea56-43eb-9a91-d5f3f185cd9f -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,159 mnist_classifier_MNISTClassifier 5zkvkijf 23bd7809-764d-4ff2-8a09-58e0b181f7de -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,161 mnist_classifier_MNISTClassifier 5zkvkijf 107ab1c0-fcc0-4279-b622-9a6bab763d2b -- POST / 200 211.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,161 mnist_classifier_MNISTClassifier 5zkvkijf 26f00784-7c56-4571-acf4-73412ecf44ab -- POST / 200 207.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,161 mnist_classifier_MNISTClassifier 5zkvkijf 0d76e57d-9206-4860-a471-1bec3af0c32f -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,161 mnist_classifier_MNISTClassifier 5zkvkijf 5bc78064-a09d-42d5-adfa-77d7ec1e9faf -- POST / 200 207.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,162 mnist_classifier_MNISTClassifier 5zkvkijf 69df3d0e-1344-456e-b316-f0f3eaba51e5 -- POST / 200 210.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,162 mnist_classifier_MNISTClassifier 5zkvkijf 371577ba-4d8a-4824-a087-a4a647842c80 -- POST / 200 209.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,162 mnist_classifier_MNISTClassifier 5zkvkijf 859784f6-4704-49e2-ba71-6bd1243799a8 -- POST / 200 209.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4556) INFO 2026-03-09 18:08:03,163 mnist_classifier_MNISTClassifier 5zkvkijf 4f90d5e2-b3c9-47ed-8e3f-bcea6912d895 -- POST / 200 208.2ms
Processed 1000 requests in 5.18 seconds
Throughput: 192.88 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance#

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment#

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion#

In this tutorial, you:

  • Deployed a PyTorch model using Ray Serve with production best practices.

  • Enabled dynamic request batching to optimize performance.

  • Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

  • Tested the service with concurrent asynchronous requests.

Further reading#

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

For more information, see the Ray Serve documentation and Ray Serve examples.

Total running time of the script: (0 minutes 15.329 seconds)

On this page
PyTorch Libraries