GUIDE DIRECTORY

Find your next useful idea.

Choose the decision you want to make. Each reading path connects a topic overview with focused, practical articles.

01 / Establish the delivery layer

Understand cache eligibility and origin delivery before adding a prediction model. Then evaluate one bounded warming experiment.

CDN machine learning: a practical guide to smarter delivery

Machine learning can help a delivery system choose what to cache, where to send traffic, and when to investigate unusual behavior. Start with a narrow decision, a clear baseline, and boundaries that remain dependable when predictions fail.

Read the cdn machine learning guide

Predictive caching: decide what to warm before demand arrives

Predictive caching moves a possible future miss ahead of the user's request. Learn how to rank eligible objects, set a warming budget, handle stale forecasts, and test whether earlier transfers improve delivery enough to justify their cost.

Read the predictive caching guide

API response caching without leaking private data

API caching starts with deciding who may receive a response. Learn how to review HTTP directives, design complete cache keys, separate public and personal content, and test identity boundaries before expanding a caching policy.

Read the api response caching guide
02 / Design the inference path

Decide where a model runs, how its artifacts arrive, and which endpoint should handle the request.

Edge AI vs cloud AI: where should inference run?

Inference placement starts with the job a model must do. Learn how to compare local devices, nearby servers, and cloud services using complete latency budgets, realistic memory measurements, privacy boundaries, and explicit fallback rules.

Read the edge ai vs cloud ai guide

Delivering ONNX models through a CDN: a deployment guide

Reliable model delivery requires more than uploading an ONNX file. Build a release process that binds models to runtime assets, verifies downloaded bytes, handles browser compatibility, and activates updates only when a complete working package is ready.

Read the onnx model cdn deployment guide

LLM request routing: balance quality, latency, and cost

A useful LLM router chooses among eligible models, budgets the entire request, and measures successful outcomes. Build a practical policy for deadlines, retries, streaming, evaluation, and gradual rollout without hiding quality failures behind lower request prices.

Read the llm request routing guide
03 / Operate with evidence

Connect measurements to user experience and cost. Keep privacy and authority boundaries visible during recovery.

CDN analytics: turn edge logs into useful decisions

Useful CDN analytics connects cache behavior, latency, and errors to a clear operational decision. Learn to define trustworthy metrics, interpret request and byte hit ratios, manage sampling and privacy, and test changes with meaningful guardrails.

Read the cdn analytics guide

Why p95 and p99 latency matter for edge applications

Averages can hide the requests that make an application feel unreliable. Learn what p95 and p99 describe, how to measure complete user journeys, and how to compare regional traffic and latency distributions without misleading aggregation.

Read the p95 and p99 latency guide

AI infrastructure costs: budget for the full request path

A useful AI budget follows each request from the edge to the model and back. Learn to separate billing from operational cost, model retries and caching, and connect infrastructure spending to successful user outcomes.

Read the ai infrastructure costs guide

An edge AI security checklist for delivery and inference

Edge AI security spans downloaded artifacts, inference requests, retrieved context, and the tools a model can reach. Use this practical checklist to make each trust boundary explicit and verify that release and runtime controls work together.

Read the edge ai security guide

Work from a concrete question

Before reading, write one sentence about the decision you are trying to make. Examples include reducing repeated origin work, supporting a model on lower-memory devices, or understanding why a small group of requests takes much longer. Keep the constraint and the evidence you need alongside that question.

After reading, choose one small next step: classify an object family, measure a complete request, verify a runtime dependency, or test a recovery path. The most useful guide is the one that helps you make a better decision in the system you actually operate.

Big questions. Clearer next steps.

Have an infrastructure question or a topic worth exploring?

Talk to CDNML