Computer Architecture · All levels

ACE and CHI Protocol Introduction — Worked Example

Worked Example for ACE and CHI Protocol Introduction (Coherency and Memory Ordering).

Scenario

A coherent accelerator path migrates to CHI bridge and occasionally observes late completion after barrier acknowledgement.

Timeline

Metric fails at review meeting
Engineer captures metric report, trace snippet, and workload phase
Root cause traced to incorrect assumption from prior stage
Minimal architecture change or policy experiment applied and documented
Workload regression matrix re-run on the tagged model

Outcome

Ordering attribute propagation fix and completion queue policy correction remove mismatch with minimal throughput impact.

Senior debrief

After solving the example, write the debrief a lead would expect: what changed, why it worked, what could regress, and what permanent methodology update prevents recurrence.

diagram

STAFF ARCHITECTURE REVIEW MEMO — Coherency and Memory Ordering / ACE and CHI Protocol Introduction

1. Current state
   - Failing / watched metric: ACE/CHI interoperability readiness report
   - Workload / benchmark / trace: <fill before review>
   - Model tag, RTL tag, simulator version, PMU setup: <fill before review>
   - Scope: core, cache level, NoC path, coherency domain, accelerator, or SoC budget

2. Root-cause hypothesis
   - Most likely mechanism: <name pipeline/cache/NoC/coherency/perf mechanism>
   - Competing hypothesis: <name the second plausible cause>
   - Evidence still missing: <counter, trace, waveform, model sweep, or workload slice>

3. Proposed action
   - Minimal reversible change: <microarchitecture, policy, sizing, traffic, or software contract change>
   - Expected improvement: <metric delta>
   - Regression risk: Protocol adaptation bug can create silent coherency or ordering violations despite passing throughput benchmarks.

4. Regression and signoff
   - Re-run: ACE/CHI interoperability readiness report
   - Must not regress: System correctness under mixed CPU, DMA, and accelerator traffic.
   - Decision owner: Interconnect protocol architect

Before / after metric graph

diagram

METRIC TREND GRAPH — ACE and CHI Protocol Introduction

IPC / throughput
  ^
  |                  target
  |                 ─ ─ ─ ─ ─ ─ ─
  |            ● after bounded fix
  |         /
  |    ● baseline
  |  /
  |● failing run
  +---------------------------------> experiment index
    bad tag       hypothesis        accepted fix

Readout rule:
  - one dot is not a conclusion
  - compare against same workload, seed, model tag, and counter setup
  - explain why the fix moved the metric, not just that it moved

Architecture deep dive

Coherency protocols trade traffic, latency, and verification complexity.

Concept diagram

diagram

MESI STATE SKETCH

        read miss          write
 Invalid ─────────► Shared ───────► Modified
    ▲                 │  ▲             │
    │ invalidate      │  │ downgrade   │ writeback
    └─────────────────┘  └─────────────┘

The interview bar is not naming states; it is explaining traffic and ordering.

Metric graph

diagram

COHERENCY TRAFFIC STACK

read shared      █████████████  42%
read exclusive   ███████        21%
invalidates      ██████████     31%
writebacks       █████          14%
snoop retries    ███            8%

False sharing often appears as invalidation spikes.

Metrics and artifacts

coherency transaction rate
snoop/filter efficiency
ordering violation tests
false sharing counters

Mini case study

Performance regression traced to false sharing on a counter array — coherency traffic exploded. Architecture fix: per-core counters + periodic merge, not faster NoC alone.

Debug branches

If rare SW bug, run litmus and ordering tests before microarch changes.
If traffic high, profile sharing patterns at cache-line granularity.

Senior review question

Ask: what single metric would prove this concept is working or failing on your workload?

Key takeaways

Connect every architecture claim to a workload and measurable metric.
State verification and PPA impact before proposing design changes.

Common pitfalls

Feature-driven design without MPKI/IPC/bandwidth evidence.
Ignoring coherency and NoC traffic in cache and accelerator sizing.

Study notes

Re-read this topic with one concrete workload.

Practice this lesson