Skip to content
DenseChip
Learn
PracticeCode labInterview

DenseChip

Navigate

Menu

LearnPracticeCode labInterview

Tools

All toolsSV editorCode repoResume
DenseChip

Practice, courses, and chip-design tools in one focused workspace.

LearnPracticeCode labInterviewToolsLearning paths

© 2026 DenseChip

AboutContactPrivacyTerms
Skip to lesson

Course contents

  • How to Use This Course
  • Reading Path
  • Cache Coherency Glossary
  • The Shared Course Model
  • Cache Coherency Revision Sheet
  • Why Coherence Exists8
  • States and Protocols12
  • Transactions12
  • Races and Controller Design8
  • Progress and the Fabric16
  • Ordering and Synchronization12
  • Performance and Scalability12
  • Real Protocols12
  • SoC Integration12
    • LLC Data and Directory Policies
    • Devices and DMA
    • The Memory-Controller Boundary
      • Point of Coherence and Serialization
      • Memory-Controller Reordering
      • Same-Address Hazards Below the Home
      • Memory Latency and Coherence
  • Power, Clocking and Reliability12
  • Verification12
  • Debug and Bring-up12
  • Interview and Design Review17
  • Capstone: A Coherent Model Lab5
Loading lesson

‹The Memory-Controller Boundary
  1. Topics
  2. Cache Coherency
  3. SoC Integration
  4. The Memory-Controller Boundary
  5. Memory Latency and Coherence

Part 9 · SoC Integration · All levels

Memory Latency and Coherence

Measure backing-memory delay only on paths that actually depend on it.

Would faster DRAM fix this coherent miss?

First identify its required source and permission work. In a cold MESI snapshot with X = 0 and H U, backing memory is authoritative. In a warm C0 M / 1, C1 I / -, H exclusive(C0), memory = 0 snapshot, C0 must participate. A permission-only upgrade may need no new payload at all. These paths cannot share one universal DRAM-latency multiplier.

Existing course path

Backing-memory work

Other dependency to measure

Cold read

Current data read

Home admission, response delivery and fill acceptance.

Permission-only upgrade

No refill read for the retained value

Invalidation handling and H-collected acknowledgment.

Dirty read under MSI/MESI

Memory update before settled shared completion

Dirty-holder response and protected data acceptance.

Dirty transfer to another writer

No forced memory update in the selected path

Current-data forwarding and exclusive permission handoff.

Default dirty eviction

Write accepted before Put-Ack

WB capacity, memory-side queueing and acknowledgment delivery.

Classifying the executed path determines whether to examine backing service, peer transfer or permission-only work.
Latency attribution follows the actual transaction path.

Use the existing illustrative latency calculation rather than redraw it. Its cold GetS takes 43 illustrative cycles, 30 of them the memory read: that is the path lower DRAM latency directly helps. Its upgrade's 20-cycle serial subtotal contains 0 cycles of memory read, so cutting DRAM read time cannot reduce a term the upgrade never incurred. It could indirectly affect contention, which would be a separate measured effect.

For an eviction-heavy workload, backing delay can fill finite WB entries and backpressure private replacement, causing later demand misses to wait before they even reach H. Separate that queueing effect from the service time of the current demand read. Review the existing controller resources to locate the blocked storage.

Any eventual-completion claim assumes eventual memory service, reliable delivery, protected finite buffers, fair relevant scheduling and eventual receiver acceptance. A maximum-cycle promise additionally needs bounds on refresh/interference, queues and service under the chosen memory contract. A finite average is not such a bound.

Common pitfall

Attributing every long coherent miss to DRAM even when the newest data is private or the request is stalled on permission.

Interview

Give one miss helped directly by lower backing latency, one not directly helped, and one affected indirectly through WB backpressure.

Check yourself Can reducing DRAM read latency directly shorten the permission-only upgrade's four message legs?

Not in the selected path. Its retained data needs no backing read. Any improvement would need another changed dependency, such as reduced shared-resource contention, supported by evidence.

Related topics

  • Shared course model

  • Backing delay can retain WB capacity

Previous

109 / 167

Next: Power, Clocking and Reliability

Up next

Up nextPower, Clocking and Reliability

Sign in to save progress

Practice this lessonReport an error

See also

  • Point of Coherence and Serialization
  • Memory-Controller Reordering