Banks, Bank Groups, Mats, and Parallelism Limits: Inputs and Outputs

Inputs and outputs contract

Inputs and Outputs for Banks, Bank Groups, Mats, and Parallelism Limits focuses on Sustainable bank-level parallelism (BLP) and page-conflict rate under tRRD/tFAW, bank-group timing, and activate-current limits.. The purpose is to turn memory observations into mechanism-backed actions with explicit owners and release-safe validation.

Use this contract for architecture, controller firmware, PHY, and validation handoffs. Missing inputs create expensive late-stage rework and inconclusive debug loops.

INPUTS
  - workload distribution and QoS target
  - firmware revision, controller policy profile, timing registers
  - data-rate / voltage / temperature operating state
  - training snapshot and reliability policy status

OUTPUTS
  - bottleneck classification with command-level evidence
  - owner-signed mitigation proposal
  - before/after trend for latency, bandwidth, and reliability
  - regression matrix with rollback triggers

Ownership split

MEMORY OWNERSHIP LAYERS - Banks, Bank Groups, Mats, and Parallelism Limits

artifact area     owner
----------------  ----------------------------
architecture    DRAM architect
controller FW   circuit designer
verification    memory controller owner
silicon bringup performance modeling owner

Rule: every signoff metric has a named accountable owner.

DRAM deep dive

Cell-array and subarray organization determines bitline delay, sensing margin, and locality-sensitive energy cost.

Concept diagram

ARRAY ORGANIZATION VIEW

rows x columns -> mats/subarrays -> local sense amps -> global I/O
physical distance shapes timing and energy

Metric graph

ARRAY ACCESS COST SHARE

bitline settle delay   ██████
sense/restore time     █████
global routing overhead ███

Reports and artifacts

• subarray toggle heatmap

• sense-amplifier utilization report

• bitline RC delay audit

• wordline coupling checklist

Mini case study

A dense address remap increased long-bitline activations, creating extra tRCD guardband and persistent tail-latency drift.

Debug branches

• Map hot addresses to mats and subarray boundaries

• Inspect sense-margin behavior under temperature corners

• Evaluate row-mapping changes before voltage retuning

Senior review question

Ask: which latency, bandwidth, and reliability evidence proves this DRAM topic is closed under real traffic?

Key takeaways

• Always tie controller and PHY counter shifts to application latency and throughput outcomes.

• Lock firmware timing profile, thermal condition, and DIMM state before comparing DRAM captures.

Common pitfalls

• Chasing peak bandwidth while ignoring p99 latency and fairness tails.

• Changing timing guardbands without separating SI noise from scheduling issues.

• Declaring closure without reliability gates, fault injection, and regression replay.

Handoff explanation

Inputs extend beyond timing registers. DRAM analysis inputs include traffic distribution, address map, queue policy, training state, SI/PI condition, thermal state, and firmware version.

Outputs must be action-ready: Sustainable bank-level parallelism (BLP) and page-conflict rate under tRRD/tFAW, bank-group timing, and activate-current limits., artifact packet (Bank-parallelism characterization report: BLP saturation curves, tFAW stress traces, and bank-group conflict heatmap.), bottleneck class, owner, expected gain, and rollback scope. "Bandwidth improved" without this packet is not signoff-ready.

The safest handoff is a before/after evidence set: environment tags, traces, hypothesis, chosen fix, rejected alternatives, and regression criteria.