11.49Memory is an architectural constraint

Suppose each customer record averages:

5 KB

1 million records ≈ roughly:

5 GB raw data

before runtime/object overhead.

Obviously:

payload = giant array

is bad.

Think:

streams
pages
record blocks
persistent queues
batch aggregation

This is exactly why these frameworks exist.