170 / 279 · Module 11 — Salesforce Bulk Processing + Mule Batch Jobs · filtered: code← prev⊞ allnext →
11.36Large synchronization design
Requirement:
Every night synchronize 1 million customer records into Salesforce.
I'd immediately ask:
Do all 1 million change daily?
Probably not.
Better:
incremental/delta sync
using:
LastModifiedDate
watermark
CDC
source change log
Then maybe only:
25,000
actually need processing tonight.
The best bulk optimization is often:
Don't process data that hasn't changed.