17.18First question

Ask:

“Do all 500,000 actually change every night?”

If only:

20,000

change, don't process 500,000.

Prefer:

incremental/delta sync

using:

watermark
LastModifiedDate
CDC
source change log