word choice - How can I remember the difference between "lay" and "laid"?

I often confuse lay and laid. For instance, in selecting the appropriate word in these contexts:

She lay/laid a hand on his arm.
He lay/laid across the bench lazily.
We lay/laid down our heavy load.

Is there a common mnemonic for remembering which to use, and when?