grammaticality - How should I use "go + present participle"?

I read some activities are commonly expressed in English by "go + present participle." However, I found a sentence like "Let's go ride a bike!" and I am wondering which sentence I should use.

Yesterday, I went riding a bike.

Yesterday, I went ride a bike.

Let's go riding a bike!

Let's go ride a bike!