progressive aspect - I'm giving up vs. I give up

Are both of the following sentences grammatically correct and, if so, is there any siginificant difference between simple and progressive aspect here?

I give up (on sth. / sb.)

I'm giving up (on sth. / sb.)