phrase request - Is "what the hell" considered offensive?

Is "what the hell" used as just an expression, or is it considered offensive? In what situations is it "okay" to use it? If it is offensive, is there a more "polite" alternative which expresses the same feeling?