Banana 

I am white inside

Quite tasty when ripe

You don’t need a knife

To take a bite

I have yellow skin

If you are me, you are dim

As the words—Are you bananas? suggest

For which I have absolutely no respect