Sounds like you have an Orange branded/customized version of the phone. I'm afraid that thing can't be removed (without reflashing the phone with generic/retail version of phone software/firmware, instead of the Orange version).
Search for other posts mentioning the Orange home screen & you'll see.