This is deliberate.
Consider the following scenario: you're viewing a page in portrait mode and you double-tap on a column of text to make it fit the width of the screen. If you now rotate the phone, the content is enlarged so that the column of text still fits the width of the screen.
As far as I know there is no way to stop this.
Was this post helpful? If so, please click on the white "Kudos!" star below. Thank you!