I'm 95% sure it's true. In fact, it's an exercise in Folland (number 30 in chapter 1). Specifically :
, for any
there is an open interval
I know it isn't true for the unit interval in your example. However, I think there does exist an interval by the outer regularity of Borel measures.