not to sayused to introduce a stronger way of describing something
- I prefer not to say, but... - Just between you and me.