In my opinion, it is safe to slightly over-clock with a stock cooler. However I personally wouldn't even bother, until I had better cooler.I wish to know I fit is safe doing so with a stock cooler.
Here is someone that reached 4.8GHz.
i5 3570k @ 4.8ghz 75c hyper 212 evo