The CPU vs GPU performance debate has been going for a while. Our recent paper "A survey of CPU-GPU heterogeneous computing" published in ACM Computing Surveys 2015 seeks to change this mindset. This paper argues for moving away from CPU vs GPU debate, to CPU-GPU collaborative computing. It shows that merely offloading computational tasks to GPUs is not optimal, instead, using both CPU and GPU can lead to potentially higher speedup. This survey cites nearly 200 papers. Comments are welcome.