With double-buffering, an enhancement you can try is to enable it only when adding, after adding you can disable, so that scrolling and other user operations will not delay....this is just a thought..you can try and see if it works..
Moreover on cpu usage, I tried switching between 3 browser windows and 2 VS windows by clicking on them in the task bar so that they will repaint themselves and I watched the cpu usage...it comes between 8-11% (once it came to 20% but only once and in another case 5% once among several rounds of clicking)...Try this and see how it shows for you...to get some understanding.