[C++11] Performance of casting and pointer

I played around with C++ trying to decrease build time by using pimpl and a base class.

Having some arbitrary base class in the pointer I need to cast it to the real data type when I wanna use it.
For the pointer I tried *, shared_ptr and unique_ptr and took times with and without casting.