It turns out it was caused by my new DLL referencing the base DLL... With all of these being in 1 solution. It required that it reference the project instead of the DLL directly. As soon as I referenced the DLL project instead of directly to the DLL, Visual Studio stopped complaining about the references. Kind of strange, but I guess for the dynamic debugger to work properly, it required this.
Thanks guys!