.Net Debug Mode Performance Hit

Been running some memory intensive code (not a lot of memory, but a lot of calls to memory) in Visual Studio and from running my application in Debug Mode to compiling the application to a Release Build there is a 60% jump in performance.