topic Take into account that /3GB in Software Tuning, Performance Optimization & Platform Monitoring

Address Windowing Extensions ( AWE ) technology on Windows platforms with Intel CPUs

SergeyKostrov — Thu, 06 Dec 2012 06:16:21 GMT

Hi everybody, It is a well known problem ( or limitation ) that a 32-bit application on some 32-bit Windows platforms can not allocate more than 2GB of memory. However, some 32-bit Windows platforms, for example Windows XP Professional or Windows Server 2003, support Address Windowing Extensions ( AWE ) technology ( designed by Microsoft ) and a 32-bit application could allocate more than 2GB of memory. Please take into account that Intel CPUs should have support for a Physical Address Extensions ( PAE ) feature. Enclosed is a very simple test-case in 'AweTestAppV1.zip' ( Visual Studio 2005 and up ) that tries to allocate different amounts of memory and allows to verify if a 32-bit application could allocate more than 2GB of memory on Windows platforms that support AWE. Notes: - An Intel CPU PAE feature is supported even on Intel Pentium(R) 4 CPU - A 32-bit Windows platform must support AWE ( for example, Windows XP Home doesn't support AWE ) - Please take a look at a small Readme.txt file for some technical details - For more information about AWE technology visit: http://msdn.microsoft.com/en-us/library/windows/hardware/gg487508.aspx Best regards, Sergey

Thanks Sergey!

Bernard — Thu, 06 Dec 2012 12:41:21 GMT

Thanks Sergey! I have already downloaded your source code and extensive testing will be performed later.

>>...I have already

SergeyKostrov — Thu, 06 Dec 2012 14:56:55 GMT

>>...I have already downloaded your source code and extensive testing will be performed later... Excellent and thank you. Here are two additional notes: - Start with 1.5GB ( you will see a set of defines / by default I set it to 2.5GB ) - 1.86GB was the maximum amount of memory the application was able to allocate in the Release configuration on a 32-bit Windows platform ( when LARGEADDRESSAWARE is enabled ) - Use the Windows Task Manager in order to see how memory is allocated - When defines: #define _INIT_ALLOCATED_MEMORY_PASS1 #define _INIT_ALLOCATED_MEMORY_PASS2 are uncommented it takes some time to complete the initialization of memory. I recommend to comment out both at the beginning of tests: // #define _INIT_ALLOCATED_MEMORY_PASS1 // #define _INIT_ALLOCATED_MEMORY_PASS2

>>>Excellent and thank you.

Bernard — Thu, 06 Dec 2012 21:03:52 GMT

>>>Excellent and thank you. Here are two additional notes:>>> Tomorrow I will post my results. Btw AWE memory mapping is more secure because it won't be paged out.

>>Tomorrow I will post my

SergeyKostrov — Fri, 07 Dec 2012 02:36:00 GMT

>>Tomorrow I will post my results... Excellent. Will you be able to make a couple of screenshots? >>...Btw AWE memory mapping is more secure because it won't be paged out... I'm simply interested... Where did you find that information? Is it a statement from Microsoft?

>>>Excellent. Will you be

Bernard — Fri, 07 Dec 2012 07:02:00 GMT

>>>Excellent. Will you be able to make a couple of screenshots?>>> I could , but I do not know how to make a screenshots(I'm not joking). >>>I'm simply interested... Where did you find that information? Is it a statement from Microsoft?>>> I strongly recommend you to read the ultimative source of Win OS knowledge a book written by Mark Russinovich titled "Windows Internals" in its 5 and 6 edition. Sadly there you won't find any source code examples, but the amount of information transmitted to the readers is amazing and very insightful. http://www.amazon.com/Windows-Internals-Part-Covering-Server/dp/0735648735/ref=sr_1_2?s=books&ie=UTF8&qid=1354865140&sr=1-2&keywords=windows+internals+7th+edition

>>...I could , but I do not

SergeyKostrov — Fri, 07 Dec 2012 13:24:12 GMT

>>...I could , but I do not know how to make a screenshots... There is a 'Print Screen' button at the top of keyboard ( usually in a right part ). After you pressed it create a new image in MS Paint and press 'Ctrl+V' ( Paste ), edit if something needs to be corrected or marked, and press 'Save As' to save the image as a jpg-image. Jpg-format is a significantly smaller in size then default bmp-format.

>>>There is a 'Print Screen'

Bernard — Fri, 07 Dec 2012 14:24:00 GMT

>>>There is a 'Print Screen' button at the top of keyboard ( usually in a right part ). After you pressed it create a new image in MS Paint and press 'Ctrl+V' ( Paste ), edit if something needs to be corrected or marked, and press 'Save As' to save the image as a jpg-image. Jpg-format is a significantly smaller in size then default bmp-format.>>> Thanks Today I was busy with my project(I'm writing GUI calculator in Java which will be able to compute special and elementary functions).Tomorrow I will test your application.

Hi Iliya,

SergeyKostrov — Fri, 07 Dec 2012 23:21:39 GMT

Hi Iliya, I'll be ready for any questions related to these tests. Best regards, Sergey

>>>I'll be ready for any

Bernard — Sat, 08 Dec 2012 06:24:27 GMT

>>>I'll be ready for any questions related to these tests.>>> Today I will do it. Will you be interested in my GUI calculator testing?

>>...Will you be interested

SergeyKostrov — Sat, 08 Dec 2012 06:55:23 GMT

>>...Will you be interested in my GUI calculator testing? Iliya, I'm very sorry but UI is no longer my specialization. However, if you make some screenshots of the application I'll be able to provide some limited feedback. Is it OK? Best regards, Sergey

Thanks .Later I will send a

Bernard — Sat, 08 Dec 2012 08:08:00 GMT

Thanks .Later I will send a fully working app. Now regarding your project I'm struggling with "bcdedit.exe /set PAE ForceEnable" option and it seems not effective I have memory failure allocation reportred by your app. I'm using win 7 and edited boot option with bcdedit.exe.

Tried also bcdedit.exe set/

Bernard — Sat, 08 Dec 2012 08:19:00 GMT

Tried also "bcdedit.exe set/ increaseuserva 3072" option wchich also was not effective(else statement is executed every time). Please post your OS configuration.What options were set in order to successfuly testr your app?

>>...I'm using win 7 and

SergeyKostrov — Sat, 08 Dec 2012 23:12:26 GMT

>>...I'm using win 7 and edited boot option with bcdedit.exe... I understood that you have Windows Server 2003 and I don't understand why are you using Windows 7. So, Please take a look at a Readme.txt file enclosed with the project. There is a link to a Microsoft's article about AWE and I also made a couple of notes. The most important are as follows: ... 1. ...test Microsoft AWE technology on Windows Server 2003 2. /3GB switch in Boot.ini file has to be used 3. Initial size of the Virtual Memory file has to be equal or greater than 3GB ... In order to set an Initial size of the Virtual Memory file please follow these steps: On Windows Server 2003 [ Start button ] -> Settings -> Control Panel -> System -> Advanced -> Performance Settings -> Advanced -> Change Virtual Memory -> Select 'Custom Size' radio button -> Set 'Initial size (MB)'=3072 and 'Maximum size (MB)'=8192 -> Press 'Set' button -> It is possible that a request to reboot the computer will be asked. Best regards, Sergey

Hello Sergey,

Patrick_F_Intel1 — Sun, 09 Dec 2012 05:08:45 GMT

Hello Sergey, Also note that 32bit apps on 32bit windows can use up to 3GB of memory. There is an article on this at http://msdn.microsoft.com/en-us/library/aa366778.aspx Pat

>>>I understood that you have

Bernard — Sun, 09 Dec 2012 06:25:05 GMT

>>>I understood that you have Windows Server 2003 and I don't understand why are you using Windows 7.>>> No.I 'm using Win 7,but I have a few VM's with various OS's already pre-installed. Today I will create another VM with Win Server 2003 and extensive testing will be performed. I will report about the results. >>>>On Windows Server 2003 [ Start button ] -> Settings -> Control Panel -> System -> Advanced -> Performance Settings -> Advanced -> Change Virtual Memory -> Select 'Custom Size' radio button -> Set 'Initial size (MB)'=3072 and 'Maximum size (MB)'=8192 -> Press 'Set' button -> It is possible that a request to reboot the computer will be asked.>>> Thanks.

Hi Iliya,

SergeyKostrov — Sun, 09 Dec 2012 18:35:12 GMT

Hi Iliya, >>No.I 'm using Win 7,but I have a few VM's with various OS's already pre-installed. Do you use a VirtualBox software? >>Today I will create another VM with Win Server 2003 and extensive testing will be performed. I hope that it won't take too much your time. The test is really simple and I expected that it could be completed in a couple of minutes. Thanks for all your efforts.

>>>Do you use a VirtualBox

Bernard — Sun, 09 Dec 2012 19:26:08 GMT

>>>Do you use a VirtualBox software?>>> No VMware workstation 7.

>>>>Do you use a VirtualBox

SergeyKostrov — Sun, 09 Dec 2012 21:06:00 GMT

>>>>Do you use a VirtualBox software? >> >>No VMware workstation 7. Thanks. >>...I hope that it won't take too much your time. The test is really simple and I expected that it could be completed in a couple of minutes. Iliya, please don't spend too much time on it unless you're really interested in AWE technology.

Hi Patrick,

SergeyKostrov — Sun, 09 Dec 2012 21:09:00 GMT

Hi Patrick, >>...There is an article on this at http://msdn.microsoft.com/en-us/library/aa366778.aspx. Thanks for the link and it has another link to a very good article: What is 4GT? http://technet.microsoft.com/en-us/library/cc786709(WS.10).aspx