topic Using FEAST for large matrix in IntelĀ® oneAPI Math Kernel Library
https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033302#M20252
<P>Hello,</P>
<P> I am presently working with FEAST to find eigenvalues and eigenvectors for a symmetric matrix. I need to solve N X N matrix with N ~ 10^6- 10^8. </P>
<P> Now I have few queries :</P>
<P> 1. SInce the size is large it is not possible to allocate this storage in a desktop (it has 8GB ram). Is there any way to handle large matrix of this size ?</P>
<P> 2. The matrix is also expected to be sparse for which I expect to store it in a compressed format and that can save some memory space. But the eigenvector matrix is also of the dimension N X N which I have to pre-allocate before calling FEAST. Hence the compressed storage will not be of much help. Is there any way to solve this problem ?</P>
<P> 3. Since FEAST fpm uses 64 iparm of MKL_pardiso, I have checked that iparm(60) helps to work using disk space storage. Can I use that in feast to solve this large problem ? However, in this case also I guess I have to pass eigenvectors (N X N) to FEAST which I have to pre-allocate. Can I use disk space somehow for this?</P>
<P> My program is working for moderate size matrices (10000 X 10000).</P>
<P> I would appreciate any help in this regard.</P>
<P>Thanks,</P>
<P>Dhiraj</P>
<P> </P>
<P> </P>
<P> </P>Fri, 26 Dec 2014 05:21:21 GMTHazra__Dhiraj_Kumar2014-12-26T05:21:21ZUsing FEAST for large matrix
https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033302#M20252
<P>Hello,</P>
<P> I am presently working with FEAST to find eigenvalues and eigenvectors for a symmetric matrix. I need to solve N X N matrix with N ~ 10^6- 10^8. </P>
<P> Now I have few queries :</P>
<P> 1. SInce the size is large it is not possible to allocate this storage in a desktop (it has 8GB ram). Is there any way to handle large matrix of this size ?</P>
<P> 2. The matrix is also expected to be sparse for which I expect to store it in a compressed format and that can save some memory space. But the eigenvector matrix is also of the dimension N X N which I have to pre-allocate before calling FEAST. Hence the compressed storage will not be of much help. Is there any way to solve this problem ?</P>
<P> 3. Since FEAST fpm uses 64 iparm of MKL_pardiso, I have checked that iparm(60) helps to work using disk space storage. Can I use that in feast to solve this large problem ? However, in this case also I guess I have to pass eigenvectors (N X N) to FEAST which I have to pre-allocate. Can I use disk space somehow for this?</P>
<P> My program is working for moderate size matrices (10000 X 10000).</P>
<P> I would appreciate any help in this regard.</P>
<P>Thanks,</P>
<P>Dhiraj</P>
<P> </P>
<P> </P>
<P> </P>Fri, 26 Dec 2014 05:21:21 GMThttps://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033302#M20252Hazra__Dhiraj_Kumar2014-12-26T05:21:21ZHi,
https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033303#M20253
<P>Hi,</P>
<P>You are correct - general approach to reduce memory size of internal MKL pardiso is using ooc algorithm (iparm(60)). But memory allocation for matrix Q is still needed. The only way to reduce size of matrix Q is divide search interval on several subintervals with reduced number of eigenvalues in each of it (but you have to know such estimation for each subinterval). After you need to call EE functionality for each subinterval and find eigenvalues for in each subinterval in loop.</P>
<P>Thanks,</P>
<P>Alex</P>Fri, 26 Dec 2014 05:29:54 GMThttps://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033303#M20253Alexander_K_Intel22014-12-26T05:29:54ZHello Alex,
https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033304#M20254
<P>Hello Alex,</P>
<P> Thanks a lot for your quick reply. I shall try your suggestion.</P>
<P>Thanks,</P>
<P>Dhiraj</P>
<P> </P>
<P> </P>Fri, 26 Dec 2014 06:30:04 GMThttps://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Using-FEAST-for-large-matrix/m-p/1033304#M20254Hazra__Dhiraj_Kumar2014-12-26T06:30:04Z