Intel® Fortran Compiler
Build applications that can scale for the future with optimized code designed for Intel® Xeon® and compatible processors.
28520 Discussions

Loading data faster

Petros
Novice
‎05-19-2011 07:56 AM
215 Views
Hi,
I have a program program that reads data from a text file, fills some arrays and vectors and runs a simulation. The data read from the file are the same every time (have to do with the structure of the system). The file is pretty big (>10mb) and unsorted, so loading the file every time is slow.
Is there a way to make the data part of the program? Make them into a sort of library and link with it? Convert them to binary? Any ideas are welcome!
Thanks,
Petros
0 Kudos

Link Copied

1 Reply
mecej4
Honored Contributor III
‎05-19-2011 08:02 AM
215 Views
If you put large initialized arrays into the executable image, the latter will be large. You can do a one-time write of the array(s) into an unformatted (or "binary") file and read the file in later runs.

Why is "unsorted" relevant? Why should the data being unsorted slow "loading the file"?
0 Kudos
Copy link
Reply

Community support is provided during standard business hours (Monday to Friday 7AM - 5PM PST). Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.