- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
My code reads multiple, really large files (say, about 2 or 3 GB each). Is there a rule of thumb to determine how many IO buffers (in my READ statements)I should use for the best performance? I don't know in advance how big the files are - they may be much smaller than 2GBat times. I suppose I should use a value of BUFFERCOUNT which depends on the size of my files.
Where can I find somedocumentation regarding this?
Thanks,
Olivier
Link Copied
1 Reply
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There isn't any written recommendation as it is very much application dependent. You'll have to experiment. Overestimating is not likely to be too harmful, other than the memory used for the buffer. I suggest reading the documentation section Optimizing Applications > Programming Guidelines > Improving I/O Performance
Depending on how your application is constructed, you may also want to look at the Fortran 2003 asynchronous I/O feature.
Depending on how your application is constructed, you may also want to look at the Fortran 2003 asynchronous I/O feature.
Reply
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page