Need to run LLM's on 10% of the hardware at 1,000X the speed w/o GPU's to make Ai/ML worthwhile

Software Tuning, Performance Optimization & Platform Monitoring

Discussion regarding monitoring and software tuning methodologies, Performance Monitoring Unit (PMU) of Intel microprocessors, and platform updating.

Need to run LLM's on 10% of the hardware at 1,000X the speed w/o GPU's to make Ai/ML worthwhile

305 Views

Solution to make Ai/ML LLM time series analysis profitable per subject parameters. Any ideas?

Link Copied

0 Replies

Community support is provided Monday to Friday. Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.