Farmers Assistance Chatbot using Intel® Extension for PyTorch*

Every day, farmers face challenges in agriculture due to insufficient knowledge of crop management and farming techniques. Usha Rengaraju, in her blog, proposed a solution for such problems: a Farmers Assistance Chatbot that helps farmers get timely assistance with queries related to agriculture.

In this project, Gemma model (Google’s open LLM) is fine-tuned on Intel® Xeon® processors using Hugging Face Supervised Fine-tuning Trainer (SFTTrainer) and Intel® Extension for PyTorch*.

The blog explains the various steps involved in the project:

1. Install the necessary packages and load the dataset 
2. Data Visualization
3. Fine-tuning the Gemma model
4. Model testing

Read more about the project on Medium and GitHub.

Learn more about Intel Extension for PyTorch

Intel Extension for PyTorch: The Intel extension expands PyTorch with up-to-date features and optimizations for an extra performance boost on Intel hardware. Check out how to install Intel Extension for PyTorch. The extension can be loaded as a Python module or linked as a C++ library. Python users can enable it dynamically by importing intel_extension_for_pytorch.

• The CPU tutorial gives detailed information about Intel Extension for PyTorch for Intel CPUs. Source code is available at the main branch.
• The GPU tutorial gives detailed information about Intel Extension for PyTorch for Intel GPUs. Source code is available at the xpu-main branch.

What’s Next?

We encourage you to check out and incorporate Intel’s other AI/ML Framework optimizations and end-to-end portfolio of tools into your AI workflow and learn about the unified, open, standards-based oneAPI programming model that forms the foundation of Intel’s AI Software Portfolio to help you prepare, build, deploy, and scale your AI solutions.

About the Author:

Usha Rengaraju is an AI consultant and the World’s first woman triple Kaggle Grandmaster. She specializes in deep learning and generative AI. Analytics India Magazine ranked her among the top ten Data Scientists in India for 2020 and Analytics Insight magazine ranked her among the top ten women data scientists for 2021.