Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- Intel Community
- Software
- Software Development SDKs and Libraries
- Intel® oneAPI Data Analytics Library
- How to get model results out of PyDaal into python-usable format (Numpy, Pandas?)

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page

Matt_P_1

Beginner

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content

08-28-2017
05:07 PM

388 Views

How to get model results out of PyDaal into python-usable format (Numpy, Pandas?)

Hi,

I've searched the documentation on PyDaal but haven't been able to find a way to access the results of a trained and tested model within a Python script; for example, is there a way to output it as a NumPy array which can then be used further?

Thanks,

Matt

Link Copied

3 Replies

VictoriyaS_F_Intel

Employee

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content

08-30-2017
08:14 AM

388 Views

Hello Matt,

The methods for accessing the components of the machine learning models in Intel DAAL are algorithm specific

The example below shows how to get the access to the support vectors in the Support Vector Machine (SVM) model.

# Build the SVM model trainingResult = algorithm.compute() # Retrieve SVM model object from the training result model = trainingResult.get(classifier.training.model) # Retrieve numeric table with support vectors from SVM model svTable = model.getSupportVectors() # Read the numeric table of support vectors into numpy array block = BlockDescriptor() svTable.getBlockOfRows(0, svTable.getNumberOfRows(), readOnly, block) # Retrieve 2D numpy array with support vectors svArray = block.getArray() print(svArray) svTable.releaseBlockOfRows(block)

I attach the full example source code for your reference.

The complete list of SVM model accessors is available in DAAL API Reference: https://software.intel.com/sites/products/documentation/doclib/daal/daal-user-and-reference-guides/i...

Best regards,

Victoriya

Matt_P_1

Beginner

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content

10-22-2017
06:23 PM

388 Views

Hi Victoriya,

Thanks for the response. If I wanted access to the prediction result of a trained model on a new set of data, how would I access those predictions?

For example, in the file you attached, line 153 reads:

predictionResult = algorithm.getResult()

How do I access the predictionResult's predicted classes with Python? For example, I would like to do some tuning analysis like computing precision, recall, F1, etc. and would prefer to use Scikit-Learn implementations as those are common to the other pipelines in my project; to do so, however, would require accessing the prediction results as a Python array-like structure.

Thanks!

Matt

Preethi_V_Intel

Employee

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Email to a Friend
- Report Inappropriate Content

10-23-2017
10:18 AM

388 Views

Hi Matt,

You can obtain prediction results as a numeric table using the below command line

predictionValues = predictionResult.get(classifier.prediction.prediction)

predictionValues will have the support vectors

DAAL's SVM binary classifier only accepts class values 1 and -1. This is because predictionValues not only gives the value of support vectors but also a sign on each value which gives you information on the class. A negative sign on the predictionValues means that the observation belongs to '-1' class and '1' if not.

A numpy array format of predictionValues can be obtained using the following code

from daal.data_management import BlockDescriptor_Float64 doubleBlock = BlockDescriptor_Float64() predictionValues.getBlockOfRows(0, predictionValues.getNumberOfRows(), readOnly, doubleBlock) getArray = doubleBlock.getArray()

There are pre built helper classes and usage examples for PyDaal's SVM in GitHub repository. These classes provide methods to calculate Training Result, Prediction Result, Model Evaluation, Model Storage & Retrieval, relatively simplifying your effort in model building process. These methods will only require you to pass appropriate input parameters to perform each stage. Also you can refer to a gentle introductory series on PyDaal analytics model building process to get more details on the workflow.

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

For more complete information about compiler optimizations, see our Optimization Notice.