Community
cancel
Showing results for 
Search instead for 
Did you mean: 
pedro_r_1
Beginner
237 Views

AWS Lambda using Intel´s Distribution for Python?

 

Dear all,

As anyone managed to test the packages from this distribution, such as numpy and/or scipy, in AWS Lambda? If yes, would be very interested in understanding the steps needed to achieve this.

@Intel, would be great for users to have a github repository, as https://github.com/vitolimandibhrata/aws-lambda-numpy, for the optimized packages.

Best,

Pedro

 

 

0 Kudos
3 Replies
Robert_C_Intel
Employee
237 Views

Pedro,

We have not looked at Lambda, but it looks like a good idea. We will see if there is a way to install a MKL-optimized numpy. I am not sure how long it will take so if someone else has success, please share it. Thanks.

Robert

pedro_r_1
Beginner
237 Views

 

Hi Robert,

Thanks for taking a look. I guess with Numpy and Pandas many developers will be happy.

If I could add one more thing to the wish list is a docker image that includes the (optimized) intel python distribution.

Nonetheless, I am positively surprised with the performance of the distribution. Well done!

Pedro

 

pedro_r_1
Beginner
237 Views

 

Hi all,

It took me some days, but I managed to make it work in AWS Lambda. Using an Amazon Linux AMI, I set up a virtual environment pointing to the Intel Python 2.7 interpreter. Then I simply used pip to install Pandas and Numpy (got an error first as I didnt have some developer tools). 

Then I just zipped the virtual environment folder, and now I can import Numpy and Pandas in AWS Lambda. The total size of the zip file is around 25MB, so overall it is not a problem. There is probably a better way, ie, delete the test cases, etc, but at least it got me going with the library. 

I also tested f2py and it also worked like a charm in AWS Lambda. If there are some benchmarks that you would like me to run, just let me know. Happy to help.  

Will try to replicate the steps for the 2017 beta distribution in the next couple of days, and will post each and every step.

Regards,

Pedro

 

 

 

 

 

 

 

 

 

Reply