Artificial Intelligence (AI)
Discuss current events in AI and technological innovations with Intel® employees
676 Discussions

Roseman Labs Engine: Unveiling Breakthrough Performance with Intel® Liftoff

Eugenie_Wirz
Employee
0 0 884

Intel® Liftoff Catalyst Track member, Roseman Labs enables you to perform analyses across data sources without the need to share or expose the underlying data sources. 

Their unprecedented privacy and data security guarantees accelerate setting up data-driven collaborations. What sets this solution apart is the scalability, flexibility and simplicity to link data sets from several parties, and to develop AI models on top in a safe and compliant manner.

 

Setting New Benchmarks and Accelerating Encrypted Computing Innovation

 

In April 2024, Roseman Labs benchmarked the scalability and accuracy of their Engine (v1.10) against various implementations found in the public domain. (For background information about the benchmark setup, we refer the reader to Roseman Labs’ April 2024 benchmark whitepaper). What they found is that we are among the leaders of the encrypted computing space in terms of scalability and flexibility.

Today, in collaboration with Intel® Liftoff, they have repeated their secure table join, table filtering, and table group-by benchmark with the upcoming v1.14 Engine release on 6th Gen Intel® Xeon® Granite Rapids Scalable Processor 6980P servers.

Roseman Labs .jpg

 

The Result: 5x Faster and Redefining Scalability in Encrypted Computing

 

The graphs compare between version v1.10 and v1.14 of the Engine (corresponding to April ’24 and December ‘24 respectively), and depict how the throughput, measured in number of table rows per second, increases when we increase the number of CPU cores involved in the computation, for frequently used table operations: filter and join in the left graph, and group-by in the right graph. 

The right graph shows a five-fold throughput increase for group-by and close to two-fold throughput increases for filtering and joins. The updated benchmark demonstrates the significant performance impacts of key algorithmic innovations that have been incorporated into the Engine over the last months, and with that Roseman Labs’ commitment to continuously bring tangible product improvements to customers.

These advancements demonstrate how innovation can tangibly benefit our customers. With up to a five-fold increase in performance, Roseman Labs continues to lead the charge in delivering practical solutions for secure data analytics and AI.” - Niek J. Bouman, CTO, Roseman Labs

 

What’s next for Roseman Labs?

 

Looking ahead, access to proprietary data is a growing concern. According to Gartner, by 2027, 50% of AI will be trained on domain specific data, up from 1% today. Gartner also predicts that 60% of large organizations will use one or more privacy-enhancing computation techniques in analytics, business intelligence or cloud computing.

These trends motivate Roseman Labs’ three-pillar strategy:

  1. Enable secure training of AI models and secure inference on various data modalities, and offer interoperability (e.g. via ONNX) so that clients can use existing models with the platform, which will further shorten time-to-compliance for clients.
  2. Expand the scalability of their encrypted data space for confidential analytics on structured data, in terms of runtime performance, data volumes and cost-effectiveness.
  3. Ease integration with partners, technology integrators and Cloud market places, through product features and by enabling self-service deployments.

 

About Intel® Liftoff

 

Intel® Liftoff for startups is open to early-stage AI and machine learning startups. This free virtual program helps you innovate and scale, no matter where you are in your entrepreneurial journey.

 

Related resources

6th Gen Intel® Xeon® Scalable Processor - Latest generation of enterprise server processors

Intel® Tiber™ AI Cloud - Cloud platform for AI development and deployment

Intel® Gaudi® 2 AI accelerator - High-performance AI training processor designed for deep learning workloads

 

Related articles

A Closer Look at Intel Liftoff Startups Driving European Tech Manufacturing

Intel® Liftoff in Amsterdam: Doing AI Different at World Summit AI

About the Author
I'm a proud team member of the Intel® Liftoff for Startups, an innovative, free virtual program dedicated to accelerating the growth of early-stage AI startups.