Blogs

cancel
Showing results for 
Search instead for 
Did you mean: 

Blogs

Posts

Enhancing long-context, high-concurrency LLM serving on a 32 GB workstation GPU: TurboQuant KV Cache

Long context LLM serving is running into a memory wall. The problem is not always raw compute. It is the KV cache, which grows with every token and every concurrent user.In this article, we show how T...
1 Kudos
0 Replies

Lablup adds Intel Arc Pro B70 support to Backend.AI

Building on its existing support for Intel Gaudi 2/3 AI accelerators, Backend.AI now extends its Int...
1 Kudos
0 Replies

Edge Devices From Sensors to Servers and the Silicon Inside

Edge devices are physical hardware that processes data at or near its source rather than in a centra...
0 Kudos
0 Replies

Remote Edge Management Beyond Deployment Day

Remote management at the edge is the ability to monitor, update, recover, and reconfigure distribute...
0 Kudos
0 Replies

Local AI and the Compute Architecture That Makes It Work

Local AI runs models directly on the device rather than sending data to the cloud. The definition is...
0 Kudos
0 Replies

Edge Computer Vision Beyond Pattern Matching

Edge computer vision is AI processing visual data on local devices rather than sending images and vi...
0 Kudos
0 Replies

Edge Computing vs Cloud Computing Beyond the Binary

Edge computing processes data at or near its source. Cloud computing processes data in centralized d...
0 Kudos
0 Replies

Data Sovereignty Starts Where Your Data Stays

Data sovereignty is the principle that data is subject to the laws of the country or region where it...
0 Kudos
0 Replies

Edge AI for Real-Time Analytics Beyond Low Latency

Edge AI for real-time analytics is processing data at or near its source to generate actionable inte...
0 Kudos
0 Replies

Edge Computing Latency Beyond Network Proximity

Edge computing latency is the time between a device generating data and receiving a processed respon...
0 Kudos
0 Replies

Agentic AI at the Edge Runs the Full Loop Locally

Agentic AI at the edge is autonomous intelligence that perceives its environment, reasons over multi...
1 Kudos
0 Replies

Edge AI Applications That Actually Reach Production

Edge AI applications are AI workloads that run on local devices to generate decisions without cloud ...
0 Kudos
0 Replies

Edge Computing Benefits Beyond the Generic List

Edge computing benefits are the measurable advantages organizations gain by processing data near its...
0 Kudos
0 Replies

What Is Edge Computing and Why Do Most Deployments Stall

Edge computing processes data at or near its source rather than sending it to a centralized cloud. T...
0 Kudos
0 Replies

Edge AI

Edge AI runs artificial intelligence algorithms on local devices rather than sending data to a centr...
1 Kudos
0 Replies