Hugging Face introduced @huggingface/kernels, a collection of more than 200 WebGPU kernels. These kernels facilitate local AI inference by leveraging WebGPU technology, which is supported on various hardware platforms.
The kernels are designed to improve performance and compatibility for running models directly in web environments or local setups. This can help engineers optimize inference workflows without relying on cloud services.
The release aims to expand the accessibility of AI models by providing a broad set of tools for hardware-accelerated computation. It supports developers in deploying models efficiently on devices with WebGPU support.
