Skip to main content

OpenVINO GenAIDocumentation

Getting Started
Use Cases
Guides
Supported Models
Samples
Concepts

Concepts
Optimization techniques

Optimization techniques

Optimization techniques to OpenVINO GenAI.

📄️ Speculative Decoding

Note: This page is a work in progress.

📄️ KVCache Token Eviction Algorithm

Overview

📄️ Continuous Batching

Note: This page is a work in progress.

📄️ Prefix Caching

Note: This page is a work in progress.

Speculative Decoding

OpenVINO

OpenVINO™ Documentation
Case Studies

Legal

Terms of Use
Responsible AI

Privacy

Cookies
Privacy

Copyright © 2025 Intel Corporation Intel, the Intel logo, and other Intel marks are trademarks of Intel Corporation or its subsidiaries. Other names and brands may be claimed as the property of others.