When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving ↗
Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill...