CoCliCo: Extremely low bitrate image compression based on CLIP semantic and tiny color map

Tom Bachard (1) , Tom Bordin (1) , Thomas Maugey (1)

1 Sirocco - Analysis representation, compression and communication of visual data

Coding algorithms are usually designed to pixelwisely reconstruct images, which limits the expected gains in terms of compression. In this work, we introduce a semantic compressed representation for images: CoCliCo. We encode the inputs into a CLIP latent vector and a tiny color map, and we use a conditional diffusion model for reconstruction. When compared to the most recent traditional and generative coders, our approach reaches drastic compression gains while keeping most of the high-level information and a good level of realism.

Domaines: Informatique [cs]

Tom Bachard, Tom Bordin, Thomas Maugey. CoCliCo: Extremely low bitrate image compression based on CLIP semantic and tiny color map. PCS 2024 - Picture Coding Symposium, Jun 2024, Taichung, Taiwan. pp.1-5. ⟨hal-04478601⟩