VETI - 3D-Guided Visual Effect Tuning on Images

Abstract

We present VETI, a framework that offers physically motivated image editing while remaining fully anchored to the input photograph. VETI poses photo editing as an interactive process within a rendering engine. It provides direct access to the physical properties of the scene by grounding lighting, object materials, and color palettes in an actual 3D representation of the image. Artists can edit real-world photographs with powerful tools typically reserved for synthetic assets, such as palette swatches, BSDF channels, and light rigs. Reflections and illumination changes are rendered realistically, replacing tedious painting of the approximated effects.

This work was developed by Mingrui and Duc Anh as a class project for CMPT 461/769 - Computational Photography at SFU.

Implementation

GitHub Repository for CMPT 461/769 - Computational Photography

Paper

Video

BibTeX

Related posters from CMPT 461/769: Computational Photography

Physically-Based Compositing of 2D Graphics Tyrus Tracey, Stefan Diaconu, Sebastian Dille, S. Mahdi H. Miangoleh, and Yağız Aksoy SIGGRAPH Posters, 2025 Abstract We propose an interactive pipeline that enables the seamless integration of a 2D logo into a target image, adapting to the surface geometry and lighting conditions of the scene to ensure realistic appearance. Manuscript & more BibTeX @INPROCEEDINGS{traceyDiaconuCompositing, author={Tyrus Tracey and Stefan Diaconu and Sebastian Dille and S. Mahdi H. Miangoleh and Ya\u{g}{\i}z Aksoy}, title={Physically-Based Compositing of {2D} Graphics}, booktitle={SIGGRAPH Posters}, year={2025}, }

Interactive Object Insertion with Differentiable Rendering Weikun Peng*, Sota Taira*, Chris Careaga, and Yağız Aksoy SIGGRAPH Posters, 2025 Abstract We develop an object insertion pipeline and interface that enables iterative editing of illumination-aware composite images. Our pipeline leverages off-the-shelf computer vision methods and differentiable rendering to reconstruct a 3D representation of a given scene. Users can add 3D objects and render them with physically accurate lighting effects. Manuscript & more BibTeX @INPROCEEDINGS{pengTairaCompositing, author={Weikun Peng and Sota Taira and Chris Careaga and Ya\u{g}{\i}z Aksoy}, title={Interactive Object Insertion with Differentiable Rendering}, booktitle={SIGGRAPH Posters}, year={2025}, }