Over the past year, uses for agentic LLMs have started to pop up in the realm of VFX, tools that can inspect your scene contents, make modifications, and even some
Author: NeuralVFX
Image Dataset Extraction from Video
Every great ML model is built on a foundation of great data, but creating it is often a soul-crushing chore. Several months ago I was handed a large piece of
Retrieval Augmented Captioning with LLMs
One of the largest barriers to entry when training Stable Diffusion models is creating a fully captioned training dataset. While tools like CLIP or BLIP can auto-generate captions for generic
AR Facial Pose Estimation
With the film industry beginning a shift toward virtual production, one of the next places for AI to make an impact is augmented reality. I’ve been curious about this for
Reverse Matchmove + Discriminator
One question which I ask myself when evaluating GAN and machine learning approaches to image generation is, “Can it work at high res?”. With some ok looking results from my
Reverse Matchmove GAN
At some point, most of us have needed to adjust a camera move in 3D. I’ve seen it done every way, from blocking out projection geometry to allow a slight
Lighting Swap CycleGAN
With the recent revamp of texture extraction/projection and photo modeling techniques rippling through the industry (and a general thirst for more information), the amount of photographs coming back from the
Beauty2Normals Neural Network
One of my favorite aspects of VFX is compositing CG, especially doing vector math and tricks with tech passes to finish off a shot. Often when I’m working with a
Neural Network for Generating HDRIs
Every lighting TD has been given a shot to light with no lighting reference or information from set to help determine the illumination before, this is the fun part of
Hello World
Hello All, Welcome to my blog! The reason I’ve created this blog is to share and get feedback on my experiments with machine learning. I’ve recently started learning about neural