Skip to content

A scratchbook for machine learning and AI in visual effects

  • About

Author: admin

  • Home
  • admin

Retrieval Augmented Captioning with LLMs

February 19, 2025February 19, 2025 admin

One of the largest barriers to entry when training Stable Diffusion models is creating a fully captioned training dataset. Tools like CLIP or BLIP can auto‐generate captions for generic imagery,

Read More

AR Facial Pose Estimation

January 3, 2020April 14, 2024 admin

With the film industry beginning a shift toward virtual production, one of the next places for AI to make an impact is augmented reality. I’ve been curious about this for

Read More

Reverse Matchmove + Discriminator

January 22, 2019June 11, 2023 admin

One question which I ask myself when evaluating GAN and machine learning approaches to image generation is, “Can it work at high res?”. With some ok looking results from my

Read More

Reverse Matchmove GAN

December 23, 2018June 11, 2023 admin

At some point, most of us have needed to adjust a camera move in 3D. I’ve seen it done every way, from blocking out projection geometry to allow a slight

Read More

Lighting Swap CycleGAN

May 18, 2018June 11, 2023 admin

With the recent revamp of texture extraction/projection and photo modeling techniques rippling through the industry (and a general thirst for more information), the amount of photographs coming back from the

Read More

Beauty2Normals Neural Network

April 29, 2018June 11, 2023 admin

One of my favorite aspects of VFX is compositing CG, especially doing vector math and tricks with tech passes to finish off a shot. Often when I’m working with a

Read More

Neural Network for Generating HDRIs

February 8, 2018June 11, 2023 admin

Every lighting TD has been given a shot to light with no lighting reference or information from set to help determine the illumination before, this is the fun part of

Read More

Hello World

February 5, 2018June 11, 2023 admin

Hello All, Welcome to my blog! The reason I’ve created this blog is to share and get feedback on my experiments with machine learning. I’ve recently started learning about neural

Read More

Recent Posts

  • Retrieval Augmented Captioning with LLMs
  • AR Facial Pose Estimation
  • Reverse Matchmove + Discriminator
  • Reverse Matchmove GAN
  • Lighting Swap CycleGAN

Archives

  • February 2025
  • January 2020
  • January 2019
  • December 2018
  • May 2018
  • April 2018
  • February 2018

Categories

  • augmented reality
  • lighting
  • llm
  • matchmove
  • Uncategorized
All Rights Reserved 2022.
Proudly powered by WordPress | Theme: Fairy Dark by Candid Themes.