VFX in the Real World: Screen Replacement

The world of film and video has been rapidly shifting and democratizing over the last decade. It is now possible to have one editor on a workstation accomplishing the work of an entire post-production house. Well, sort of….

In-house agencies are realizing that while they can bring in editors (staff or freelance) to competently manage most aspects of post, there are times when it makes sense to reach out to a specialist to help with the more technical challenges. There are instances where outsourcing certain scenarios, including VFX, may be the most effective route.

If you have a concept that requires photo-real compositing, like phone or PC screen replacement, tapping into a post house to supervise VFX can bring best practices on set, more upfront decision making, and ultimately, a smoother online edit.

If you’re embarking on a shoot and want to assure a proper, organic screen comp in the end, here are a few tools you may not have in house, but a post house can provide:

 Corner Pin Tracking

If your scene includes a phone or PC screen, your DP or Gaffer is not lighting for the screens; they are lighting for the overall environment. So, the screen detail will not be readable, hence the need for replacement.

When you're framing your shot, make sure to keep at least three corners of the phone or tv screen as visible as possible. The fourth point can be determined in post using trackers in Flame. Then provide the screen content as a separate element for compositing into the final shot. Shadows and reflections can be added to the screen based on the practical key lighting, and Voila! The final shot is seamless and organic.

Finger Rotoscoping

In layman’s terms, rotoscoping is the process of manually creating a matte for an element on a live action plate so it can be composited over another background. For instance, when shooting phone screens, you can feature the actual app screen on the device so your talent can interface and swipe. Then a post house will take the exposed screen capture or screen animation, rotoscope the live action, and use compositing tricks to blend the plate back into the shot.

Another consideration is the action in the shot. If a person's finger is swiping a phone screen that you'll be replacing, what do you do about the finger? This also needs to be rotoscoped in Flame, which means the finger will be traced frame by frame so that it can be layered back in.

Multi-Screen Replacement, Product Replacement and Set Extension

Many of these tools and techniques are transferable to product shots. We use tracking to replace a package or label, cover up an offending logo in the background of an exterior shot, or paint something out. And a post house can even add in background to your scene, something known as a set extension.

Bottle Replacement for Angry Orchard

Multi-Screen Replacement for New Balance

If any VFX inquiries arise or you’re looking to review your boards and receive suggestions on best practices to apply on set, I’m happy to help. The more we can discuss up front, the more seamless the screen replacement will be in post. Feel free to reach out to me directly at monty@finishboston.com

No Reader Comments

Leave a Comment

Recent Posts

Marketing Your Brand's Sustainable Practices

May 11, 2020

Many companies now adopt sustainable practices that go well beyond office recycling programs. Saving energy, reducing operational waste, curbing emissions, and developing green products are a few of the sustainable objectives being integrated into company missions and products.

As a result, brands …

Read Moreright arrow

Keeping it Fresh at Deloitte

April 27, 2020

  • by Jens Peterson, IHAF

The best in-house agencies strike an artful blend of consistency and innovation to drive growth. Deloitte’s Green Dot Agency (GDA) does just that while investing in key areas like talent, strategy and global partnerships. See how it’s done in this video from GDA, a recent finalist for IHAF's In- …

Read Moreright arrow