Blender + OSC Live Puppeteering Demo

In preparation for the release of OK Go's "Impulse Purchase" video tomorrow, it's time to share some files and info on how to use the setup. As we mentioned in the announcement, this is a procedural, live setup, which relies on Geometry Nodes, OSC, and some good old keyframing to make magic happen.

Demo File

Before releasing the full source of the music video, we'd like to share a simpler demo file that showcases how the live puppeteering setup works. This file, along with the add-on that lets you control the character with your face, is free for everyone!

In order to use this setup, you need:

• Blender 4.5 LTS
• The file (see below)
• The bespoke Foscap add-on (see below)
• The Live Link Face app on iOS or Android

Blender File - 4.1 MB - CC BY-SAokgo_impulse_purchase-demo-v005.blend

Blender File - 16.4 KB - GPLv3foscap-1.0.0.zip

Step by Step

Here is a detailed guide for getting you up and running:

1. Make sure your computer and your phone are on the same WiFi (or wired network).
2. Install (or make sure you have installed) Blender 4.5 LTS.
3. Install the add-on by dragging and dropping it onto the open Blender window. At the moment, this add-on is specific to the project, so once you're done testing, you may want to remove it.
4. Open the demo file. You may see a dialog regarding Python execution, press Allow Execution.
5. You will see a large 3D Viewport. Make sure that Viewport Shading is set to Rendered. On the right-sidebar, check out the Foscap tab. I should display two labels: "Address" and "Port".
6. Launch the Live Link Face app. Tap the gear icon to enter Settings. Under Mode, change it from "MetaHuman Animator" to ARKit. Under Streaming, Live Link, add a new Target and type in the IP address you see in Blender. You can also turn on Head Rotation for extra fun.
7. Go back to Blender and press Start OSC in the sidebar panel.
8. You are all set! Use a screen recording app on your computer and on your phone to record a take, stitch them together (you can use Blender's Video Sequencer for that), and share it online!

This is perfectly normal. Allow Execution!

Share the videos with us by using the hashtag #b3d and mention Blender Studio on Instagram and other social media.

Stay tuned for the release of the video tomorrow, when we will share more details on how the setup was built!