Last week, Apple hosted two days of presentations in Cupertino and online, talking about how to create immersive content for the Apple Vision Pro — and it’s all available for free, on YouTube. While Day 1 (Create immersive media experiences for visionOS) had a mix of technical and video info about formats and app development, Day 2 (Create immersive media experiences for visionOS) focused entirely on production and post-production considerations for immersive media. 

If you’re remotely interested in 3D 180° immersive video, these sessions are very much worth your time.

Day 1 is more technical, and if you aren’t across the formats and terminology, check out the valuable format basics early up on Day 1, and then also check out a great presentation from Victor Agulhon, co-founder of Targo, about the app D-Day: The Camera Soldier (which I reviewed here a few months ago).

If you’re more interested in the video production and post-production topics, check out Day 2, in which cinematographers and audio specialists involved in shooting Apple Immersive pieces talk about all their techniques, including, in no particular order:

• how to frame your subject in immersive
• how to place your camera in immersive
• issues and big wins related to movement
• the importance of (and issues with) eye contact
• capturing and mixing Spatial Audio
• how to attach audio sources to objects in your frame
• how immersive means you can’t “cheat” like you can in regular filmmaking
• minimum comfortable distances for visible objects (larger environments work well)
• proper handling of dailies and how you need to watch them on a Vision Pro
• how the incredible Open Hearts music video for The Weeknd was made
• pre-viz for immersive and how it made that shot in Open Hearts possible
• differences in production, including the need for truly detailed set design and set-integrated lights
• the importance of foveated compression optimisation
• distribution challenges when a 10 minute file takes multiple terabytes
• how much or little editing is possible in certain contexts
• blending non-immersive 3D cameras with immersive cameras
• live immersive sports and concert capture — yes, how they shot the staggeringly good Metallica piece with 14 immersive cameras
• issues faced in unscripted productions like those the Wild Life, Boundless and Elevated series

Though this was officially classed as a developer event, I think this is Apple’s first long-form developer session to really spread out into video technology and be made public on their YouTube channel. It’s massively welcome, and a huge boost to anyone shooting in immersive.

A new tool was also announced. While Spatial Audio can be managed along with immersive video in DaVinci Resolve’s Fairlight tab, you can also use Logic Pro, or now ProTools. Apple have recently released the Apple Spatial Audio Format Production Suite (AAX) for working with Spatial Audio in Pro Tools, so grab it if you’re curious.

The new Apple Vision Pro Dual Strap is excellent

Last week also saw the release of the Apple Vision Pro with M5 and the new Dual Knit Band. That head strap is compatible with original Apple Vision Pro, and having tested it out myself now, I can definitely recommend it. If you have ever struggled with comfort while wearing the Apple Vision Pro, this new strap makes a massive difference. Yes, it’s heavier, but due to the placement of the extra weight, on the back of your head, it’s far more comfortable. For a detailed discussion, check out Adam Savage’s detailed review of the new Vision Pro and the new head strap.

Previously, I’ve used the ANNAPRO Pressure-Reducing Comfort Head Strap 2 extensively. While it’s been a huge help, this new head strap is easier to adjust, and will suit more heads.

However, the ANNAPRO does still work with the new strap and is still the best way to use an AVP without the Light Seal. The combination of the Dual Strap and the ANNAPRO is rock solid, even without the light seal, and does a better job of keeping the AVP from resting on your nose than any previous setup.

With the light seal removed, the field of view is larger, it’s lighter at the front by 99g, there’s more ventilation, and you’re more connected to your real environment. This might not be your choice when watching a movie if you want maximum isolation, but it’s superb for anything else. It’s also a nice way to share an immersive experience with others while not having to worry about any part of your Vision Pro touching anyone else’s face. (Especially anyone wearing make-up!)

Grab the new Dual Knit Band for $99 from Apple, and if you want to spend extended periods without the Light Seal, consider adding the ANNAPRO Pressure-Reducing Comfort Head Strap 2. 

Once you’ve gotten comfortable, you should check out a few new Apple Immersive videos. They’re still releasing new work, including Wild Life: Orangutans, and a sneaky press release last week announced in passing that a new Blackmagic URSA Cine Immersive Live camera will be used to stream several NBA games in the US next year, and will also be available for purchase next year.

We’ve had highlight reels and documentaries, but have been waiting for live sport; it’s finally coming soon. I can’t wait to see how they do this.

I suspect the best way to capture live sport in immersive might be to surround the court: cameras at each corner and the center of each side, and maybe place one above each basket. Editing can simply cut between them to follow the action. The talented production staff at Apple are clearly across this, though. Metallica proves that many viewers can handle (and love) quicker cuts and some close-up moments, and though immersive isn’t something everyone can experience yet, it’s amazing nonetheless.

Also: the Samsung Galaxy XR was released

Though this new headset is close to the Apple Vision Pro on paper, it’s not something I’m able to test myself; it’s only available in South Korea and the US right now. Read more about it in our article here.

From an Apple Vision Pro owner’s perspective, it’s frustrating that Netflix and YouTube have official supported apps on this new platform while the Apple Vision Pro, out for over a year, does not. Google Maps also supports a full 3D fly-over view, something which needs a third-party app on the Vision Pro.

Still, competition is welcome in this space, and I’d love more people to experience how wonderful high-quality immersive media can be. Immersive devices might never become mainstream, but they still feel like magic. If you can, check one out.