Recreating the experience: An experiment in virtual reality journalism

By ILINA GHOSH

Staff Reporter

Canadian Press photo editor Marie-Espérance Cerda was in the midst of this year’s violent May Day protests in Montreal and her virtual reality coverage of the event allows audiences to share in the experience.

Cerda’s experiment in virtual reality journalism plunges the user into a three-dimensional world, entirely filling the user’s field of view with 360 degrees of video that shifts with the gaze of the viewer. Her project also pairs this video with real-time audio from the scene, completing the immersive experience.

 

rjrc sc
Marie-Espérance Cerda demonstrates her experiment in virtual reality journalism – playing in the background is her coverage of the 2015 May Day protests in Montreal. [Ilina Ghosh]

“With virtual reality you are no longer representing reality or an event, you are recreating an experience. You are trying to get someone to feel something,” said Cerda, who produced the immersive journalism experiment as the major project for her master’s in media production degree at Ryerson University.

Gene Allen, a professor at the Ryerson School of Journalism and the supervisor of Cerda’s work, praised the innovative nature of the project: “[It] allows viewers to focus on any aspect of the unfolding action, just as if they were there.

“You can look in one direction — with the images filling your whole visual field — and see the cops approaching, beating shields with their batons, then turn around and see the protesters cursing and throwing water bombs, then turn 90 degrees to see a group that broke off and ran up McGill College Avenue, then back to the cops — or wherever you like.”

Cerda said her interest in technology and its function in journalism led her to explore the relatively new concept of virtual reality as a journalistic medium. She is not, however,  the first to experiment with the tools. American journalist Nonny de la Peña, “the godmother of virtual reality,” pioneered the use of immersive technology in reporting. Her latest piece, Project Syria, commissioned by the World Economic Forum, simulates the bombing of a Syrian refugee camp. Each element of the film is drawn from real audio, video and photographs taken on scene.

Similarly, The Wall Street Journal took its readers on a roller coaster ride of the NASDAQ, while VICE News asked, “what if, instead of watching a news broadcast about the latest protest, you could walk into it?” when it created VICE News VR: Millions March. It places the viewer in the midst of 60,000 protesters on the streets of New York City.

“I saw huge potential. I wanted to do the same thing and see what the implications of that would be,” Cerda said.

Intrigued by the work of those before her, Cerda began creating her own piece of immersive journalism. To capture all 360 degrees of the Montreal riot, she walked the streets of Montreal with six GoPro cameras set into a 3D printed rig: the result is what looks like a baseball bristling with cameras pointing in six different directions.

Cerda’s rig of six GoPro cameras in action on May Day. [Marie-Espérance Cerda]

The rig and cameras used by Cerda to capture all 360 degrees of the protest. [Marie-Espérance Cerda]
The next steps involved asking Ryerson to purchase a computer program called VideoStitch and teaming up with an undergrad student to plug all the audio and visuals into a 3D content development software called Unity.

While Cerda’s video can also be watched in a two-dimensional interactive 360 degree video, it becomes immersive when viewed through the lens of Google Cardboard, a low-tech virtual reality viewing headset that attaches to a smartphone.

The headset, made of folded cardboard, two biconvex lenses, magnets, velcro and a rubber band, is available for around $20 from Google Cardboard. Users can also build their own Google Cardboard at home using Google’s free instructions, with the lenses available online and other materials available at home or at a hardware store.

Google Cardboard, the low-tech attachment used by Cerda to transform a smartphone into virtual reality viewer. [Handout/Google]
Unlike traditional broadcast journalism, immersive journalism does not involve narrating a story, Allen said.  “It’s an exploration. It’s much more similar to a game than a standard news story. You’re in a defined area, but how you move around is really up to you and yet it’s reality.”

While virtual reality journalism can offer a viewer a way to experience a story that traditional forms of journalism cannot, Cerda says it is just one of the tools in a journalist’s storytelling toolkit. “VR journalism can’t be a stand alone product… because you can’t get the full story in a virtual reality experience,” she observed. “It’s best place is to offer a different aspect of… the information so that you can better understand it.”

Cerda said one of the drawbacks with the new medium is that it cannot be edited like reels of traditional footage and will likely not be successful with all news audiences. In her research, she found younger males were most receptive to the technology, while people over 35 were less interested and more set in their ways in terms of how they received their news. She said producing immersive journalism is also more labour intensive and technologically demanding than current approaches.

Allen, a historian whose research involves exploring the impact of new technologies on journalism, said that despite the limitations, “[the future possibilities] are pretty amazing.”