Bridget Dolan and her team at Sephora’s Innovation Lab, based in San Francisco, were a year into developing a new virtual reality tool for the retailer’s mobile app when the technology used to power the experience saw a breakthrough.
“When it comes to augmented and virtual reality, it can only be successful if it’s truly useful,” said Dolan, Sephora’s vp of the Sephora Innovation Lab. “We weren’t interested in just buzzy. A lot of things like technical accuracy and timing had to come together, and there was a time last year when, during testing, we hit a tipping point.”
Sephora’s team and its technology provider, augmented reality platform ModiFace, had pushed facial recognition technology to a new point of sophistication. After months of development, the technology can break down one virtual makeup application into a step-by-step layering process, while maintaining critical accuracy and reaching mass scale.
In its mobile app, Sephora as fleshed out its augmented reality offerings with newly launched features. The Virtual Artist tutorial tool currently offers steps to perfecting a nighttime-perfect smoky eye, eyeliner three ways, brows three ways, contouring and highlighting. When in the tutorials, users see a video play in the bottom right of their screen that reflects their face shape and skin tone. As each step is completed, the product and instructions on how to apply it appear over their image.
The AR tool in the app also new features thousands of eyeshadow shades, as well as new “expert looks,” which feature full stylist looks at once.
Through the AR experiences, an “add to cart” option lets the testers dump every product that appears in the video into their mobile carts.
“Our time, money, effort and energy goes into teaching clients,” said Dolan. “To achieve new looks, you need to try new products, and if we can make you feel confident, you’ll be more engaged overall. It’s really about that halo effect, and we’re seeing sales through the app.”
Sephora’s mobile and digital strategy is built around the idea that when people know how to use a beauty product, and what tools are needed to complete a look, they’ll be more likely to buy it. They’re far from the only beauty company to realize that augmented reality could be the answer to selling beauty products online, where customers are typically expected to make decisions off of a few photos. Brands like CoverGirl, Rimmel London, Shiseido and OPI have launched augmented reality apps to let customers try on products using their phones.
“Beauty brands are constantly faced with the challenge of creating a connection between physical products and customers,” said James McCrae, head of digital strategy at Blue Fountain Media. “However, brands should only commit to something like AR if they’re going to keep investing.”
Source: The Glossy
Why It’s Hot
Sephora turned what could have been just a fluff application into a way to sell more products through its mobile app. By pivoting off of a customer need, tutorials, they found a use for AR that would increase sales. With more users making purchases directly from their mobile devices, giving them the same experience they could get in store keeps loyalty high.