![]() The benefits of using a deep learning with VR include: Deep learning is already used by AI systems to carry out specific tasks by training on large data sets of relevant data, but has generally not be applied to VR systems. Instead of waiting for chipsets to advance and reduce in price, the Facebook team used a deep learning and developed an end-to-end convolutional neural network. But they can’t produce the effect in real time for sophisticated, rich content, because the processing demands are too high for even state-of-the-art chips. Traditional approaches, such as using an accumulation buffer, can achieve physically accurate defocused blur. The Facebook team explored traditional approaches to optimize computational displays, but the results did not align with expectations: Great VR has to work with objects that are close to you. To work around this problem, the VR industry has placed objects at a distance of 2 meters. If you try to look at something that is not in the focal plane, like an object that is close to you, things become blurry. Maria Fernandez Guajardo, head of enterprise AR/VR at Facebook, explains the challenge with this approach: But, Virtual reality (VR) applications typically focus on objects that are in your mid-distance as it matches the focal plane in which the image is in-focus. DeepFocus takes advantage of an end-to-end convolutional neural network that produces an accurate retinal blur in near real-time.ĭeepFocus is the underlying technology behind Half Dome, a prototype headset that leverages eye-tracking cameras, wide field of view optics and independently focused displays which provide lifelike VR experiences.Ī multidisciplinary team of researchers at Facebook Reality Labs (FRL) developed DeepFocus with a goal to deliver “experiences that are indistinguishable from reality”. ![]() This technology ensures nearby objects are in-focus, while distant objects appear out of focus, much like cinematic experiences. In a recent blog post, Facebook announced they have open-sourced DeepFocus, an AI powered framework for improving focus on close objects.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |