Apple has reportedly acquired another arrow towards augmented reality acquisitions, taking over Spektral, a computer vision company with real-time compositing technology (known as "green-screen" technology in TV and film)] According to the Danish newspaper Børsen (subscription required), Apple bought the company, which was founded late last year by Toke Jansen and Henrik Paltoft as CloudCutout, for $ 30 million. Jansen's LinkedIn profile shows that he has served as the Computational Imaging Manager for the company since December 2017.
spectral technology applies machine learning and spectral graph theory (studying connections in a diagram) to remove background images and videos in real time.
Using an equation representing the levels in an image, the technology triggers unknown values in each pixel. This gives 16.8 million unknown values in each image, and Spektral solves these unknowns 60 times a second. Spectral is able to compensate for fine details and fast motion with the same approach.
"The human visual system is extraordinary By recognizing, segmenting, and joining, simply by thinking, researchers have been fascinated by these remarkable abilities for decades and have therefore attempted to build computer systems with similar characteristics, "it says on the company's website. "This is known to be a very challenging problem, but lately computers have been able to achieve human precision in certain recognition tasks and this trend will undoubtedly continue to bridge the gap between human cognition and artificial intelligence." The implications of this advancement are Away to new business models, because tasks that previously required human intervention can now be automatically solved by algorithms. "
Apple has introduced a similar background removal feature in its Clips app, although the feature requires the TrueDepth camera on the iPhone X Google has also developed a way to change video backgrounds using neural networks, while Facebook and Snapchat provide background segmentation.
Nevertheless, Spectral joins a massive amount of augmented reality talent and tools from Apple, including AR Displayman Akonia, headset maker Vrvana, and Flyby Media (who developed the code behind ARKit).
Do not Miss: NR30: The Augmented Reality Influencer of 2018