The 3-D selfie has arrived
by Staff Writers
Nottingham UK (SPX) Sep 27, 2017
Computer scientists at the University of Nottingham and Kingston University have solved a complex problem that has, until now, defeated experts in vision and graphics research. They have developed technology capable of producing 3D facial reconstruction from a single 2D image - the 3D selfie.
Their new web app allows people to upload a single colour image and receive, in a few seconds, a 3D model showing the shape of their face. People are queuing up to try it and so far, more than 400,000 users have had a go. You can do it yourself by taking a selfie and uploading it to their website.
The research - 'Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression' - was led by PhD student Aaron Jackson and carried out with fellow PhD student Adrian Bulat both based in the Computer Vision Laboratory in the School of Computer Science. Both students are supervised by Georgios (Yorgos) Tzimiropoulos, Assistant Professor in the School of Computer Science. The work was done in collaboration with Dr Vasileios Argyriou from the School of Computer Science and Mathematics at Kingston University.
The results will be presented at the International Conference on Computer Vision (ICCV) 2017 in Venice next month.
Technology at a very early stage
It has been developed using a Convolutional Neural Network (CNN) - an area of artificial intelligence (AI) which uses machine learning to give computers the ability to learn without being explicitly programmed.
The research team, supervised by Dr Yorgos Tzimiropoulos, trained a CNN on a huge dataset of 2D pictures and 3D facial models. With all this information their CNN is able to reconstruct 3D facial geometry from a single 2D image. It can also take a good guess at the non-visible parts of the face.
Simple idea complex problem
This is a problem of extraordinary difficulty. Current systems require multiple facial images and face several challenges, such as dense correspondences across large facial poses, expressions and non-uniform illumination.
Aaron Jackson said: "Our CNN uses just a single 2D facial image, and works for arbitrary facial poses (e.g. front or profile images) and facial expressions (e.g. smiling)."
Adrian Bulat said "The method can be used to reconstruct the whole 3D facial geometry including the non-visible parts of the face."
Their technique demonstrates some of the advances possible through deep learning - a form of machine learning that uses artificial neural networks to mimic the way the brain makes connections between pieces of information.
Dr Vasileios Argyriou, from Kingston University's Faculty of Science, Engineering and Computing, said: "What's really impressive about this technique is how it has made the process of creating a 3D facial model so simple."
Aside from the more standard applications, such as face and emotion recognition, this technology could be used to personalise computer games, improve augmented reality, and let people try on online accessories such as glasses.
It could also have medical applications - such as simulating the results of plastic surgery or helping to understand medical conditions such as autism and depression.
Aaron's PhD is funded by the University of Nottingham. His research is focused on deep learning applied to the human face. This includes 3D reconstruction and segmentation applied to the human face and body. Adrian Bulat is a PhD student in the Computer Vision Lab. His main research interests are in the area of face analysis, human pose estimation and neural network quantization/binarization.
Lausanne, Switzerland (SPX) Sep 07, 2017
Physical and biological sciences increasingly require the ability to observe nano-sized objects. This can be accomplished with transmission electron microscopy (TEM), which is generally limited to 2D images. Using TEM to reconstruct 3D images instead usually requires tilting the sample through an arc to image hundreds of views of it and needs sophisticated image processing to reconstruct t ... read more
University of Nottingham
Space Technology News - Applications and Research
|The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.