The 3D Creator is a preinstalled app that allows you to scan objects in 3D. The latest version offers five different scan modes:
- Selfie scan
- Face scan,
- Head scan
- Food scan
- Freeform scan
How does the 3D Creator work?
- The first part of the scanning process is calibration. The camera takes images as you circulate slowly around the object and an algorithm looks for characteristics that stand out in the images.
- Based on the camera orientation and captured images, a point cloud is created. The point cloud is quite rough and is colourless.
- Next up is a mesh. The mesh is, simply put, a group of 3D points called vertices. Using the points from the point cloud the algorithm sculpts the mesh allowing it to shape itself after the scanned object.
- Finally, the application creates the texture. The texture in this context consists of the colours of the object. Using the images captured during sculpting, the colours are projected onto the mesh. The texture has a fixed resolution but the quality and richness of detail depend on how well the sculpting is performed.
The app offers informative tutorials for every scan mode. Below is a screenshot from the face-scan tutorial.
After finishing a scan you can save and edit the creation, as well as share them or have them 3D printed. Scans are saved in the .OBJ file format(*) which is compatible with most 3D printers.
The creation can also be used as a 3D wallpaper, as well as integrated into the Sony Mobile AR effect application as an AR Object or AR Avatar.
There are currently no plans to handle other file formats than .OBJ.