Niantic is involved in “location-based games” such as “Pokémon GO” and “Pikmin Bloom”. A game that entertains users with AR (Augmented Reality) and MR (Mixed Reality) using a VPS (Visual Positioning System) that identifies the situation based on information from the camera, and the game We are working to supporting developers who create On the other hand, how far have AR and MR spread in our lives?
This time, two engineers from the US headquarters are visiting Japan, so we asked them about the AR / MR world that Niantic is aiming for.
We spoke with Niantic Senior VP of Engineering Brian McClendon and Senior Director of Product Management Kjell Bronder.
Niantic Senior VP of Engineering Brian McClendon (left) and Senior Director of Product Management Kjell Bronder (right)
Two Solutions to Facilitate Third Party Development
In terms of content, meanwhile, it has been growing steadily, Shell said, adding that third-party developers have two solutions for creating AR content.
First, “Niantic 8th Wall” which can use the AR engine in the cloud, and then “Niantic Lightship” which can develop immersive native AR applications using Unity.
“Lightship” overlays various content on real world objects and renders them in real time. Content developed in Japan is also being developed, and Mr Shell said he expects “interesting ideas” such as “AR Street Painting” that can paint the real world and content from Japanese developers.
On the other hand, the “8th Wall” has content that allows you to easily experience AR with a web browser, and is used for promotions.
“8th Wall” cannot access AR Core, so it may be inferior to content using “Lightship”, but it is said that it can be used with sufficient accuracy for content marketing.
Regarding the “8th Wall”, Mr. Shell said, “I would like to tell you the good news,” and revealed that the Japanese version will be delivered in the second quarter of 2023. Mr. Shell said that the delivery of the Japanese version, including the website, making the content created by Japanese developers more enjoyable.
Niantic can create content from a human perspective
Niantic isn’t the only company developing AR technology. Google is also researching AR technology and releasing an SDK for app developers.
Regarding the difference from Google, Mr. Shell analyzed, “Google’s things are created based on Street View images, so compared to Niantic’s, there are more places that can be used, but the accuracy is low .” Niantic says it can provide around 150,000 spots and fewer but higher resolutions.
As for the photos used, Bryan said, “Google’s is taken out of the way with Street View.” Niantic said, “It’s something the user took with a smartphone, and it’s taken from a perspective closer to the human eye.” He expressed the idea that things would work better.
However, Brian explains that there are some issues that need to be resolved when developing with AR glasses.
First, he notes that AR glasses have battery issues. Glass requires a smaller battery, but does not extend the length. On the other hand, he said it would be difficult to use if the cables were separated. There are also problems with adjusting the light when going back and forth between dark and bright areas.
Shell also notes that the “viewing angle” is narrow. He said he would like to provide a display that is closer to the human viewing angle.
Regarding the need for AR glasses, Mr Brian said, “Smartphones currently have many disadvantages, such as being in the way, being heavy, and having to be taken out. He expressed his enthusiasm to pursue the opportunity of being able to do so.
Mr Shell also said, “If the device can better understand the events happening around the user, it will be possible to give the user better information.” For example, he pointed out that a guidance app could a way to provide better information to users who don’t understand Japanese by showing them “signs that can be understood even if they don’t understand Japanese”. Current AR glasses often include a camera on the front, but if this can cover 360 degrees such as the back and sides, the device can immediately understand information that the user does not notice and provide better content. I explained that was . The significance of these contents is that they can be used in a condition where both hands are free, and the quality of everyday life is greatly improved.
As for the current AR problem of dissociation between the real world and the overlay content, Mr. Bryan explains, “It’s not a visual quality problem, it’s a physical problem.” Mr Shell explained that this difference from reality also depends on the extent to which the device understands the surrounding situation. For example, in terms of content where a ball rolls, the phenomena that occur on the floor and on the surface of water are different. At the same time, it states that the processing power of the device is also affected.
Finally, Mr. Shell and Mr. Bryan said, “It’s very interesting because Japanese developers develop content with completely different ideas from American developers. “I was expecting to be able to interact with Tokyo, and I’m looking forward to the first Japanese content in the future.” (Mr. Brian) and said they have high expectations for AR content in Japan.
Brian also revealed that a game from Niantic in Japan is being developed following “Pokémon GO” and “Pikmin Bloom”. I can’t announce it yet, but I want you to look forward to it.
