augmented reality news, articles and features | New Scientist /topic/augmented-reality/ Science news and science articles from New Scientist Tue, 06 Jun 2023 09:31:33 +0000 en-US hourly 1 https://wordpress.org/?v=7.0.1 242057827 Apple Vision Pro won’t solve the problems with virtual reality /article/2377029-apple-vision-pro-wont-solve-the-problems-with-virtual-reality/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS Mon, 05 Jun 2023 19:26:31 +0000 /?post_type=article&p=2377029 Apple has announced its first VR headset
Apple has announced its first VR headset
Apple

Apple’s newly announced virtual reality headset promises to blend the real world with video and audio, ranging from immersive FaceTime video chats to watching films and shows on a huge virtual movie screen. But even the company that pioneered the modern smartphone may not have great expectations for its $3499 device at a time when rival Silicon Valley giants such as Meta and Microsoft have struggled to make VR go mainstream.

“Apple’s headset is both experimental and expensive,” says , a historian of technology at Virginia Tech. “The same was true for many other eventually successful devices, including the iPhone, but those technologies were opening up new spaces, whereas Apple is entering well-trod ground where others have failed.”

Apple’s Vision Pro headset presented at its annual Worldwide Developers Conference on 5 June is designed to deliver blended reality experiences for many familiar apps made by Apple, Microsoft and other companies that mix virtual and physical spaces for work and entertainment. The headset also provides a “see-through” experience that shows the wearer’s eyes and allows for interaction with other people in the physical world even while the wearer is interacting with virtual experiences. It even creates a digital persona to replicate the appearance of the wearer for use in FaceTime conversations and other experiences.

Scheduled to become available for purchase in early 2024, the headset is connected by a woven cable to a pocket battery that supports up to 2 hours of use and supposedly runs almost silently and at a comfortable temperature. It also contains a new Apple computer chip called R1 that processes information from 12 cameras, five sensors and six microphones in an attempt to eliminate sensor lag. The headset can be controlled solely through the wearer’s visual gaze, voice and small hand gestures such as pinching and flicking motions.

Silicon Valley has been trying to make some version of XR – the catchall phrase for virtual reality, augmented reality and mixed reality – go mainstream for decades, says , author of the book Making a Metaverse That Matters. Apple’s Vision Pro headset is technically a mixed reality device that enables wearers to access immersive virtual experiences while still seeing the outside world.

Apple's Vision Pro headset
Apple’s Vision Pro headset
Apple

Part of the challenge for XR headsets has been the steep cost, along with the physical discomfort and awkwardness of using bulky headsets. But another significant issue that has been overlooked by many tech companies involves the many people who experience which is like motion sickness, says Au.

Despite having so far, Meta has struggled to keep VR users returning to the virtual experiences available in its previously touted . Shortly before Apple’s headset announcement, Meta CEO his company’s upcoming Quest 3 VR headset that also offers a mixed reality experience.

Meanwhile, Microsoft had sold just 300,000 units of its HoloLens headset as of late 2022 while similarly failing to gain traction for its own .

Virtual reality and other XR headsets failed to gain significant traction even during the pandemic when millions of people stayed closer to home – global by more than 12 per cent between 2021 and 2022. “The base of VR users remains small and is still almost wholly in video games and other forms of entertainment,” says Vinsel.

Given that backdrop, Apple has projected sales of less than 100,000 units of its headset and total production of potentially just 300,000 headsets, according to . If the headset doesn’t sell well even based on those modest goals, Apple could still “present it as a prototype or as an early adopter thing” and market it primarily for business customers, says Au.

Apple’s headset development has cost the company more than $1 billion per year, according to . But as the world’s largest company and profits of almost $100 billion in 2022, the company can afford to bet on a multibillion dollar VR experiment even if it completely fails.

“They could throw a billion dollars at research in VR and not even notice it,” says Au. “That’s like the change of their couch.”

]]>
2377029
Drones on strings could puppeteer people in virtual reality /article/2337889-drones-on-strings-could-puppeteer-people-in-virtual-reality/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS Fri, 25 Nov 2022 15:35:53 +0000 /?post_type=article&p=2337889 2337889 Invisible 3D printed tags turn simple objects into gaming controllers /article/2319877-invisible-3d-printed-tags-turn-simple-objects-into-gaming-controllers/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS Wed, 11 May 2022 22:00:47 +0000 /?post_type=article&p=2319877 2319877 VR with muscle-stimulating tech that can force you to move your head /video/2318460-vr-with-muscle-stimulating-tech-that-can-force-you-to-move-your-head/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS Tue, 03 May 2022 10:44:54 +0000 /?post_type=video&p=2318460 Applying muscle-stimulating electrodes to carefully selected points on the necks of volunteers can force the wearer to look up or down, or side to side – which could be useful for steering attention in a 3D virtual reality training or gaming environment, but potentially in augmented reality applications in the real world, too. Currently, the only systems capable of steering the head are the robotic exoskeletons used by medics for neck rehabilitation.

]]>
2318460
VR could use a muscle-stimulating device that forces your head to turn /article/2318401-vr-could-use-a-muscle-stimulating-device-that-forces-your-head-to-turn/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS Tue, 03 May 2022 06:00:40 +0000 /?post_type=article&p=2318401 2318401 What is a metaverse and why is everyone talking about it? /article/2286778-what-is-a-metaverse-and-why-is-everyone-talking-about-it/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS Wed, 11 Aug 2021 16:25:55 +0000 /?post_type=article&p=2286778 2286778 Augmented reality glasses help kids with autism relate to others /article/2166942-augmented-reality-glasses-help-kids-with-autism-relate-to-others/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS /article/2166942-augmented-reality-glasses-help-kids-with-autism-relate-to-others/#respond Thu, 19 Apr 2018 17:02:07 +0000 /?post_type=article&p=2166942 /article/2166942-augmented-reality-glasses-help-kids-with-autism-relate-to-others/feed/ 0 2166942 3D ‘holograms’ made with lasers by moving one particle at a time /article/2159456-3d-holograms-made-with-lasers-by-moving-one-particle-at-a-time/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS /article/2159456-3d-holograms-made-with-lasers-by-moving-one-particle-at-a-time/#respond Wed, 24 Jan 2018 18:00:02 +0000 /?post_type=article&p=2159456 /article/2159456-3d-holograms-made-with-lasers-by-moving-one-particle-at-a-time/feed/ 0 2159456 Did Pokémon Go really kill 250 people in traffic accidents? /article/2154881-did-pokemon-go-really-kill-250-people-in-traffic-accidents/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS /article/2154881-did-pokemon-go-really-kill-250-people-in-traffic-accidents/#respond Tue, 28 Nov 2017 15:57:33 +0000 /?post_type=article&p=2154881
Pokemon road safety sign
Distractions can kill
Daren Fentiman/Zuma/Eyevine

Using a mobile phone while driving is dangerous. Trying to catch Pokémon at the wheel could be even worse. According to a new analysis, the mobile game Pokémon Go may have contributed to nearly 150,000 traffic accidents, 256 deaths and economic costs of $2 billion to $7.3 billion in the first 148 days after its introduction to the US.

These figures come from extrapolating the effects of Pokémon Go on Tippecanoe county in Indiana to the whole of the US, so should be taken with a pinch of salt. However, even in this locale, there was a substantial increase in traffic accidents following the game’s launch. The researchers say they were able to attribute 134 crashes, two of them fatal, across the county to Pokémon Go between July and November 2016, out of a total of 286.

“We used the most conservative assumptions that were supported by the data. We are quite confident of the extrapolation and, if anything, we are understating the effect,” says at Purdue University, who carried out the study with colleague John McConnell, also at Purdue.

Pokémon Go is an augmented reality app that adjusts a person’s surroundings through the lens of their smartphone camera. A player at the right location can see cartoony creatures called Pokémon, as well as finding PokéStops where they can restock supplies or Gyms where their Pokémon can battle those of other players.

Clusters of crashes

Because battles at Gyms take so long, it is essentially impossible to be driving and also battling. However, PokéStops can be used quickly and so someone might be able to top up their supplies while still at the wheel. Faccio and McConnell’s analysis found that traffic accidents in Tippecanoe county were clustered around PokéStops but not Gyms, suggesting aspects of the game were leading to dangerous driving.

This clustering allowed the pair to make the association to Pokémon Go, but it is likely that other apps are just as bad. Up until 2011, the had experienced a 25-year decline. This has since reversed and some have suggested that mobile phones are to blame, but they were widespread well before the upturn. Could apps be the problem?

In 2008, Apple’s App Store had 800 apps with 10 million downloads. By 2011, this had shot up to 500,000 apps and 18 billion downloads, and has continued growing at a rapid pace. Chatting on a mobile phone while driving is distracting enough, but people using apps may have just been enough to reverse the trend.

Though the figures seem shocking, the study’s methods seem reliable. “The statistical analyses they performed appear to be sound, correctly applied and actually statistically significant,” says at the University of Michigan.

However, he is sceptical about how applicable the findings are for a wider geography or population. “I believe these results for Tippecanoe county, Indiana, are accurate and probably reliable. But I am not so sure that this county is very representative of the rest of the country,” he says. For example, the county is mostly rural with a major urban area and a major university that has many young, inexperienced drivers. “To claim to be able to estimate larger financial effects for the country is not necessarily supported by the data they analysed,” says Schoettle.

Reference: SSRN,

]]>
/article/2154881-did-pokemon-go-really-kill-250-people-in-traffic-accidents/feed/ 0 2154881
App creates augmented-reality tutorials from normal videos /article/2146850-app-creates-augmented-reality-tutorials-from-normal-videos/?utm_campaign=RSS|NSNS&utm_content=augmented-reality&utm_medium=RSS&utm_source=NSNS /article/2146850-app-creates-augmented-reality-tutorials-from-normal-videos/#respond Mon, 11 Sep 2017 10:36:31 +0000 /?post_type=article&p=2146850 An augmented reality training video
Easy when you’re shown how
Chesnot/Getty Images
Augmented-reality headsets have long promised to turn unskilled tinkerers into instant experts. Whether you want to change the oil in your car or cut an onion so it doesn’t make you cry, a headset or tablet will paint your surroundings with instructions guiding you like an experienced pro, patiently correcting any missteps along the way. Sounds great, so what’s the hold-up? Producing the content has always been tricky and expensive. That’s why AR tutorials are generally used only by the kinds of companies that have a fortune to spend, for example on fighter jet maintenance tutorials. But a start-up company is hoping to change that. in Mannheim, Germany, can take a single video of someone correctly performing a task – and then with the help of artificial intelligence automatically convert it into an AR tutorial. “The goal is that anyone who wants to fix something at home can download a tutorial to their AR device that shows them how to do so,” says at the German Research Centre for Artificial Intelligence, and one of the co-founders of IOXP. There are already how-to videos on YouTube for every conceivable thing you might want to learn, but they won’t tell you when you’re doing it wrong.

Do it yourself

To create an AR tutorial using the IOXP system, first you use a standard camera to film someone completing a task. This could be changing the oil in a car, installing a boiler or doing a cross-stitch. Then a host of computer-vision algorithms are set loose on the video to separate it into comprehensible chunks: detecting a person’s hands and what they are doing, recognising different objects, and so on. From this, the system generates a step-by-step electronic manual detailing how to do the task. Finally, that’s converted into an AR version. Best of all, the AR instruction manual starts itself as soon as it recognises the task in front of you. For example, if an engineer goes to perform some basic maintenance on a machine, the camera on their AR headset will automatically identify the machine in front of it. “You then see the hands of the expert in front of you showing you what to do,” says Stricker. If you grasp the wrong dial or object, your hands turn red and the system replays the action that you are meant to be performing, highlighting your hands, relevant knobs, dials, parts, all within an accuracy of half a centimetre. Bosch has already trialled the system with some of its engineers in Germany, and is currently in talks about a larger roll-out.

The knowledge cliff is nigh

“This solves one of the big barriers of adoption: how can you extract the information? Automating this is massive,” says Rab Scott at the at the University of Sheffield, UK. For the average person, it’s only a matter of time before flat-packed furniture comes with augmented-reality instructions too. “Ikea has all of its instructions available on YouTube. Turning that into an augmented reality app would be easy with IOXP’s technology,” says Scott. This wouldn’t have to be via a headset, but could be just as effective on a mobile phone or tablet. Imagine trying to replace a part on your boiler. You hold up your phone and it highlights the right bit for you and shows you how to detach the current one. You then hold up the app again and it either proceeds to the next step or tells you you’ve done it wrong. Technology like this is also going to be crucial in the next few years. “Sixty per cent of engineers in the UK are over 50. In the next 15 years we are going to fall off a cliff unless we can capture their knowledge and deliver it to the next generation of engineers effectively,” says Scott.]]>
/article/2146850-app-creates-augmented-reality-tutorials-from-normal-videos/feed/ 0 2146850