Get Started Making Robots with Google Blocks

Anna Zhilyaeva, a mixed reality artist who goes by @AnnaDreamBrush on Twitter, has a great walkthrough of using Google Blocks to build robots:

This is part of the #BotsWithBlocks challenge, highlighting how you can use prefab kits to make objects and scenes in Blocks that can be used in other VR/AR development.

Anna’s social media channels have a ton of cool VR and mixed reality art, by the way. Check out her Instagram and YouTube pages.

Mira Prism AR Headset is Exactly What Apple Glasses Won’t Be

Jonathan Nafarrete, writing about Mira’s just-launched Prism, a $99 Augmented Reality headset that works with iPhone:

The design of the headset is beautiful, something I would expect from a company like Apple when it comes to attention to detail. Prism’s clear lenses easily remove and reattach with the gratifying snap of a magnet hold. The cradle for the iPhone is just as simple, allowing for varying device sizes to fit with an expanding spandex fabric.

Judging only from the press photos in Nafarrete’s post, the headset is neither beautiful nor anything like an Apple product. It more resembles science lab safety glasses than something from Jony Ive’s lab.

This is a simple headset powered by one of the most popular devices, all for the price of $99. But there’s only one thing missing from this equation to make Prism a hit with mass consumers—content. Mira shared that they’ve partnered with select immersive content studios to create an initial suite of interactive AR experiences for developers to learn from and consumers to play, all included when the Prism headset ships. Experiences range from solo challenges to multiplayer games, including mind-bending mixed-reality puzzles, holographic chess and digital warship battles, which make gaming in AR as dynamic as it is social.

“Only one thing missing”: The most important thing of all. Content is still king.

Prism won’t be the only iPhone-compatible AR headset to pop up between now and (if) when Apple’s own glasses drop. It’ll be interesting to see how third-party hardware makers attempt to leverage ARKit-powered experiences made to be viewed on iPhone screens. And, also, if any hardware makers get enough stuff right to pique Apple’s interest on the acquihire front.

I can’t imagine Apple buying another company’s hardware design (let alone one this ugly). But Apple does have a history of acquiring smaller companies and integrating their tech into future products of their own. If Mira – or some other company – finds a great way to leverage ARKit for a headset experience, don’t be surprised to see it incorporated into Apple’s own AR glasses.

You know, if Apple’s actually making its own AR glasses.

The New iPhone Will Let You Interact With Virtual Objects

Thanks to a third-party developer, iPhone users will be able to reach out and touch, pinch, and otherwise interact with digital objects when iOS 11 launches later this year. UploadVR reports that Clay VR is integrating its functionality into Apple ARKit, and the tech should be working within the next week or two.

In lay terms, this means that developers will be able to add interactivity to their ARKit-based Augmented Reality apps with relative ease – and without any additional hardware. As Jamie Feltham reported:

Developers may already be familiar with Clay, it’s an SDK that allows smartphone apps to track the user’s hand in 3D with just the phone’s camera. It can recognize more than 30 gestures users make with their hands, allowing for controller-free navigation of experiences.

While Clay was originally designed for use in Virtual Reality, it’s already being used in some AR/Mixed Reality environments:

Currently you can see a similar solution with Microsoft’s HoloLens, where users pinch their fingers to interact with virtual objects and interfaces in the real world.

It’s worth repeating: Clay’s solution won’t require additional hardware. Apple’s control of the full iPhone stack — hardware, software, and everything in between — has long been one of their greatest advantages in the smartphone market. Now it’s shaping up to be perhaps the single most important factor to date in launching the biggest Augmented Reality platform we’ve ever seen. Experiencing bleeding edge AR on iPhone promises to be as simple as launching an app that just happens to have some Augmented Reality features already baked in.

Will Outsized Ambition Ultimately Doom Magic Leap?

This week’s news that CastAR – the Augmented Reality hardware startup that raised $15 Million from Andy Rubin’s Playground Ventures – is closing its doors made me think of Magic Leap.

Both companies have, to date, focused on creating an entirely new approach to computing centered around a new class of hardware (glasses). Both companies also invested significant time and resources into building games and other content – a full-on software ecosystem – to run on their new hardware.

In other words, CastAR and Magic Leap both set out to make a giant leap from the touchscreen computing model of today to the immersive, head-mounted display computing model of tomorrow, without taking too many intermediary steps. Unlike Apple’s approach to AR or Samsung’s VR play, both of which lean on the smartphones consumers already use to make immersive computing adoption a little less painful, CastAR and Magic Leap set out to build brand new hardware, software, ecosystems, consumer behaviors, and (presumably) brand awareness and loyalty from the ground up.

Now CastAR is reportedly packing it in. So what about Magic Leap?

* * *

A week or so ago, a website I’m not familiar with ran a post announcing that Magic Leap is “not that far away” from disrupting the computing industry at long last. The article included an embedded YouTube video of Magic Leap CEO Rony Abovitz giving a speech at a conference called eMerge Americas; actually, the article largely quoted and paraphrased from said speech.

The video of the speech was shot in 360 immersive video and posted to the “Nick Quay Real Estate Group” YouTube channel. As of my writing this, it has 2,890 views and 15 ratings: 12 thumbs up, three thumbs down. That’s not so many views.

Both the web article and the description of the video include this text, attributed to Abovitz:

Magic Leap is not Virtual Reality or Augmented Reality.
Magic Leap is “Spacial Ambiance, using digital light fields to create a personal computer that is ambient, always around you, always understanding, what you see, it sees, what you hear, it hears, and is always contextually aware.”

The term “Spacial Ambiance” appears in both places. Magic Leap, apparently, has not only invented a new class of immersive computing (again, their word), but also a new way to spell, “spatial.”

I led with all of that not (just) to be a snarky blogger, but because it’s all kind of stunningly noteworthy given last month’s reports that Magic Leap could be closing in on a Series D round of funding. A round that insiders believe will put the company’s valuation at $8 Billion. This company may soon be worth eight billion dollars, and they’re making up words and being covered on some real estate guy’s YouTube channel?

Magic Leap says they’re working not only on a consumer product, but also on scaling manufacturing to ship “millions” of devices. They say 2017 will be a big year. They say their initial product will be “affordable” like a “premium” consumer tech device. A few reports have translated that to somewhere between $1,500 and $2,000 at retail.

History says a $1,500 Augmented Reality headset from a new brand will be a total failure with consumers. Consumers don’t drop $1,500 to try a new way of computing. Consumers don’t drop $1,500 on a debut product from a company they’ve never heard of. Consumers don’t buy into a new class of computing by the millions.

History says what consumers will do is watch Magic Leap’s video demos for free on YouTube, and then check out the new class of AR-enhanced apps soon to be hitting the phones those consumers already know and use and love. Consumers didn’t buy Gear VR headsets by the millions, but will try out the ones that come free with their next Samsung phone, and maybe even pay for a few apps as a result.

Apple seems to be taking a similar tack with AR, starting with iOS apps and potentially building towards the Augmented Reality glasses everybody is convinced engineers are toiling over in Cupertino. AR/VR is a long play, and history says the smart money will leverage existing brand loyalty, install bases, and developer ecosystems to shepherd the transition to immersive computing over time.

Then again, nobody’s invested $15 Million – let alone a billon dollars – in my startup, so what do I know about history and smart money?

* * *

I’m really curious about Magic Leap. The company has raised in excess of $1.4 Billion — at a $4.5 Billion valuation — from some big time investors led by Alibaba, with that rumored D-round looming. They’ve demoed their technology to a bunch of celebrities and a very small handful of journalists. They also released a YouTube video that was routinely mocked by other journalists for showing fake tech.

Stephen Spielberg and NBA star Andre Iguodala were blown away by their demos. Backchannel’s Jesi Hemple was also impressed. Beyonce, on the other hand, was not. One the other other hand, this one person I know whose name I can’t tell you was impressed. And s/he didn’t even get the A-list celebrity demo.

So most people who’ve seen the demos have been impressed. But even in demo-land there have been issues. The company’s patent filings detail a hardware system that includes glasses that connect to a pair of belt-mounted packs that handle computing and battery power. The Information reported last December that the then-current prototype hardware was bulkier than those patent filings detailed. The Information, along with Business Insider, have been somewhat skeptical about Magic Leap’s progress.

I, too, am skeptical. It’d be pretty cool of Magic Leap to disrupt the whole goddamned world by unveiling a product that changes the way people think about computing, in one fell swoop. But they may wind up exposed as fraudulent hucksters and run out of the virtual town, Theranos-style.

The more likely outcome lies somewhere in between the two extremes. Magic Leap will likely launch a consumer offering late this, or perhaps next, year. The device will probably do some super cool things, fall short of expectations set by those rigged demo videos, and gain some traction amongst enthusiastic early adopters.

Available content will be important to the device’s success, but more important will be Magic Leap’s efforts to nurture adoption across industries. $1,500 is a huge outlay for an individual consumer, but not that much for an enterprise tech company, industrial giant, or medical conglomerate looking to invest in next-generation training methods. Since Magic Leap doesn’t appear to be interested in “trickling up” from iPhone apps to proprietary hardware, trickling down from enterprise adoption to eventual consumer adoption may well be their only path to sustainability.

But who knows? Maybe the secret play is to make a huge splash and then slice the company up and sell the core tech to the highest bidder. Maybe Alibaba’s prepared to keep writing checks to sustain Magic Leap over the long haul until spacial computing takes hold of the mainstream. Or maybe the initial launch will reveal a coordinated attack of hardware, software, and studio/developer ecosystem the likes of which our world has never seen, and within mere months everybody will have bought into Magic Leap.

I only hope that, unlike CastAR, Magic Leap lasts long enough to bring their vision to market. And maybe just knock our socks off in the process.

Four Years and $15M Later, CastAR Packs It In

Brian Crecente, Polygon:

CastAR, the augmented reality start-up co-created by two former Valve employees, laid off its staff, shut down internal studio Eat Sleep Play and closed its doors today, according to now former employees.

A core group of employees are working to try and sell the existing technology, a source tells Polygon.

CastAR was launched by Jeri Ellsworth and Rick Johnson, who left Valve in 2013 with the company’s permission to take their AR research with them. After a successful Kickstarter campaign, CastAR raised $15 Million from Andy Rubin and Playground Ventures. They then refunded all of the Kickstarter money and set out to build a hardware company and content studio. The aim was to launch a pair of standalone AR glasses – and accompanying content and developer platform – as soon as this year.

Today’s news immediately made me think of Magic Leap, another company with high-profile backing and ambitious plans for mixed reality. More on them in this post.