Apple has today been granted a patent for a graphical display concept it calls virtual paper, and two things struck me about it – one about its origins, the other about what it may tell us about future Apple design language.

The patent is for a visual representation of paper in three-dimensional form, which is, of course, the type of user interface most applicable to the upcoming Apple mixed-reality headset

Virtual paper patent

As Patently Apple spotted, the Cupertino company has today been granted a patent that takes the concept of folding paper from a 2D world to a 3D one.

Today the U.S. Patent and Trademark Office officially granted Apple a patent that relates to the future use of Virtual Paper on devices that will be able to crumple, flip, fold, bend while keeping the graphics intact in varying positions as the virtual paper changes angles and perspectives. Virtual paper could include mixed reality content in 2D, 3D and animation where the image could be constantly shifting depending on a particular state that it’s in. This is pretty cool stuff that’s now in-the-works.

Apple’s patent language is, as usual, much denser.

While the 3D virtual content is displayed such that the 3D virtual content is bounded within the perimeter of the virtual paper, the 3D virtual content is able to protrude out from a first side of the virtual paper, and the display of the 3D virtual content is based on the second set of world coordinates. The 2D virtual content, on the other hand, is displayed as conforming to the surface of the virtual paper based on the first set of world coordinates. In some embodiments, a second side of the virtual paper, which is the opposite of the first side of the virtual paper (e.g., the backside), is displayed with a rasterized conforming representation of the 3D virtual content, e.g., a blur effect or shadow of the 3D virtual content, along with a rasterized conforming representation of the 2D virtual content. 

Two things struck me about this.

It’s the latest iteration of a 1983 concept

First, that is effectively the latest iteration of a concept first seen in the LISA way back in 1983!

For anyone who’s never used a personal computer before the Mac and Windows, it’s difficult to comprehend just what a revolutionary change Apple introduced.

Prior to the LISA, computers just showed a list of file and folder names, in text form. What Apple gave a few people in 1983, and many more with the Macintosh launch in 1984, was a graphical representation of an office desktop. Directories were now shown as folders, like the paper ones in common use at the time. Documents were shown as virtual pieces of paper, with an indication of their contents, using different icons for written documents, spreadsheets, and graphics.

Really the only change since then is that icons are now a tiny thumbnail of the first page of the actual content, which is a pretty small change over the course of 39 years! That 1983 concept has certainly endured the test of time.

It would see a return to a more skeuomorphic UI

One of the biggest changes seen to Apple’s design language over the years was, of course, the shift from the skeuomorphic world pioneered by Scott Forstall, to the flat design introduced when then hardware design head Jony Ive took control of software design too.

Forstall, and Steve Jobs for that matter, were known for having a taste for so-called skeuomorphic design. Real world materials like leather and paper would appear in software design especially on the iPad where the Contacts app looked like a real address book and the Calendar app was bound by leather.

Following Forstall’s firing, Jony Ive took over software design which led to iOS 7 and beyond to what we have today.

Apple’s patent suggests that the Apple headset could see the company return to a more skeuomorphic world as it transitions from 2D to 3D.

We’re expecting Apple’s mixed-reality headset to be launched late this year, or early next.

Top photo: Vinicius Amano/Unsplash; LISA photo: RR Auction; Paper photo: Kelly Sikkema/Unsplash

FTC: We use income earning auto affiliate links. More.


Check out 9to5Mac on YouTube for more Apple news:

You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

About the Author

Ben Lovejoy

Ben Lovejoy is a British technology writer and EU Editor for 9to5Mac. He’s known for his op-eds and diary pieces, exploring his experience of Apple products over time, for a more rounded review. He also writes fiction, with two technothriller novels, a couple of SF shorts and a rom-com!

Ben Lovejoy's favorite gear