Skip to main content

Mystery solved: Apple vans gathering next-gen Maps data, grabbing Street View storefronts + 3D images

Three years after Apple launched its own iOS Maps app to replace Google as its iPhone and iPad map provider, the Cupertino company is readying its first major enhancements to the service. While Apple was known to be gearing up for the launch of a mass transit directions service this fall in a handful of cities, sources have revealed that it is also developing its first entirely in-house mapping database to reduce its reliance on TomTom, using a fleet of mysterious vans to take still photos of business storefronts to replace Yelp photos, and building a 3D Street View feature. Apple has been using the sensor-equipped vans in cities such as Los Angeles, Dallas, and New York since earlier this year, and, below, we detail how the vehicles are advancing Apple’s plans for the future of Maps…

In-house Maps data by 2018

Since the initial Apple Maps launch on the iPhone and iPad in the fall of 2012, Apple has utilized fundamental geography data pulled together from several third-party sources, including TomTom. This core data for mapping software is known as the “base map.” The initial data errors reported by Apple Maps users were in part the result of Apple aggregating several data sources, instead of building its own singular database as rivals Google, MapQuest, and Nokia HERE have done for years.

Apple is now in the process of collecting its own base map data, using beige, black, and white minivans to augment work already done by recent acquisitions such as BroadMap. These minivans have been the subject of rampant speculation since they were first spotted months ago, including many guesses that they were test vehicles for upcoming Apple-designed cars. However, sources indicate that they are solely being used to gather data and images for the Apple Maps application.

The current plan is to revamp the foundation of the Maps application, shifting to the in-house base map database by 2017; this would lead to the cutting of ties with partners such as TomTom, which currently have multi-year Maps contracts. While Apple hopes to achieve the 2017 shift, a source says that Apple is not completely on track to meet this goal, so a 2018 launch may be more likely.

Apple Maps (Left) in 2012 <a href="http://theamazingios6maps.tumblr.com/page/2">not showing lake</a> (Right)

For end users, this change will mean more accurate and rapidly updated data. For Apple, this means more control over the core user experience, and, consequently, less of a need to rely on partners for data to be updated. Apple is notably taking a similar approach to its upcoming indoor mapping feature, which is being developed entirely in-house with iBeacons equipped to small autonomous robots.

3D Street View 

In addition to assisting with in-house data collection, the Apple Maps vans are equipped with cameras to collect Street View data. Apple does not believe that classic Street View interfaces developed by Google are intuitive to the user, according to sources with knowledge of Apple’s work on Maps services, so the company is exploring new ways to present Street View imagery.

To expand its 3D Flyover mode in Maps, Apple is working on ways to tie together its new camera data to make a street level version of 3D Maps for a future version of its Maps app. As Apple has only recently started collecting its 3D Street View data, such a feature is not likely to be imminent. However, Apple has another plan for the imagery it’s gathering that will appear sooner rather than later.

Replacing Yelp with storefront stills 

Apple Maps listing showing Yelp photo

Sources say that Apple’s camera equipped vans are taking still pictures of businesses along commercial roads, an initiative Apple has internally codenamed “Project Gardar,” an apparent reference to Norse strongholds in new territory. Apple has planned to begin integrating still exterior photos of points of interest this fall in its iOS 9 Maps app. Currently, the individual cards (or listings) within the Apple Maps application are illustrated with Yelp’s images, as seen in the screenshot above.
In order to reduce its reliance on Yelp, Apple wants to replace photos taken by amateur reviewers with its own pictures of storefronts. Replacing Yelp’s images with ones snapped from vans is a long-term initiative planned for a gradual rollout, rather than one that will happen all at once. It is unclear if Apple is still on track to begin the transition with iOS 9, but it appears likely to begin within the next year at the latest.

Apple initially launched its van project to verify, plus add to, its work on an in-house, next-generation Maps geography database and to take still photos of storefronts, but sources say that the photos can be stitched together for other purposes, such as for the aforementioned 3D Street View feature.

Earlier this month, we revealed Apple’s plans to launch a robust mass-transit directions service for iOS 9, along with details on Apple’s plans for new Augmented Reality and Browse Around Me features for the iPhone and iPad Maps applications. As Apple uses similar features for its Maps app on OS X, the company is likely to integrate data from its next projects on the Mac as well over the course of the next few years.

For iOS 9, Apple is also working on a tweaked user-interface with a new typeface, a Home app to control HomeKit devices, split screen apps for the iPad, a Google Now-competitor, Force Touch support, iMessage improvements, a new keyboard, and an overall focus on quality, security, and stability. Apple is working on similar stability enhancements for OS X 10.11, in addition to new features such as Control Center. Apple’s WWDC keynote takes place on Monday, June 8th.

FTC: We use income earning auto affiliate links. More.

You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

  1. chrisl84 - 9 years ago

    Can’t wait for WWDC 2025 when we get that Apple Street View these vans are working on.

    • standardpull - 9 years ago

      Haha, by the time Apple gets around to Street View, Google will have delivered the view of everyone naked in their own bath/shower. Only to be shared with trusted partners and advertisers, of course.

      • rnc - 9 years ago

        They don’t even need cars, everybody is uploading their naked pictures and “home movies” to Google Photos by now…

        It’s FREE!

      • Would that be the same trusted partners and advertisers who pay Apple good money so that they can target you and I with in app adverts via iAd?

      • rnc - 9 years ago

        Apple doesn’t leak user data between to services you don’t want for you, or for Apple.

  2. Shane Wasilkoff - 9 years ago

    I just passed one of these last week in Chicago.

  3. michaelg379 - 9 years ago

    I think Apple should acquire Garmin, TomTom, EveryScape, MapJack and CycloMedia to get development moving faster…

  4. Oh I mis-read: “Apple has been using the senior-equipped vans…”
    This would explain why it takes ages to complete.

  5. irelandjnr - 9 years ago

    There was no mystery.

  6. acslater017 - 9 years ago

    A 3D Street View would be awesome. Realistic drive throughs, rather than flyovers.

    If Apple do eventually get involved in cars, perhaps this database could help for situations when the sensors are blinded.

  7. rogifan - 9 years ago

    Figured all along these vans had to do with maps not an Apple car. I think it’s going to be near impossible for Apple to catch up to Google in terms of mapping the world. I have a feeling this is going to be another thing like flyover and only available in big cities.

    • irelandjnr - 9 years ago

      Yeah and regarding an electric car how can they hope to catch up with Tesla having a 15 year advantage before Apple announces theirs?

      • alanaudio - 9 years ago

        For how long did Nokia and Blackberry exist before the iPhone was launched ?

        The crucial thing is not what you did in the past, but what you will be doing in the future.

      • irelandjnr - 9 years ago

        True, but Tesla are not Nokia.

      • acslater017 - 9 years ago

        Apple has repeatedly succeeded in the past when they redefine the market, redefine expectations, and enter the market when an emerging category is still nascent. They didn’t compete with record labels to sell the most CDs – they made the iPod and iTunes Store. They didn’t compete with Nokia and Blackberry to make the best keyboard phone for business people – they redefined the product as a miniature computer (an area of Apple’s strength).

        5 years from now, Apple may not even be directly competing with the auto market as we know it. Sure, there is knowledge and expertise in the areas of motors, steel frames, performance tuning, safety, etc. But if the concept of a car gets redefined to include electrification, self-driving, on-demand, machine learning, advanced sensors, etc. then who’s to say that Apple would be at any disadvantage at all?

    • macnificentseven48 - 9 years ago

      I believe Apple could catch up if it really wanted to which would mean acquiring a huge fleet of vehicles and personnel and bringing technical know-how in that area on-board. Apple may be very deliberate on how tasks are carried out and I’m not going to criticize them if I don’t know what it takes to do a Street View project. I’m only guessing that if Apple threw a couple of billion dollars to such a project they could make huge strides. Maybe it doesn’t work that way at all.

  8. They should buy TomTom and HERE.

    • I suggest you read the article again. The problem with importing other sets of data is a) they are incomplete sometimes and b) data synthesis between different sets of data and making it accurate is far harder than generating it on your own with your own set of standards.

      • Yes I did understand it correctly. But buying these companies would allow Apple to modify the data to its needs. Buying data from other companies or owning it are 2 different shoes. TomTom for Europe is very accurate. I used TomTom here long ago in its first iterations on PSION pocket computers (PSION 5mx still the best pocket computer). Later on different smartphones from Ericsson. Now I rely on Navigon for the rest of Europe (all data incl. traffic data and train data on my iPhone no roaming charges). Most time I use Apple Maps for my transits but only inside my country. If I’m abroad which happens very often I use Navigon.
        Now Navigon belongs to Garmin, because the Garmin navigation systems are really bad, they had to buy a better system. TomTom and Navigon are the clear leaders here in Europe. Though they are struggling to survive, as nobody buys stand alone versions anymore, but only smartphone versions.
        So buying HERE would make sense.

        And generating accurate data from different sources can’t be so much of a problem. I think the problem is time and manpower to achieve this in a short time. Apple has to catch up on Google. But Google is 10+ years in advance. Look at the OpenStreet project: they were laughed at at the beginning, but now even Microsoft uses them because they do have data, not available on other systems. But at the same time much data is missing which Microsoft replaces by its own system,

        We know people expect from Apple to do it right the first time and much easier user experience.
        But Google is known for generating Adware with any service they have. So the recently announced Google Map system giving more infos to you than you really need or want is just another way to make billions of Advertising Cash.
        Apple wants the data for themselves to giveth the user privacy and just the necessary info the user wants or needs.

        I think Apple needs the data for their self driving car, which needs very accurate data. The side effect its that we will have a super mapping / navigation system ion iOS 9 or 10 or 11.

      • fprush - 9 years ago

        Think you are right; Apple needs its own data, no point buying these companies. But not mainly because of the integration problem; which is a thing, but because current data sets are lacking for what they are planning. What are they planning? Think cyberhusky gets it right in last paragraph; map data is an enabling tech for a self/assisted driving ‘car’. This new data is a step above current data sets (with exception of google). If buying one or more of these companies got Apple from A (now) to B (mapping end game) as fast as possible, then Apple would have bought them.

  9. Makes sense and very Apple. Partner with others where required to learn and get things moving in the short-term, then develop stand-alone technology to own and control entirely in-house in the long-term. It seems very likely that Apple have been doing this with Siri too, and are about to drop Nuance and replace them with a considerably more powerful internal solution. Given the rumours we are now hearing about Siri proactive, I am more convinced than ever that this WWDC will see the end of Nuance and a powerful new Apple-built Siri backend with accompanying API.

    • xiia0mousee - 9 years ago

      Oh yes. Glad to hear that possibility. Been trying to do some home automation app and it’ll just make my life 30% easier if there were Siri APIs.

  10. iphonery - 9 years ago

    I’ve spotted one in Las Vegas.

  11. yojimbo007 - 9 years ago

    Was that really a mystery?

  12. telecastle - 9 years ago

    The Apple Car rumor was stupid. No excuse for giving credence to such outlandish claims. It’s not that getting into the electric car business is a bad idea. It’s just that Apple can do this much more efficiently by buying Tesla rather than trying to build an entire team that would design and build its own car. Apple has enough money to buy Tesla by going the Tesla shareholders twice the value of what their stock price is today and it would still be a great deal for Apple. If Elon Musk doesn’t like this idea, then Apple could do a hostile takeover without having Musk agree to it. It, of course, would be much more preferable if Musk agreed to stay on and head the Apple’s electric car division.

    I truly believe that Apple is working on the Tesla acquisition, and all those high-profile hires from the automobile industry that Apple made recently are most likely about hedging Apple’s bets in case Musk didn’t go along with this plan, so that Apple would have their own person who could head their electric car division.

    • rettun1 - 9 years ago

      I don’t think elon musk is interested in a buy out. I think what he is interested in is the propagation of the electric car market, and that will definitely happen once both tesla and Apple are behind it. I do hope that there will some form of collaboration between them though

      • rahhbriley - 9 years ago

        With Tesla selling their engines to more or less anyone, that could be a simple way to start building an Apple Car. Maybe they collaborate on batteries or Apple just does that themselves? I could see Apple designing a lot of the car but not every component. Maybe they’d could do other Tesla drive train components where needed? I’d love to see them take on as much of it as they could and then carefully select the remaining components.

        I agree Telsa doesn’t want to be taken over, and I don’t see Apple executing a traditional forceful take over of someone, especially a company that public and well liked. I also agree Tesla really just wants a larger electric car market, and welcome more quality (and especially non traditional) competitors. Partnering with Apple on this level of involvement benefits them from having a solid customer and quality competitor to grow the market.

        I believe Musk genuinely wants to make a contribution in human advancement and that he believes electrical vehicles to be one of the routes to do that. I also believe he loves making money doing it. A deal like this with Apple could definitely help him accomplish both.

  13. macnificentseven48 - 9 years ago

    I certainly hope Apple is doing some Street View project. Although they don’t seem very serious if they’re merely leasing a fleet of unmarked vehicles. What’s odd is how all the other companies’ mapping vehicles use tall tower cameras for 360 degree views. Is Apple’s mapping technology providing better images? It’s odd how Apple could easily afford to acquire a lot of mapping data from other services but would rather rely on its own methods. I don’t think Street View is necessary to have a good mapping system but I just like using it to see areas without having to leave my house. Unfortunately, a lot of that Street View data is somewhat old. Houses have been built on those empty lots that show up on Google Maps Street View.

  14. > using beige, black, and white minivans

    I saw a red one last week too.

  15. o0smoothies0o - 9 years ago

    I think Apple should be using massive amounts of money for R&D of small drones with insanely sofisticated sensors and cameras to be doing mapping, and creating virtual reality tours of things like national parks. Just get permits to fly them all over, their sensors keeping them perfectly on track, and never hitting anything, and sofisticated camera balancing to create a dead steady picture. That’s how you build the future map of the entire world, in 3D, and create beautiful virtual reality tours of places people will never get to visit in person.

  16. Scott (@ScooterComputer) - 9 years ago

    Duh.

    No sh1t, Sherlock.

    Derp.

    (And half a dozen other responses from Captain Obvious. I do believe there were many of us who said just that when the vans were outed months ago; the rest of the morons should hopefully be shamed into thinking more the next time they begin to comment on a subject they know nothing about and let their ignorance serve to “stretch” a rumor.)

  17. george1620 - 9 years ago

    Spotted one in San Diego, CA

  18. charilaosmulder - 9 years ago

    The way I’d like to see street view implemented: just zoom in closely in sattelite view and see more detail in the streets than the places that only support standard flyover. No extra interface. Just a far more realistic flyover.

  19. Evan - 9 years ago

    With in-house 3D mapping, it all makes sense now how the Apple car will work. If you look into self driving car technology, the only cars capably of safely driving on streets are ones that have been mapped out and uploaded into the a database map that the car reads from. Thus, current cars can only drive in very limited, heavily mapped, areas. If Apple intends to sell self driving cars in 15 years, this technology is vital to it’s existence, with Google being it’s only competitor on the software side (again – if Google decides to give the APIs away that is).

  20. Edwin Tuijtel - 9 years ago

    Forget Google Maps, and surely forget Nokia Here.

    TomTom is miles ahead in the future of Realtime Maps, Realtime Traffic..
    Autonomous driving = TomTom

    Why you think Apple extended and enlarged the deal with TomTom.

    TomTom Road DNA
    http://www.gpsbusinessnews.com/TomTom-Road-DNA-Precise-Location-Tech-for-Driverless-Cars_a5470.html

  21. Michael Sullivan - 9 years ago

    A company that says it is committed to the environment would work with existing data from a company that has already logged millions of miles driving the streets of the world. If only I could think of one……