Storing Sentience

When Siri was unveiled with the introduction of the iPhone 4S, there were a lot of very intrigued, very happy people. Already, in my usage of Siri with my new iPhone 4S, I find myself pleasantly surprised with the things I’m able to do, and how easy Siri makes so many of the things I’m used to doing. Naturally, there are some shortcomings. Since I use an unlocked 4S with the T-Mobile network, I’m relegated to EDGE when not on wi-fi (how was this speed ever acceptable?), and communication with Siri is woefully slow. I wish I had the scratch to pull off an AT&T subscription, but I just don’t right now.

This got me thinking, however. Since the 4S relies on a persistent, high-speed network to deliver results to the user, what happens when a person has a slow connection, or is in a wireless dead zone? The ability for Siri to function as an interface diminishes dramatically, leaving a person only able to interact with the data that is already on his or her phone. While this normally would not be a problem, anyone looking for Siri functionality in a wireless dead zone is going to be frustrated, period. Naturally, the last thing Apple wants is unhappy customers, so what can Apple do to circumvent this situation?

I found the answer in the iPod Shuffle.

This little device, as many know, is what one might call one of Apple’s lesser-loved projects. At the time of its inception, it filled a necessary void–that of a low-cost music player bearing the iconic Apple logo and “iPod” name. It was my first iPod, and, I’d wager, the first iPod for many others, as well. The problem with the iPod Shuffle, now, is it lacks features. It isn’t relevant anymore. When the shuffle was introduced, MP3 players, including the iPod Classic, were large and relatively bulky, and their battery life left something to be desired. The Shuffle had long battery life, was capable of syncing with iTunes, and offered people an interesting alternative to the blue-hued screens and click wheels of their larger cousins. The storage was all flash, which meant that it wasn’t prone to hard drive failures in the same way the iPod Classic was, and that it could play all day on a single charge.

Since the Shuffle lacked a screen, however, there was no way for a user to really know what was about to play. Apple solved this with their “VoiceOver” feature, which was able to announce the name of the playing track or playlist, or the remaining battery life. In order to do this, however, the user needs to give up some storage space on their device to make room for the VoiceOver data. For some, this is an easy tradeoff, since it adds a sense of depth to the diminutive device. Tuck that in the back of your mind for a moment.

It was recently discovered that the iPhone 4S contains a dedicated sound-processing chip that enables it to better separate your voice from background noise, which increases its ability to recognize what you’re saying before sending that data off to Siri for processing and language recognition. All this data being sent to Siri means that there are a great deal of sound snippets that Apple has at its disposal to refine and improve its voice-recognition and accuracy. The more people use Siri, the better it gets, and the better it gets, the more people use it. Eventually, I believe, Apple will be able to “distill” certain Siri queries down to their core components, picking out speech patterns and pull user voices away from background noises more easily. Furthermore, Apple will be able to condense certain components of Siri down to include that functionality on devices that don’t have a persistent wireless connection, and significantly speed up Siri queries on devices that do. Naturally, looking up restaurants on Yelp or finding out data from Wolfram is going to require a connection to the internet, but things like setting reminders, calendar appointments, taking notes, and playing music can all (theoretically) be done locally, without a persistent data connection. This would allow Apple to install Siri on all of its devices. When the device has a wireless connection, it would be able to upload usage statistics, and download changes to the onboard Siri database while doing its nightly iCloud backup.

Naturally, the user might have to sacrifice some storage space, but it would allow even the iPod shuffle to become a “personal computer”, with the ability to store notes, read emails, and access a user’s information in the cloud when a connection becomes available. Who knows? Apple may even negotiate a wireless deal with service providers that allow all its devices to connect to a Kindle WhisperNet-style “SiriNet” for free, for the purposes of communicating with the Siri servers.

Until we have ubiquitous worldwide wireless coverage, we can talk to the little Siri in our Shuffle.


In Like a Lion

20110331-115248.jpg

One of the most powerful developments in recent years has been the creation of “cloud computing.” Folks familiar with the technology know that it’s essentially doing for your computer what email services like Gmail and Yahoo! have done for your communication–they’ve taken your messages, contacts, and other personal information and stored it on secure servers across the nation to make it easily retrievable in the case of an emergency or hardware failure. Instead of relying on a single storage point (your home PC, for example) to store all of your communication, Google, Yahoo, and dozens of other websites offer to handle of those tasks in exchange for showing you advertising or using some non-identifiable information to craft better algorithms.

For most people, the immediate benefit of these systems was apparent. Access your mail anywhere, store contacts somewhere that won’t be affected in the case of a system crash or loss of a single device (like a phone), and integrate these services with your web browsing. Easy, and powerful. The systems that provided these services long ago have evolved significantly, now allowing entire operating systems to essentially run through your broadband connection, piping only the data necessary for input and allowing massive supercomputers to handle all of the processing.

That all sounds fine and good, but what does it mean for you?

Cloud computing, so named because of its pseudo-omnipresence, changes the role of computers significantly. They no longer exist as a single point of storage for all your information. Instead, the computer is more of a gateway, a portal to your data that is stored in massive servers. One analogy I can draw is that of a dry cleaner. With the old model of computing, it was as though you were standing at the front of a dry cleaning factory trying to look for a specific shirt. You might not even know where the shirt was located, but you’d still have to find it yourself. With the advent of search, that process was trimmed a bit- you tell someone else what to look for and where to look, and they find the shirt.

Now, with cloud computing, we see that yet another layer of interaction is slowly melting away. We’re doing away with the fetching entirely. You don’t even really need to know where you’ve stored your data, you just need to run a search, and you can pull down results from the stuff you have stored locally on your computer as well as the files floating up with the sun and moon. We are no longer limited by how much space is on our devices, how much storage we can buy. The only limiting factor is the infrastructure that connects all these devices together. Some people have asked me, almost accusingly, “Well what happens if the network goes down? What then, huh?”

If the entire United States suddenly experiences a simultaneous and catastrophic shutdown of all of its network infrastructure, we will have much bigger things to worry about than listening to our music or accessing the documents on our cloud folder. That’s akin to asking what would happen if all paper in the United States suddenly caught fire. I don’t want to hypothesize about the events or circumstances that would need to exist in order to facilitate such a terrible reality, but, assuming it was both spontaneous and total, I doubt anyone would be worried about their fourth grade diary.

Digression. Apologies.

In recent news, we’ve heard rumblings of Apple’s new iOS 5 being cloud-based, a total overhaul of the OS. I can’t even begin to fathom what that means. The OS seems just fine as it is, but the cloud is where it’s at these days, and that darn data center that’s been occupying so many of my thoughts and predictions seems like the perfect use of all those massive petaflops (or whatever they use to measure data centers of that magnitude). It all seems to be coming together now.

What we will start to see is more unity across Apple’s various OS products. Remember back in 2005, when Steve was asked what kind of OS the iPhone was running? Does anyone remember his response? Let’s recap, shall we?

Jobs admitted that Apple is a new player in the cell phone business, saying “We’re newcomers. People have forgotten more than we know about this.” Jobs noted that the operating system to run the iPhone — Mac OS X itself — has been in develop for more than a decade (its roots like in NeXT’s Nextstep operating system). Mossberg suggested that the iPhone doesn’t have the entire operating system on it, but Jobs protested.

“Yes it does. The entire OS is gigabytes, but it’s data. We don’t need desktop patterns, sound files. If you take out the data, the OS isn’t that huge. It’s got real OS X, real Safari, real desktop e-mail. And we can take Safari and put a different user interface on it, to work with the multitouch screen. And if you don’t own a browser, you can’t do that,” said Jobs.

This shift is not overnight, and it is not a new direction for Mac OS. Once Apple began work on the iPad, they started planning for this shift, possibly even before that. I seem to remember some folks discussing the origins of the iPhone, how it was actually rooted in an experimental side project that Steve Jobs somehow got a look at and recognized as brilliant, and that said side project was actually more akin to the iPad than the iPhone. At any rate, it looks to me as though Apple has been planning this shift for years, possibly even the better part of a decade. I believe that Apple designed iOS with unification in mind all along, seeing a desire to create a powerful OS for new mobile devices that hadn’t even been developed yet. It seems fairly obvious when you look at their last “Back to the Mac” event, and even more glaringly obvious when you see something like this coming out of Gizmodo.

Adobe demonstrated Photoshop for iPad yesterday. Not a sub-product like Photoshop Express, but the real Photoshop, with a new skin. Sure, it doesn’t have some of the advanced print and web publishing oriented features of the desktop behemoth. But it has everything you need, from layers compositing—including a 3D mode to show people how they work—to what appeared to be non-destructive adjust layers, levels, color controls, and all the features I use every day in the desktop Photoshop. From the little we have seen, the application was fast and smooth.

I believe Apple has succeeded in ushering in a new age already; I can’t wait to see them throw the doors wide open to a future we’ve only dreamed of.


It’s All in the Name

Apple also made a small, but very meaningful change to their iOS app store, namely the shift to a button labeled “Install.”

It's a really good app!  You should get it!

While this may appear on the surface to be merely cosmetic, looking deeper reveals a lot of information in light of all the movement Apple has been making recently in building out the data center and rolling out the tall ladders for cloud (or pseudo-cloud) computing.  AppleInsider discusses the physical processes that are beginning to facilitate this, but here is the first

What we see here is a blurring of the lines between local and cloud storage.  If a button is labeled “Install,” it implies that the app is close at hand, just a tap away in order to be in front of us and usable.

Consider the language Apple uses when downloading and installing apps from the App Store.  While the app is being downloaded, the user sees “Loading…” below the app, creating the impression that the app is not being fetched from some far-away place, but that the app is being unwrapped, that it’s simply starting up for the first time.  As the process continues, “Loading…” changes to “Installing…,” which further increases the similarity to a locally-stored app.  Shortly thereafter, the app is ready, and the user can go to town.

Displaying “Install” in the app store, instead of the app’s price, puts the user at ease that they already own this piece of software, that Apple is keeping track and taking care of all of their software for them, and that they have their own personal software vault from which any app they own is accessible to them at any time.

Think about that change in the juxtaposition to the old way of computing, when installing a program meant loading a physical disc into a tray and transferring the data onto a computer.  Think about the programs that actually required that the disc be in the tray.  This is a distinct and marked shift away from that type of application and media, a shift toward user-friendliness, toward ease-of-use.

Once again, this is good technology.  The computer gets out of the way, and we are able to engage our information more quickly, without a break in thought, without losing ourselves to the process.  We are able to focus, explore, create.  We are able to be more human.