Off Course-On Target

Country or Community or Neither?

Maps are such a big part of my life as I experience the world via my sailboat so the TechCrunch posting XKCD Updates Its Map: We No Longer Live In Actual Countries But Digital Ones provided some serious fun for me this morning looking at this updated map for 2010 and this previous 2007 Map of Online Communities from XKCD.  These maps show online communities as countries with size based on the volume of daily social activity. 

It is both a fun perspective on the world we live in and very useful to support the trend I’ve been talking about for many years that the whole notion of national boundaries is fading fast relative to their importance and relevance in our daily life.  Let me be quick to point out that I am not in any way suggesting that national boundaries will be eliminated or forgotten nor that we will be any less proud of your national heritage.

But in terms of what matters in our daily lives as we go about living, learning and working together I think we are all seeing more and more examples where national boundaries matter less and less.  The country of origin of a person, product or service matters less and less to us compared to their fit and match to our unique needs and preferences.

Think about it, in your conversations and correspondence over the past week which have you mentioned more often; what country you are from or what online community you are from?

I’m certainly pleased and proud to be Canadian for example and just sent out a Happy Canadian Thanksgiving (Oct.11th) wish to one and all.  But guess where and how I sent it?  My blogs, Facebook, Twitter and all done from the cockpit of s/v Learnativity here in Majuro atoll in the Marshall Islands group. (07 06.274 N, 171 22.358 E)

I would also point out a related pattern that the importance of and the differences between the physical and the digital, between the real and the virtual, between the geographic location and the online location, are also becoming less and less relevant and distinct. We can and should start dropping them as qualifiers in our conversations. Just like we are less likely to feel the need to point out that we are calling someone from our car or an airplane and focus on the conversation at hand, we will have less need to add that some thing, or even some one, is digital or online or Canadian and focus more on having the right people and things connected together at the right time and way to meet the unique needs of the moment.

Perhaps more importantly it seems to me that communities matter more than countries.  I don’t see this as anything uniquely modern or new or digital.  Reflecting back on human history one could argue that communities have often been more important than nationalities.  What is new however is the reduced need to factor things like location or nationality or digital into our daily decisions.  They are not irrelevant, just less relevant. 

Taking an even longer view, which is my nature, I see all single point categorization such as nationality, gender, age group, digital, real, and so on, fading in importance and relevance as we instead use these as bits of metadata or characteristics which number in the hundreds, millions and centillions (10⁶⁰⁰) and which we combine into mashups and mine to help us make faster better decisions and help us avoid stereotyping and other forms of mass production thinking.

While not without new problems and challenges I for one see all these changes as a VERY good thing and a major step forward by providing more ways and opportunities for all of us to help make this a better world to live, love and work within.

In any case, have fun wandering and pondering these maps.

Rethinking maps, photos and search

MS Adds much more than Bling to Bing Maps

I continue to be impressed by all the great work coming out of Microsoft Research the past year or more and this presentation by Blaise Aguera y Arcas shows some of the most recent examples.  They are certainly providing great answers to my constant asking of “What if the Impossible Isn’t?”

I picked up on Blaise and the work he and his crew were doing over a year ago, initially with their creation of the Seadragon technology which they brought with them when they joined MS research and used it to create Photosynth which continues to amaze and impress me as well.

It seems like much of their research is centered around visual computing and interfaces and in my post a few days ago “Seeing is Believing 2.0?” I mentioned two other MS Research projects in this area, Pivot and SecondLight.  Today this presentation by Blaise is online from the TED 2010 conference where he shows how they are integrating a lot of technology including Flickr, Seadragon and Photosynth along with some Augmented Reality into Bing maps to enable some amazing new capabilities and possibilities.

Watch the video and I think you too will be impressed not only at the technology but with the new level of functionality and value these mashups are driving into maps.  It is really the whole area of using location as the grounding context for a huge array of other information and uses.

The New Frontier?  Going Inside

In one of my original postings on Photosynth I suggested/hoped that what we would see next was an ability a bit like a “cosmic zoom” * where we could zoom either up or down almost infinitely.  Up into the cosmos of space and down onto not only the street but inside of buildings and then below into the sea. 

* If you’ve never seen Cosmic Zoom, or it has been a while since you watched this 1968 video/animation from the National Film Board of Canada, I’ve embedded it at the bottom so you can treat yourself.

As usual change is occurring exponentially so it looks like Microsoft already has my wish!  As you’ve hopefully just seen in the video above Bing maps now provide an inside view capability where we can go from the outside street views into the inside of buildings.  They gain this in part by having dedicated “backpack cams” which can be taken inside public buildings and places to provide detailed inside views.  But my real excitement is about the ability to “go inside” via all the geo tagged photos from “the rest of us” that are posted to Flickr.  This is where the power of Photosynth really shows some promise to me as it stitches together any number of photos by aligning them in 3D space such that we end up with a highly integrated patchwork of all these interrelated photos.  This scales extremely well when you think of how many photos there are in Flickr (5,384 posted in the last MINUTE, 2.2 million geotagged the past month) and the Seadragon technology allows this to all happen extremely fast and with no apparent slowdown no matter how images are involved.  You’ll also see in the demo how they are able to add in video including a live feed that is similarly aligned within the maps and photos.  Imagine when (surely not if) there is the ability to similarly include all the videos up on the web and not “just” photos.

Look Up!

As if this wasn’t all more than enough to continue my fascination, it looks like they are also addressing my cosmic zoom up wish as well.  At the very end of the video Blaise was out of time but managed to demo an upcoming integration of Worldwide Telescope into Bing maps.  I what i thought was a very intuitive implementation you can simply look up into the sky to start seeing the imagery and data of the night sky from wherever you are standing (on the map). 

Location as Context

As I mentioned at the beginning I think we need to start thinking less about these as “maps” or at least redefine what maps are as we evolve more ways to use location as a central form of context within which we work with an view data, especially visual data.  Time is another bit of context and while it is not shown in the video above, because all the photos and imagery is time stamped you can go back and forth in time as well to see what things looked like in the past and then by adding layers on top, Augmented Reality, we can also see future scenarios such as buildings and reconstruction for example.  Blaise mentioned in the early part of his demo that they have found examples where Photosynth has included some very old photos and by setting the time back they are able to see the streets of Seatlle with horses and carriages. 

Rethinking & Redefining

So as you are thinking about all these new capabilities start to think how this is all part of fundamentally redefining or notion of maps and more so of search, (think spatial) and how we are quickly transfoming from consumer to creators.  These and other changes are also tranforming how we find, discover and learn just the right people, things, locations at just the right time.

PS.  FWIW, keep your eyes on both what’s coming out of MS Research as well as what lies ahead for the increased amount of collaboration between Microsoft, Yahoo, Flickr and Facebook.

Related articles by Zemanta

• TED2010: Spatial Search - Bing, Flickr, Videos, Maps and the Stars (blogs.technet.com)
• Is Bing Maps quickly getting cooler than Google Maps? (seattlepi.com)
• Seeing is believing 2.0? (waynehodgins.typepad.com)

Past Meets Present to Create the Future of Easter Island

I am as remiss as I am delighted to be able to finally get around to sharing some of the fascinating work taking place on one of the world’s most remote locations, Rapa Nui, also known as Easter Island, and to introduce you to some of the even more fascinating people doing this work. 

Most of us are probably familiar with the mysterious stone carvings on Easter Island called Moai (pronounced mo´-eye) and they are indeed impressive.  Some of you may recall the book “Collapse” by Jeffrey Diamond and recall how he used Rapa Nui as a blueprint or roadmap to societal implosion, all of which seems all too relevant and most valuable in these current times.

However, even more impressive is the story of the people and the history that lies behind the blocks of stone. It is in part a story of great sadness and devastation as the residents desecrated the island (and nearly themselves) by clearing literally every tree in order to create these statues. Yet this is also a story with great hope and inspiration as these challenges are being resolved with remarkable human ingenuity and determination augmented by some of today’s hardware and software. I continue to be more and more fascinated by the whole new solutions and results that emerge when we mix or “mashup” the old with the new, and these efforts on Easter Island are yet another great example.

Jeff O’Brien has recently done a great job of telling this story in his Jan. 13, 2009 Fortune magazine article “Saving Easter Island” and in this accompanying video interview.  I am very confident that you will find it a good use of your time to take a few minutes to read the article and watch the video.

You will be introduced to Sonia Haoa, a 55-year-old native of the island and the lightening rod for efforts to capture the history of the island and save it from further destruction. The article and video will also introduce you to my friend and colleague Pete Kelsey who has been instrumental in helping Sonia and others on the island take advantage of some of the benefits of modern technology and techniques to create a much more in-depth and accurate capture of the geography and history of the island. They have used this technology to see whole new connections and ways forward for the future.  Pete works at Autodesk Inc. and is the resident expert in the software, such as AutoCAD Civil 3D, and the whole area of civil engineering

Together Pete, Sonia, and a team of other people from local and from other technology companies are in the process of digitizing the whole island to create models so accurate you can now see the original chisel marks from when the Moai were carved out of the volcanic rock blocks. It is from lessons like the ones coming out of this work on Easter Island that Autodesk and all of us can learn more about how to combine the past with the present to make a much better future.

Pete originally went to Easter Island out of pure curiosity and to check off one of the items on his “Bucket List” (name of a highly recommended movie BTW) of things to do and places to see before he “kicked the bucket”.  However his curiosity and talent soon led him to connect up with Sonia. And the rest makes for a great story that is still unfolding, but you can get started on with the article and video. 

* You can also track the whole project on the Easter Island project diary blog.

Best of all, I will soon have the great privilege of meeting some of these people in person and seeing their work first hand, since I am about to set sail for this remarkable remote island this month. I’m currently in Costa Rica finishing preparations on my 50’ sailboat “Learnativity” and expect to set off later this week for Ecuador and the Galapagos Islands from where I’ll turn south and make the open ocean crossing to Easter Island. If you get out your atlas or fire up Google Earth, you’ll get a better sense of just how remote Easter Island is and develop a bit more appreciation for the importance and the challenge of the efforts being made there to build a whole new future for the island and for the rest of us.

I strongly encourage you to take a few minutes to read this article and watch the video. I think you’ll soon become as fascinated with this as I am and a bit more aware of the wonderful diversity and vitality that is on this planet we share.  There are lessons for all of us and on many levels including geographical, historical, sociological, and personal to be gleaned from the history of Easter Island, as well as its present and prospective future. 

I look forward to reporting back to you when I’m on Easter Island with more photos and stories of some of my personal experiences, interactions, and perspectives.  Until then, enjoy some virtual traveling and some learning from the comfort of your chair, and please join me in a salute to the ingenuity of people like Sonia, the energy and spirit of people like Pete, and the great mashups of old and new that can help make this a better place for all of us.

Cool Tools I Use: SPOT on!

I truly believe that every one of us (yes, that includes YOU!) has cool tools that we use on an everyday basis and stories about how we use these tools and how we came to find and use them.  I'd like to hear about yours.  Meanwhile, here's another one of mine:

This SPOT messenger system is one of my newer "can't live without" tools and a "mashup" of hardware and software technologies, namely GPS, satellite-based communications, realtime mapping, and more.  It is also an example of the kind of "advanced" functionality that is quickly moving out of the hands of experts and high budget projects or pure luxury objects into the consumer mainstream. This is a trend we are seeing much more of these days, and is one I see escalating exponentially in the years ahead.

Look, look! See SPOT run!

SPOT is a great example of the power of simple purpose combined with simple design.  It essentially does ONE thing very well: tells anyone you choose to know precisely where it (and you!) is on the planet with the push of a single button. It uses GPS to precisely calculate where it is when you push the "check" button, and transmits the latitude and longitude coordinates via the worldwide (almost) GlobalStar to a list of people (text message or e-mail) that you give it and to a website-based map. 

It costs less than US$150 along with an annual subscription of about $90. For people like myself who are regularly in very remote and varied locations, and involved in possibly life-threatening or risky situations, this is a no-brainer purchase.

Simply Great!

Simplicity is one of the things that makes this such a marvel for me and why it's made my list of Cool Tools to share with you. Designing for simplicity is in fact very difficult, and it seems a bit of a lost art these days, although it one I believe and hope is making a comeback.

The SPOT device itself is relatively small (about the size of slightly rotund older cell phone), and while I sometimes wish it were smaller, I must admit that I lose smaller things much more easily, and this device is not cumbersome. But if you were wearing it on your belt or carrying in your purse, it would be nice if it were smaller. I suspect that the size is mostly due to the lithium battery (replaceable), which is probably more suitable for safety in high risk safety situations.  It need to be very dependable and must last for a long time (years vs. days or weeks). Getting a "sorry low battery" warning is NOT something you want to see if you are using this.

Continuing with the simplicity theme... there are no wires, no plug-ins, no attachments, no protrusions (such as antenna), and it has a VERY simple interface consisting of only four buttons: on/off, OK (CheckIn), 911, and HELP, with a red/green indicator light for each one. 

How Do I Use It?

If you think you or others you know and love might have a good use for this device, you can read more on the SPOT website,  but here is the quick overview to help you see just why I think this is such a Cool Tool for me and perhaps for you.

SPOT has two primary functions that I use on a regular basis

√ Check in:  When I push the "Check In" button on SPOT it sends a short message with my exact latitude and longitude information via satellite to a list of people I have provided. Being satellite-based means this will go out independent of any phone or radio systems anywhere on the planet.*  It can take up to about 2 minutes for the message to go out via satellite, BUT it will go out as long as it has a clear view of the sky, which can be through windows, but not through steel or other physical obstructions.  Of course, this is not a major limitation, since its primary use is for outdoor activities. However, I've had it work well even inside buildings as long as it is placed in an outside-facing window.

*  This is not completely true as SPOT uses the GlobalStar satelite system and they do not quite have true planetary coverage, since there is a "hole" over the Pacific ocean.  Other than for those living in such remote locations and blue water sailing types such as myself, this is not much of a problem and will hopefully be resolved later this year or next when and if GlobalStar adds another satellite to their system.

These messages include both a short bit of pre-set text I can provide such as "Hi, this is Wayne reporting to you with my current location" and the lat/long coordinates at the time I pressed the button.  As part of the setup, I go the website and put in the mobile phone numbers (for text messages) or the e-mail addresses of the people I want to receive these messages. Thereafter, every time I press the √ CheckIn button, all of these people get this short message with my updated location. Simple, handy, powerful.

Having used this for the past few months while I've been out sailing, I've also come to appreciate that this lets everyone who cares not only know where I am, but also that I'm OK since I have had to consciously press the √ CheckIn button.

Track Progress:  The SPOT also has an automated position reporting option that they call "SPOTcasting" and I use this a great deal. When it's turned on (by simply holding down the  √ CheckIn button for 5 seconds), SPOT automatically transmits my lat/long coordinates every 10 minutes for the next 24 hours to a web server. 

 

Of course, it would be rather obnoxious to have these going to people's mobile phones or e-mail inboxes, so instead, these "SPOTcasting" messages are just stored on a server and are accessible to me as either a historical log, or as a set of points displayed on a map that I can share with anyone.  Initially, I could only provide access to people by giving them my login information and password for the site, but a few weeks ago they finally added my #1 wishlist request, which is the ability to create and share a web page that displays all my check and track points "live" on an interactive map like this. By combining or "mashing up" an interactive online map (Google maps) with a feed of my check points and/or track points as they are broadcast from my SPOT via satellite messages to this server page, I am able to provide access to the complete history of my travels and my current or last location to anyone with a browser.

* I do my best to practice the experiential learning I'm so often expound on here, and real-world use is one of the key requirements and values I have for these Cool Tool posts. If you're interested in a real world example of the use of SPOT type technology ,you can follow this link to my personal travels of late.  I'm writing this on June-4-2008 at about 14:07 UTC so I'll let you figure out where I was at that time. 

Emergency use:

Fortunately I have not had to use either of these yet, but SPOT has two more buttons for emergency use:

Ask for Help:  I would press this one for non-life-threatening siuations. It is diffferent from the CheckIn message because it sends out a pre-programmed message to my contact list, telling them I need assistance and giving them my location data and a link to it on Google Maps.

Alert 9-1-1:  This, as you might expect, is for life-threatening situations, and it's the one you hope you never need!  When pressed, this sends an alert to the Emergency Reponse Center and sends a distress signal. the appropriate responders at that location, such as police, Coast guard, country's embassy or consulate or other emergency response or search-and-rescue teams.  It also notifies my emergency contact person(s), which I have provided when I initially set up the device.

And that's it!  Simple, easy, powerful.  The SPOT is not for everyone, but this is part of what I had in mind for these Cool Tool posts—not a Top Ten list of what is most popular (there are lots of these for you already), and not just something shiny and new, but something very useful and valuable for the right person at the right time in the right context. We (both individually and as groups) are unique "snowflakes", as are our situations, and so these Cool Tools are aimed at helping all of us discover things that will match our unique needs or the needs of those around us, and share a part of the overall Snowflake Effect, which my great colleague Erik Duval speaks of and write about so often.

Hope this SPOT satellite messenger is of value and interest to you.

***********

Have  "Cool Tools" you use and want to share?  Send me your favorites with the following information:

• Name of the tool and source for getting one. 
• What does it do? 
• How did you come to discover this? 
• How do you use it? 
• Why is it on your top ten "Cool Tools I Use" list?

Serious Play: Are We Humans the Biggest Computer of All?

Would you be interested in a future where the pursuit of fun and enjoyment was one our our major roles in life because it leads to solving extraordinarily large and complex world problems? For example, what if all of us helped to digitize all the content contained in all the books in the world? Almost none of this content is currently available on the Web or in any digital form and as such, is largely inaccessible to most. And would you be interested in a world where the relationship between computers and humans is a very positive and symbiotic one? I know I would. 

I'd like to bring your attention to some of the ways in which this is already happening. Let's see if this excites you so much that you'd like to not only participate in some of these processes, but also start to use some of these models to help solve some of the problems you and your profession or areas of interest face.

In my previous posting "Moving aLOM", I mentioned some of the exciting, yet daunting, challenges of the future of metadata, such as how to create, in staggering volume, some of the more "subjective" metadata—things like the infinite characteristics that describe people, places, and things—where we humans are still the only source. This effort would include things like creating metadata for all the images and videos out there—still a largely unsolved problem—the absence of which not only makes them very hard to find, but also makes the Web and computers very inaccessible to the visually impaired, which, with age, might include a lot of us!

The Exciting Work of Luis von Ahn

Perhaps most notable in this area is a relatively young new professor at Carnegie Mellon University, Luis von Ahn, standing at right in this photo with his PhD advisor Manuel Blum. Luis has already completed some amazing work on what he refers to as "human computation" and how to put "wasted" human cycles to use in solving problems a computer cannot solve at this point in time, but humans can solve easily. Luis also picks up on a theme we have discussed here on Off Course - On Target in many other contexts—the power of the "network effect" achieved by connecting everything and every one together. Human computation is obviously focused on the latter, and Luis wants us to consider having all of our brains connected together as an extremely advanced large-scale distributive processing unit. Not to worry, no wires or direct connections to your head are required!

Before I go any further, and especially if you are more of a visual and auditory learner, let me recommend that you immediately watch this talk called "Human Computation" that Luis gave on July 26, 2006, about the power of human cycles. This 51-minute talk is part of the Google Video Text Talk series (also highly recommended), and while it is long by some current standards, I feel very comfortable recommending this to you, since I'm convinced you'll agree it was a VERY good use of your time (actually Luis' talk only runs 40 minutes, and is followed by about 10 minutes of a good Q&A session).

Another excellent reference for you, which contains more fascinating details and examples of von Ahn's work, can be found in Clive Thompson's article "For Certain Tasks, the Cortex Still Beats the CPU"  in the June 2007 edition of Wired magazine.

Games with a Purpose

But for those who don't have the time right now to look at these things more, here is a quick synthesis of what I find so exciting and interesting about the innovative use of our human "compute cycles", and the use of "fun and games" for very significant and "serious" results. What von Ahn likes to call "games with a purpose".

One of the most common and effective examples of this type of human computation is one of Luis' first applications, which is known as "Captcha". The name may be new to you, but I'm sure you're already a veteran Captcha expert! Captchas are those slightly difficult to make out words that you are asked to identify and type into a box when you are signing up for web sites. Captchas are used for responses online and in other situations where we want to prevent automated "bots" from generating unending amounts of "spam" or other undesirable exploitations of such online experiences. The problem is how to differentiate between a human response and a computer response, and Captchas are a simple solution to this problem, as well as a simple example of a problem that computers can't solve by themselves.

In itself, this doesn't sound like that interesting of a problem, although certainly it is an annoying one! However, part of what I would see as Luis' brilliance is in the more primary problems he is solving with this process.

In the case of Captcha, the real problem being solved pertains to my initial reference about the challenge of digitizing all the content of the world's printed matter, such as books. For more background on this digitizing and scanning challenge, you may want to refer to my previous posting from Jan 2007 "Books—the NEW old medium". Specifically, the problem is with all the words found in printed matter that scanning and conversion technology cannot make out, because the medium has a crease running through it, or it is partly missing, or other factors which make it impossible for the technology to recognize the words correctly.  Yet, show these words to almost any one of us and we can easily recognize the word.

So all those "fuzzy" words in Captchas are NOT just some random words that are blurred to fool a computer. Instead, these are the images of words which scanning technology has failed to recognize correctly! Luis refers to this specific application as ReCaptcha and you'll find much more information there, as well as instructions and free plugins for you to embed within your own sites, blogs, etc.

And that's just one side of why Luis von Ahn was awarded one of the MacArthur "Genius" awards and a Microsoft Research grant, for he has also managed to put these types of solutions into a game format that starts to look at solving these kinds of problems at a scale that is truly breathtaking! 

Solving World Problems or Playing Solitaire?

In his talks, Luis likes to use a very compelling metric of human-hours, and he often compares statistics on the the amount of human-hours that are "wasted", in his opinion, doing something like playing Solitaire on a computer. I too have always been amazed at the number of people I observe when walking down the aisles of an airplane, for example, who are hard at "work" playing Solitaire, but I had no idea just how much time is spent on this. According to the statistics that Luis uses, over 9 billion human-hours were expended playing Solitaire in 2003 alone! Better yet, he puts this into perspective by comparing this activity to such things as:

• The building of the New York City Empire State building, which consumed about 7 million human-hours, and thus equates to just 6.8 hours of collective Solitaire playing.
• Building the entire Panama Canal, which took 20 million human-hours and amounts to less than a day of collective solitaire playing!

Metadata for All Images?

Now imagine if we were able to put this kind of "human computation" to more effective use AND still do so within the format of games that people can enjoy doing themselves! One example is another one of Luis' creations, and one that has been running with staggering results for over three years called the ESP Game. As we've discussed many times, experiential "learning by doing" is often one of the best ways to learn about something new, so I'd encourage you to not only read about the ESP Game on that site, but to play it for awhile. (Caution: can be very addictive and time consuming!) When you do, you'll see how it puts two or more players (there is also a single player version) into a friendly competition by typing in descriptive words for a given photo (that metadata thing again), and they get points whenever they both type in the same word.

So what? While progress is being made in image recognition technology, this is still largely a problem that computers cannot do. And ask yourself, do YOU take the time to "tag" or create all the metadata for the photos and videos that YOU post, such as who and what is in the photo? Didn't think so. Yet by using this type of game format, the ESP Game has been running for over three years with no drop off in popularity and as of mid-2006, it was very fast, very cheap, and very accurate. If this were done as a popular online game site, it would be possible to label all the images on Google Image Search in just a few weeks! No surprise then that the ESP Game has already been licensed by Google in the form of the Google Image Labeler, and is used to improve the accuracy of the Google Image Search. We humans are relatively competitive animals and we like to do what we enjoy, so this approach appears to have a lot of promise.

Yes, but WHERE is that object in the photo?

Another problem that is even more challenging than identifying WHAT objects are in the image is identifying WHERE they are in the image. To do this, Luis has created another game called "PeekaBoom". The first player sees an image along with a word that describes an object within the image, and then clicks on the image where the named object is located. The second player sees only the object that the first player clicked on and types the word associated to that object. Once the second player guesses the correct word, the two players move on to the next image and switch roles. More details are explained in the video (you really should take the time to watch it!).

Human Computer Relations: Parasitic or Symbiotic?

Luis also notes how this transforms the current relationship between humans and computers from what he calls a parasitic relationship to a symbiotic one where:

"...humans solve some problems, computers solve others, and together we work to create a better world."

Sound far fetched? Well, in the less than two years that his limited experiment of the ESP Game has run, over 75,000 players have come up with over 15 million "agreements" (matched words). This rate would indicate that 5,000 players playing simultaneously could label all images on Google Images in about two months. Think about that...5,000 is NOT a very big number when you consider the numbers on many gaming sites. Therefore, it should be possible to label all the images on the Web in a few months. Again, I strongly recommend that you check out the video to get not only more details, but to see just how accurate, pragmatic, and promising this approach is. 

For example, it turns out that the results of a game such as PeekaBoom can in turn be used to help train computers to recognize objects and their location. Turns out that one of the reasons that computers are not yet very good at this type of object recognition and automated metadata generation is that there is very little data and examples to use to "train" the computers on how to do it. By capturing the results of all the human play in location identification of objects within images, this data can then be used to train computers to do the same thing"—allowing us move on to new challenges... and more fun.

Super Side Effects

I think you'll agree that this approach not only shows great promise in terms of solving some very large scale problems, but has some surprising and equally amazing "side effects", like how some people have used this to help them learn a language. This approach has spawned its own game called Babble, where two English-speaking players are shown a sentence in a foreign language that neither of them speak, and are presented with a list of possible meanings (in English) below each word. Players try to agree upon a set of English words that forms the most coherent sentence. The result is that this activity is surprisingly effective in translating foreign text into English without requiring anyone fluent in both languages. Think of the possibilities of this running at a larger scale!

Another "side effect" of this approach is how many players have noted that they end up finding other people who think very much like them, and thus they have a great sense of "intimacy" and closeness with their counterparts who play these games. Therefore, many  ask if they can find out who their anonymous competitors are to continue the conversation. At this point in time, all the game players are anonymous and no identities are revealed, but one could imagine this being used as a way to help discover other people "like you"—ones you'd want to meet and get to know better.

Common Sense Isn't that Common; yet!

And lastly from von Ahn's work, check out his new game Verbosity, which helps to generate what he calls "common sense facts" (again just more metadata really). One player is given a word and the other tries to guess what it is by completing fill-in-the-blank-type templates, such as "It is a type of ____" or "It contains ___".  The player who entered the original word can answer "true" or "false", but can't use the word itself. All this is very much like some party games that many of you have probably played, but the important difference here goes back to the original point of the summative network effect and how this can all be put to greater use. In the example that Luis shows in his presentation, the word "milk" would have some common sense facts such as;

• It is white
• It is a liquid
• It is often used to eat cereal
• It has lactose

Again, computers can not currently solve this kind of problem, and it is another an example of the need for massive amounts of metadata. Imagine if we started generating massive volumes of these "common sense facts" and they were readily available to all. 

More Competition = Less Carbon?

Lest you should think this is just a "one man show" from Luis von Ahn, I want to point out that there are many others who have been developing, adopting, and adapting similar models. For example, "Carbonrally: Carbon Challenge", which you can learn more about from the Nov. 20th, 2007 Webware post "Carbonrally: My carbon footprint's smaller than yours" by Martin LaMonica, is an application that is showing some great promise for improving the reduction in greenhouse gas emissions or the "carbon footprint" of individuals and organizations alike. Carbonrally adds the dimension of some fun and healthy competition to do better than others. As Martin describes it, Carbonrally is "tapping into people's tribal competitive spirit".

Whew!  That's quite an introduction to what I believe is both a powerful and profound pattern emerging—where the natural pursuit of fun, healthy competition, and challenges are combined into a game-based model that has already shown some of the ways we can solve large-scale present and future problems. It also creates a whole new relationship between us and technology. This model is not only interesting and fun, but it is a fascinating example of "user generated metadata", which I mentioned in my previous "Moving aLOM" posting.

Your Turn to Play!

Besides raising your awareness about "human computation" and the power of this approach, I also want to encourage all of us to put more time and energy into figuring out how we can inject more fun into work and other problem-solving situations. As you do so, I think you'll see an important job or task or problem  can be more fun if it's solved with some kind of game play, and where the solution remains very much a human one.

We can not, for now at least, expect computers to come up with such fun and game-based solutions by themselves! 

For starters, if you have websites or other applications where you have problems preventing spam or other misuses, consider taking advantage of some of the freely available plugins and nullities, such as those from the ReCaptcha site. Longer term though, please put some thought into which problems you could address with this model, and the ways you could do so by injecting the fun and challenge of a game-based approach into the more serious problems you need to solve...then share them with us here at Off Course - On Target.

I'm reminded of the great quote from Brian Suton-Smith who said:

"The opposite of play is not work; its depression!"

And I look forward to hearing all the innovative and creative ways you will come up with to solve problems—large and small—and replace depression with play. Have fun!

Moving aLOM

If you are a regular visitor here at Off Course - On Target, (OCOT) you know that metadata—characteristics that describe anything and everything—has been a major part of my life and a major focus for many years. If you'd like the full story of my initial recognition of metadata and its value, you can listen to or read my previous posting "Wayne's Wine Epiphany".

What is metadata?

Sometimes metadata is more commonly called "tags", such as the information you provide for things like photos that you upload or blog entries you create and search for. At a simple and personal level, metadata would include your name, phone number, address, family members, your likes and dislikes, skills, knowledge, etc. These are all of the literally millions of characteristics that describe, and to some extent, define you and the world around you.

Among many other benefits and uses, metadata is critical for improved "findabilty" and discovery, as opposed to searching. It is largely via metadata that we are able to find the "right"  people, places, and things (with "right" referring to our individual situations, context, and needs). This also works in reverse by enabling other people, places and things to find us, where appropriate and wanted.

What's been my involvement?

One of my more significant commitments to metadata started back in 1997 with the creation of the IEEE Learning Technology Standards Committee or LTSC, and within this committee, the formation of the Learning Object Metadata Working Group or LOM. LTSC is a group of volunteers who are devoted to development and implementation of standards for interoperability for use within the worlds of Learning, Education and Training (LET). LOM is a set of standards focused on the metadata required for more effective learning and performance.

I've had the honor of being the Chair of the LOM Working Group for over ten years, and this has afforded me the privilege of working with some of the most dedicated people I know. They have worked tirelessly, and often thanklessly, to produce several fully completed standards for metadata such as the IEEE 1484.12.1 standard for the LOM data model and the IEEE 1484.12.3 standard for the XML binding of LOM to enable the exchange of LOM instances (metadata records).

You may not understand or even be interested in these specifics, which is as it should be for most standards. How much do any of us care or know about such things as TCP/IP, HTTP, or the other standards which make the Internet possible? In a similar way, standards for metadata—of which LOM is but one—are part of what has enabled the improvement  of the creation and interoperability of metadata (though much is still needed).

To our surprise, LOM standards have been implemented broadly, both within the context of learning, education, and training, as well as within an eclectic and extensive list of other domains, including art, history, archives, and human relations. I know of no way to count the amount of such LOM-based metadata nor the number of implementations of LOM, but the numbers are globally dispersed and easily numbered in the millions and beyond.

What's Next?

Now it's time for both LOM and I to move on into our respective next stages and hence the title of this posting. As of January 1, 2008, I will be stepping down as Chair for the IEEE LOM Working Group, and I'm delighted to publicly congratulate Erik Duval for being appointed as the new Chair of LOM. I am about to make some significant changes in my roles and responsibilities, both personally and professionally (more on this in a future posting), and it is time for LOM and metadata overall to evolve to best fit the "Brave New World" we now live in. In spite of his relatively young age, Erik Duval has been one of the longest serving individual experts focused on metadata for learning, education, and training. Based on his work in metadata since the early 1990's, such as the creation of the ARIADNE project which is a large European based consortium focused on knowledge sharing and reuse, Erik was instrumental in the creation of the IEEE LOM WG from its very beginning.  Officially, Erik has served all this time as the Technical Editor of LOM and, along with Tom Wason, they created the initial kernel that grew into the full LOM standard. I could not be happier or more optimistic about the future of LOM and of the advancement of metadata than I am with turning over the leadership to such a capable individual and someone who has become one of my closest professional colleagues.

While those of us who first began to put this focus on metadata knew it was important for the future, I'm not sure that any of us could have imagined the degree to which this would be true or the scale of use and generation of metadata. To meet these new needs and scale will require both the evolution of metadata as we know it, as well as a complete rethinking. Some new leadership and energy will be of great assistance in making this happen. As such, the other main purpose for this posting is to bring your attention to some important and recent developments in the area of metadata; the first is a series of new activities within and related to the current LOM standards, and the second is addressing the longer term future of metadata developments—it's worth keeping your eyes on.

Where is LOM heading?

Here's a short overview of the new activities related to LOM:

• Reaffirmation of the 1484.12.1 LOM standard, which is largely an administrative action required by IEEE for all active standards every five years.  As the name applies this is merely a check that an existing standard is still in active use and will continue to be so. As the millions implementing LOM can attest, this is very much the case.
• Corrigenda for the 1484.12.1 LOM standard, which will provide a list of all the minor (but important) technical corrections and edits to the original LOM standard, which have been discovered by those previously implementing LOM.
• Two New Parts for LOM:  After several years of work led by Mikael Nillson, the Joint DCMI (Dublin Core Metadata Initiative) / IEEE LTSC Taskforce has just initiated work on two new IEEE standards.  The previous link will provide you with access to all details of the work to date, previous meeting notes, and ways to contribute to these efforts.  As briefly and coherently as I can put it, these two standards are for:
  • Developing a Recommended Practice for Expressing IEEE Learning Object Metadata Instances Using the Dublin Core Abstract Model to meet the growing demand for interoperable definitions of Dublin Core Metadata Initiative (DCMI) metadata terms and IEEE Learning Object Metadata (LOM) data elements, which allow these to be used together in metadata instances.
  • Developing a Standard for Resource Description Framework (RDF) Vocabulary for IEEE Learning Object Metadata (LOM) Data Elements. In simpler terms, this standard will  address the increasing demand for definitions of IEEE Learning Object Metadata (LOM) data element semantics, which allow the expression of IEEE LOM instances in applications using Semantic Web technologies such as the Resource Description Framework (RDF). For some data elements, this expression can be achieved using existing, stable RDF vocabularies. The purpose of this standard is to define the semantics of data elements not covered by such vocabularies. This standard forms an important basis for making IEEE LOM useful in this larger metadata context.
• LOM next:  Over the last year or so, we've discussed how we want to make LOM evolve over the longer term. The time has come to consolidate that discussion, gather requirements, and start thinking about how to meet those. Erik and the LOM Working Group have begun a series of open, regular, synchronous discussions in order to first bring everybody up-to-date on these activities, develop a plan of action, and then to begin the necessary new work.
  • These meetings are open to ALL and will be virtual meetings accessible both online and via phone.
  • If you are interested in participating, please either contact Erik Duval directly via e-mail ([email protected] ) or subscribe to the LOM mail list on the LOM web site. 
  • While those with metadata expertise would be especially welcome, it is equally valuable to get input from a diverse range of others who want to use and benefit from significant improvements in metadata for LET in the future. Please consider adding your input to this important effort.

Trends in Metadata

Metadata is often unnecessarily limited by the popular "data about data" description, but it is so much more than this.  Metadata is perhaps most often applied to "nouns", and my simple minded recollection of the definition of a noun is a person, place, or thing. To date, most of the focus has been on metadata for content (which has been very beneficial and for which much more work is still needed), but the future will include much more attention on the other "nouns"—people, places and things. This post would go on for much too long were I to do justice to any one of these or countless other areas that would benefit enormously from improvements in their related metadata aspects, so I will only list a few areas and provide you with a glimpse of the future potential within. Watch for future developments in metadata for some of the following:

Metadata about PEOPLE

This kind of metadata, especially pertains to our skills, knowledge, abilities, experience, attitudes and competencies.

In one small example, the IEEE LTSC Working Group 20 recently completed a standard for "Reusable Competency Definitions" or RCD, and this Working Group is now looking at other aspects of competencies that would benefit from standards. 

Metadata about PLACES

For example, we are seeing the recent surge of metadata in the use of maps, and GPS metadata is being added to things like Google Earth", which will enable us to answer questions such as:

• "Where are you now?"
• "Where was this photo taken?" 
• "What does this location look like?" 
• "What happened here in 1782?"

Imagine the possibilities as more locations become "smart" with metadata about them and related to them. Photos and video might show what they look like now and in the past. Metadata will be increasingly available for every building, its contents, furniture, features, hazardous materials, fire extinguisher and escape information to name but a very few metadata elements.

Metadata about THINGS

Metadata about things provides the characteristics of all the physical objects in the world, such as machines, parts, equipment, food, furniture, music...well you get the idea. 

Add to this all the non-physical things, such as objects created in virtual worlds. Now imagine if all these "things" were connected and could start to share this information and "talk" to each other.

You are already familiar with bar codes, which contain the metadata for everyday things, as well as the more recent use of RFID tags to electronically capture and broadcast all of this metadata. This is sometimes referred to as "the Internet of things". See the 2005 executive summary of the Internet of Things for one perspective and more detail on this concept.

For example, imagine if all the ingredients in your kitchen made all their metadata available, such as how full or empty they are, when they are about to expire, which combinations might let you make a dinner along the lines of what you desire, and without a trip to the store.  It's all just metadata!

To learn more:

• Wikipedia provides this brief overview on the related topic of object hyperlinking.
• This short BBC article from 2005 discusses how the United Nations was predicting such a "network of everyday objects".

AUTOMATED metadata generation (AMG)

Once you start to consider the massive amount of metadata that is required and possible for each and every person, place, and thing, you quickly "do the math" and realize the overwhelming problem of "How will all this metadata ever be created?" Our initial tendency has been to assume that metadata is all human generated—literally "typed in" to forms. If this were true, there would not be much of a future for metadata, since there is most likely more metadata than data and certainly more metadata than there are people, places, or things! 

While human generated metadata, especially the more "subjective" metadata elements, will always play an ever more critical role in the future, it will become the minority of the overall volume of metadata. Increasingly, metadata will be generated automatically.

To learn more:

• See this article on AMG which comes from one of the many groups that Professor Erik Duval leads at KU Leuven, a prestigious Belgian university.

USER GENERATED metadata

Did you know that literally all the metadata for all the CD's and music you see displayed on your MP3 players, iPods and computers, artist name, title, album name, etc. is generated by other listeners, such as yourself and NOT by the record companies or publishers? What if we could tap into the metadata that each one of us (eventually all 6.6 billion of us) are probably generating every day, such as the tags and captions we add to photos, the PowerPoint slides we create, and search terms we use, to name but a few?  Such is the power of user generated metadata and there will be much work in the future to increase the generation of, capturing, and putting to effective use the flood of metadata that will result.

ATTENTION metadata

Attention metadata is a common term for all the metadata that captures your likes and dislikes, and which can help you find everything from great music to listen to, people to get together with, TV shows and video to watch, etc. We can think of it as the things we "pay attention to"...hence the name.

Attention metadata is what recommender systems are based on. One such effort to address some of the needs for better capturing and interoperability of this type of metadata is that of the attention.xml group. You can listen to this 2004 podcast with some of the originators of attention.xml and this podcast and blog from Alex Barnett discussing attention related topics.

Why would you need this? Consider shopping sites that track your buying patterns, and your opinions and preferences after such purchases, and use these to help you find additional items that you may want (if you let them). How does the system know if you are buying the item for yourself or as a gift for someone special? Currently they do not, and therefore the recommendations become less relevant and you likely stop using them. However as these issues begin to be addressed, there will be more and more "decision support" to help us deal with the growing problem of an economy of abundance and too much choice for those of us privileged enough to live in such situations.

Metadata UNIQUE and SPECIFIC to LET

While some of the metadata standards, such as LOM, are intended to cover the application to LET, most of the initial work to date has been much more general and largely applied to content. There is an enormous need for much greater focus on metadata that is unique and specific to learning, education, and training. This would include metadata to assist with evaluation and assessment—matching learning styles with teaching styles, and helping each of us as unique individuals to have LET options that are just right for us at just the right time and in just the right way.

And trust me, this is but a minor scratch on the vast surface of but one slice of metadata and its very exciting future! 

So LOM, for now....

I certainly have mixed emotions about reducing my direct involvement in LOM and the development of some of these future metadata related topics. However, I can't imagine leaving LOM in better hands than those of Erik Duval and the many, many other dedicated individuals, old and new, who have such dedication and passion for improving learning, education, training, and performance and indeed the world in general, through better use and generation of metadata.

Whether or not you consider taking an active role in this future development of LOM and metadata standards and specifications, I certainly encourage you to pay more attention to the role of metadata and how it serves as a fundamental principle in the future of your life, both personal and professional, and the future of the world around us.

Wayne

Oh Really? - Computational Photography

One of the most significant trends shaping our future is the redefining of what is "real" and specifically, bringing everything and anything into heightened and full three-dimensionality (or more), definition, and fidelity. I refer to "real" in the sense that we believe it "exists", and that we are increasingly:

• Losing the ability to distinguish between what is real and what is unreal.
• Losing the ability to distinguish between originals and copies, real and synthetic, real and unreal, real and virtual, here and not here.

This trend includes such things as the so-called 3D web, virtual worlds, the Internet of Things, 3D scanning and printing, and 3D human/computer interactions and interfaces, to name but a few. Will there be any such thing as "unreal" in the future? 

Since I am fascinated with and fixated on this topic, I'm going to develop it as a theme. Perhaps we'll call it "Oh Really?" and pursue it much further over a long period of time here at Off Course - On Target (OCOT). I've previously written a few articles on this subject, such as Coming Soon to a Desktop Near you:  Massive Amounts of 3D for the Masses and will cover this area more, but we'll also get into some of the many other aspects of the changing (let's hope!) ways we interface and interact with technology and are making these much more "natural" and "real".

For today, I want to briefly bring your attention to some exciting new developments coming out of Adobe Systems R&D work on new 3D camera lenses and some software they've developed for processing the resultant images. As you'll see, this technology opens up whole new possibilities, not just for photography, but for some amazing new ways of "playing with reality" by enabling you to go back into previously photographed scenes and change the images. Adobe is referring to this "computational photography" and as with many of the stories we cover here at OCOT, this one is interesting not only for the specific example, but especially for the larger topics and issues it reveals. 

Here's the story and it comes most appropriately from Dave Story, Vice President of Digital Imaging Product Development at Adobe, pictured here (thanks to Audioblog.fr) holding the original lens.

For a quick overview of Adobe's research, you may want to start by checking out "Adobe shows off 3D camera tech" on Crave. This topic originates from a recent demo Adobe did in France showing their initial R&D work with a prototype camera lens consisting of 19 different lens elements that provided multiple views at slightly different angles and what Dave described as being a bit like what a multi-faceted insect's eye would see. 

Fortunately for us, Luc from Audioblog.fr was at the demo with his video camera and has put up this 10-minute video clip.  When you first get to this site, you will also see that we still have a way to go with machine translation (in this case by Google), but bear with it and be sure to check out the video at the end to get the best understanding of what "computational photography" might lead to.

Of course, the serious fun begins once the hardware and software can take over and use these multiple images and angles to enable some very new and different possibilities. For example, they are now able to dramatically extend the concept and functionality of a "brush" in terms of what you can do with a "virtual brush" when working on photo images. In the video (and this screenshot from it) you can see Dave Story use what he calls a "focus/unfocus brush" to go into a photo and shift the focus from one statue to another in the photo. He goes on to suggest that they can also create a "3D healing brush" that would enable you to, for example, get rid of an obstruction in the original photo.

You will also see how they are able to move the "camera" after the photo has been taken. The movement in this case is very slight, but this idea of being able to capture moments and then go back and manipulate them AFTER the FACT is one of those possibilities which are equally and concurrently frightening and exciting. Something very powerful is going on here. 

Imagine If

Take this out quite a bit further and consider the potential when we have a full set of 3D data for every single pixel in digital images!  Imagine the manipulation you could do to both still and moving images; think about how you could go back into a scene or a "captured moment" and look at things from different angles, perspectives and focus. We've already been seeing advances in video camera work on movies and in televised sporting events, where they are able to move the camera through a full 360 degrees and all six degrees of motion, but now imagine YOU being able to move and manipulate the imagery on your own AND AFTER the fact!

The Future is Already Here

Or consider the uproar that has already been happening around the 3D "maps" that Google, Microsoft, and others are creating by having 3D mapping trucks drive through an area (large cities for now), taking a complete set of digital and laser images of the entire area. These images are then stitched together, so you can go from a spot on a map to "being there", enabling you to look around from that spot and see a full 360 degree surround of what you'd see if you were "really" there. The concern, by the way, is over privacy (or lack thereof) , and of what would be captured by all these images, which are constantly being updated.

This is another one of those things you can really only learn and appreciate by experiencing it, so if you have not already done so try this(I'll use Google for this example, Microsoft and Yahoo offer similar features):

• Go to Google Maps.
• Click on the "10 Market Street" listed in the left window (or anywhere in San Francisco for that matter).
• click on the "Street View" button on the top of the map area.
• Move the "little orange person" icon that shows up on the map to some intersection on the map.
• Move your cursor around in the street level photo image that appears to look around.
• Move your orange person icon up or down the street to look around there.

Scary?  Exciting?  Make you think about more possibilities if this is just rev 1.0?? YES!

And we think we have problems now (and we do) with not being able to tell the difference between an "original" photo, and one that has been altered!  Just imagine the degree to which this technology scales those problems exponentially!  Apropos to our larger theme here of full 3D reality and blurring the distinction between what is real and what is not, you can easily see how this recent example of "computational photography" is taking us in that direction and dramatically transforming what were previously just 2D photos, maps, and images.

"Computational photography is the future of photography," Story said. "The more things we can do that are impossible to do in a camera, the more powerful people's ability to express themselves becomes."

Quite true, and so once again, the great question that arises from such exciting new technology developments is what will you, and we collectively, DO with such newfound capabilities?  And what might we want to agree NOT to do?  What uses can you think of applying this to?  What problems can you now resolve with this?

I hope you will enjoy our foray into the world of 3D and the new reality, which of course is really just a matter of us finally having technology and ourselves catching up to the world as it's always been; VERY real and very multidimensional.  Oh Really?

del.icio.us tags: computational photography, Adobe, Dave Story, reality, real, unreal, photography, 3D mapping, 3D, 3D lenses, Oh Really?

Technorati tags: computational photography, Adobe, Dave Story, reality, real, unreal, photography, 3D mapping, 3D, 3D lenses, Oh Really?

New Perspectives: The Benefits of Looking Up!

Alan Kay (sometimes referred to as the father of the PC, object oriented code, and much more) is credited with saying that "point of view is worth 80 IQ points". This is a catchy way of saying that consciously looking at problems and situations from multiple perspectives and constantly looking for new perspectives to solve problems is an extremely powerful technique and skill to develop.

I suspect that you have many examples in your own life, where you've come up with solutions or have been more creative in your problem solving using some version of this idea. This idea of helping others, as well as myself, to discover and utilize new perspectives is a strategy I use in most of my work, and is a primary goal for Off Course - On Target. So with this in mind, let's see if we can get a bit "smarter" by finding and using a few new perspectives.

Looking up

We humans have a natural tendency to look ahead and down much more than we look up.  It was always a successful strategy as a child playing hide and seek to climb up a tree or onto a top shelf in a closet. And anyone unfortunate enough to have spent time in a hospital bed or on a gurney knows how different the world looks from this perspective and how little attention is paid to ceilings! On the other hand I've noticed that dentists have taken notice and are putting things on the ceilings, such as paintings or televisions, for you to look at while you are reclining in the dentist's chair.

A very recent example of this new perspective of looking up is an exciting new feature in Google Earth called "Sky".  This simple,  but powerful new feature gives you the ability to choose a location on Earth and then turn the "camera" around to look up and see the sky. This amazing tool lets you see and explore stars, animations of the planets movement, zoom in on fabulous Hubble imagery and more. Here is a short video tour that shows Sky in action:

Based on my brief time with this new feature I see this as fun and functional.  How well did your school science courses help YOU understand the spatial relationships of the moon, earth, sun, and stars?  How well can you point out the different stars and constellations in the night sky to your children or others, explaining why they change depending on date and your location? Sky sure seems to help me a lot with this.

To continue with your experiential learning, something we are so fond of here at Off Course - On Target, I highly recommend that you download the newest version of Google Earth and take the Sky feature out for a spin. I think you too will find that it offers some serious fun and lots of learning as well.

And while you're up in the Sky, why not fly?

In some recent posts, I   emphasized the need to avoid what I've characterized as "flapping", that is, copying experts and models of the past, and instead have urged you to focus on the essential characteristics you are seeking to take off and fly.  So it struck me as a nice bit of serendipity to read of the recent discovery of a hidden flight simulator in Google Earth. These secret capabilities, referred to as "Easter eggs" are a favorite of some application developers.

Adding motion is a great way to gain a new perspective, so strap yourself into one of the two airplane options, an F16 Viper and the more manageable SR22 4 seater, and try flying your way over your home region or anyplace else in the world you'd like to see.

To access the hidden feature, open Google Earth and hit Command+Option+A (must be capital A) or Ctrl+Alt+A.  Here is a full list of the keyboard controls for the Google Earth flight simulator. Fasten your seatbelt low and tight and welcome aboard! 

BTW, as you are flying around see how much the realism that comes from flying over photographic images of the "real" earth and sea starts to address some of the limitations of your experiences with less accurate virtual worlds that we've also mentioned in previous discussions, such as in my posting Virtual Lift Off?

Stars to Sea

Another way to use new perspectives is to find ways to tie two or more of them together.  For example, how can the benefits of looking up at the stars, help us when we are down on earth looking out and around us?   

Well, consider sailors who venture out into the open ocean and how extremely dependent they become upon knowing their precise location.  This, of course, helps us just as much with navigation on land. Many of you have experienced the benefits (and aggravations) of onboard GPS and navigation systems installed in new cars you may own or rent.  While modern day technologies, such as GPS and electronic charting, look after navigation with unprecedented ease and extraordinary accuracy, you always want to have a backup or two or three when your life depends upon it! Therefore, the ancient method of celestial navigation is still used as a backup by most who sail the open oceans. 

As an aspiring global sailor myself, I'm busy learning as much as I can about this art and science of finding your way by the sun, moon, stars, and planets, and I'm acquiring skills with sextants and the like. You can just imagine how much Google's Sky makes me "smarter" by helping me to learn these new concepts and skills.  Besides, I just love the juxtaposition of setting my sextant, an 18th-century technology, down beside my oh-so-very 21st-century latest, greatest, high tech GPS system and digital charting screen. 

What examples do you have of using inverted thinking and new perspectives to help you learn more, and be more creative in your thinking and problem solving? Please share your examples through your comments here at Off Course - On Target or in your own postings and I'll continue to do the same.

Thanks!

w
a
yne
=====

del.icio.us tags: Sky, perspectives, astonomy, sextant, navigation, stars, sailors, celestial, sailing

Technorati tags: Sky, perspectives, astonomy, sextant, navigation, stars, sailors, celestial, sailing

The Future is Surfacing

For the past few years, I’ve been talking about digital surfaces predominating our future, and my postings, “The Old Medium becomes the New Content” and “P-Learning: Fill up your Tank and your Head?” pointed out some good examples of this trend. So you can imagine how excited I was to see today’s announcement of Microsoft’s ventures in this direction and I’m particularly excited about the name they chose.  It may not be a cool product name but it's hot stuff for me!

At the "D: All Things Digital" conference on May 29th, Microsoft finally revealed a well-kept 5-year secret, code named “Milan”, and now unveiled as Microsoft Surface. This technology is part hardware and part software and some are referring to it as a “Table PC”. Read that term carefully—that’s TABLE as in “desk” and is not to be confused with the one with the extra "t", the Tablet PC, though it too may also benefit from this surface technology down the road.

The hardware behind it is fairly straightforward, though a feat in itself, because it is a large multi-touch screen or display, typically about 30 inches in size, which is mounted horizontally, facing up like the surface of a small table. To have the imagery display directly on the touch screen required a combination of angled side projection and touch screen technology.

Of course, hardware without software doesn’t do much. Add Microsoft Surface software into the equation, and things get really interesting. The software makes it into a full multi-touch display with lots of built-in features for gestures, recognition, etc. “Multi-touch” means that the screen responds to almost any number of simultaneous touches. You can do simple finger painting using up to all ten fingers at once, or perform more complex manipulations using multiple fingers on both hands, such as stretching out an image or window, or rearranging and moving windows around with your hands.

You can also “pass” things that are on the screen over to someone else. Many individual users can physically fit around the “table”, interacting with the surface simultaneously. One additionally interesting fact is that Microsoft will produce both the hardware and the software, something they are already doing, for example, with the Xbox 360 and the Zune music player.

It’s been quite a news item, so there are lots of links about it. Here are the ones that I thought give the best understanding and demonstrations:

• The Microsoft Surface site has a full complement of videos, pictures and specs.
• ZDNet has a demonstration of Microsoft Surface and a Ziff Davis interview with the product marketing manager, Mark Folger.
• TechCrunch posted an announcement "Microsoft Announces Surface Computer".
• USA Today’s more detailed report “Table is Set for Computing” has some good examples of applications.
• CNet News provides an in-depth write-up called “Microsoft hopes 'Milan' table PC has magic touch”
• ZDNet posted a background story on “How the ‘Milan’ table PC was born”.
• Even the New York Times got into it with multiple articles such as the one appropriately titled "Much Ado About Microsoft's Surface Computer"

Of course, such multi-user multi-touch screens are not new, nor are they something Microsoft invented, and Jeff Han is often cited for his excellent research and development of multi-person, multi-touch technology and interfaces. It is well worth as much time as you can to look over his site. Jeff has a popular demo, which you can see below:

And if you like that one, have a look at a similarly fascinating demo from Jeff that Fast Company posted called “Remapping the Universe”. Jeff has also recently started a company with the great name of  “Perceptive Pixel” to help commercialize and develop his work, so let’s hope we’ll be seeing much more of this technology move from the lab to our tables. Fast Company also has a very good in-depth interview with Jeff called "Can't Touch This" that is recommended reading.

When you check out some of the demos of Microsoft Surface, you’ll also notice some fascinating additional capabilities such as the ability to:

• Use some physical objects to perform tasks, such painting on the surface using a real paintbrush.
• Use gestures that are reasonably intuitive, such as the way you would normally work to rearrange things on a table (move them around, stack them), but with the added ability to shrink or expand them, or have them include movement, such as animations and video. If you’ve seen the movie Minority Report, you’ll have the basic idea, and the demos will show you more in a few minutes, so I’d recommend you watch them.
• Have physical objects “tagged” in several ways. For example, a “domino tag” can be attached or embedded into the physical objects, which are then recognized by the surface when you set them on it, and they can also communicate with the surface and computer to trigger further actions. This really starts to mix and mingle the physical “real world” with the digital virtual one. For example, you can read or recognize credit cards, loyalty cards, drink glasses, and paint brushes.

Initially, Microsoft Surface technology is planned for use in businesses and high traffic areas, such as airports, cafes, and restaurants, casinos, etc., and comes with initial pricing to match—estimated at about US$10,000. However, we can expect that this technology will follow the same inevitable and rapid reduction in cost as other technologies, and will see equally rapid increases in performance.

The upcoming Apple iPhone and the some of the new Tablet PC screens, such as the new IBM/Lenovo ThinkPad X60, also have multi-touch displays, and are designed for the mass market, so they will introduce more of us to this new type of interaction and interface.

Therefore, NOW is the time for us to prepare and think about how we could utilize this type of technology in the workplace, the home, and the classroom.

• Think about using it to interact with maps.
• Imagine every desktop surface in your meeting rooms and classrooms having this ability.
• Imagine walls that are huge multi-touch surfaces!
• Rather than a computer on every desk, what if every desk were a computer?

Add to this vision some other recent announcements, such as the new addition to Google Maps called “Street View”, which allows you to pick any spot on a map and get a fully immersive set of 3D images that you can control. Microsoft’s “Photosynth” technology takes a large collection of photos of a place or an object, analyzes them for similarities, and displays them in a reconstructed three-dimensional space. Imagine working with these on a tabletop surface that you, your friends, family, students and co-workers are sitting around and can now interact with, rearrange, zoom in on, and explore together.

I’m particularly interested in the area of human computer interaction, and specifically, bringing our human “action” (such as that of our hands) much closer to the action on the display. When you think about it, the gap is currently very wide, given our reliance on keyboards, mice, trackballs, and game pads. For this reason, I’m still a big fan of tablet PCs and believe they are still on track to hit a tipping point of popularity and ubiquity in the next few years.  As mentioned above, the new ThinkPad X60 tablet PC's have an optional multi-touch screen, so the trajectory continues to be clear to me.

With Microsoft Surface, our hands and our gestures are now right up against the display images, about as close as we’ve come so far to being one and the same. Next, we will break through the limitations of two-dimensional devices and begin to have three-dimensional representations and haptic (force) feedback so that we can feel the objects and models, and begin to sculpt “virtual clay” with our hands.

As additional dimensions and senses (such as smell, texture, time, locations, and sound) are added to this equation, the whole computer interface issue will increasingly fade and eventually become transparent.
Then we can focus on what we are doing and the results we are trying to achieve. We can use our abilities to visualize and express our ideas for others, to do “digital prototyping”, and experience things before they are “real”. Of course, ultimately we will continue to blur the distinction between what’s real and what’s virtual, and literally redefine what “real” even means.

So here is another set of examples where powerful new things are equal parts exciting and frightening. However as I like to point out, WE are the decision makers in all this, and it is up to us to make sure that the future that “surfaces” is one we really want and like!

w
a
yne
=====

High Resolution Imagery = High Definition Learning?

I am a HUGE fan of public radio, and I listen to it whenever I can. In the US, public radio comes in the form of National Public Radio (NPR) and most countries have a similar form, as well as access to Public Radio International (PRI). Typically these stations are broadcast just about everywhere, so as you’re driving, you can usually pick them up better than most other stations. I find their content to be one of the last sources of balanced and informative broadcasting.

The other day when I was driving in the US, I caught a news story on NPR about a fascinating new joint venture between Google and the United States Holocaust Memorial Museum (USHMM) called “Crisis in Darfur”. NPR is very good about posting their content, so you can read more about it and also listen to the original broadcast called “Google Sets Out to Map the Crisis in Darfur”.

If you are a regular reader here at Off Course – On Target, you will recall some previous posts, such as “Mashed up Maps for the Masses” and “Snowflakes Galore at TechFest 2007”, where we looked at ways that maps are benefiting from new technology and techniques that make them highly customized and extremely rich with information. This new initiative between Google and USHMM adds another dimension and is a provocative application of mapping and high-resolution photographic imagery.

Reuters covered this story at “Google to Map Atrocities in Darfur”. As Holocaust Museum director Sara Bloomfield put it:

"The 'Crisis in Darfur' is the first of the museum's 'Genocide Prevention Mapping Initiative' that is aimed at providing information on potential genocides early on in the hope that governments and others can act quickly to prevent them.”

I am interested in this not only for this specific situation but also as a chance to see if this form of “high definition learning” will be able to make more of a difference in moving people to action than previous efforts. Unfortunately, history has shown that simply making people aware of such atrocities has had almost no effect on stopping such acts.

This project will assemble photographs, high resolution satellite imagery, data, and eye witness testimony, and use Google Earth technology to make this accessible to over 200 million people around the world who have downloaded the Google Earth software*. They will be able to zoom in on high-resolution imagery to see the destroyed villages and other evidence of the destruction that, to date, the Sudanese government has denied exists.

* If you have not tried Google Earth or Microsoft’s Live Search (an implementation of their Virtual Earth technology) PLEASE do yourself and others around you a favor by trying it NOW! Google Earth does require a download, but this is truly one of those things you have to see and experience in order to believe and understand. Almost everyone I know who has done so has been completely amazed by its capabilities. And if it has been a while since you used it, you should try it as well, since new capabilities and more imagery and resolution is being added daily.

To check out the Darfur imagery, you just need to “fly” and “zoom” your way over to this region (a good lesson in itself for the many who never knew Darfur existed or where it was on the map). You’ll see how the project has put a colored border around the region to catch your attention. Zooming in from there and exploring the area is what this project is all about, so give it a try.

After these initial experiences, consider the profound impact that this readily available technology will have. We can expect to see a multiplier effect and an exponential increase in the volume of photographic data being produced by literally billions of lenses being aimed 24x7 at almost every place on earth.

Keep in mind that this mapping technology not only includes the photographic images steadily streaming out of orbiting satellites, but also the billions of photographs that individuals like you and me are taking. All of us can contribute images from our digital cameras via web galleries from the likes of Flickr, Google’s Picasa, Kodak EasyShare, SmugMug and hundreds of others. Putting this in the context of maps and using location as an underlying interface and structure is proving to be a VERY powerful way of connecting information and intellect— truly creating new knowledge and learning.

Of course, any powerful capability can be used for both good and bad purposes. However the point for us to remember is that the technology is “stupid” and can only be put to the uses and purposes that WE design and develop. So once again, we are both the problem and the solution. I am both hoping and asking that we make the right choice and take the action to ensure that this power is utilized and leveraged for very positive forward progress and benefits.

It remains to be seen if the “Crisis in Darfur” project and this new combination of content and technology will produce new levels of deep and behavior changing learning. But in my opinion, it is a great form of leadership by example. Let’s learn from this example and begin to design and develop other ways of putting this technology to use for increased effectiveness of learning and performance.

What other applications and projects can YOU think of for using this technology?

w
a
yne
=====