My Photo

Search

ClustrMaps

Where's Wayne?

June 23, 2008

Future Sources of Innovation, Discovery and Design?

Perhaps it is just a case of seeing what I want to, but I seem to be finding more and more evidence to support my long-term prediction that for the next few decades at least, we will find that one of the greatest sources of innovation, new ideas, and inspiration will be the developing regions of the world. This is due to:

  • The benefit of starting with a a clean slate and having no pre-existing infrastructures, customs, and behaviors to overcome.
  • The driving force of necessity, which, as the saying goes, is "the mother of invention".
  • The fact that creativity and innovative thinking lies within all 6.6 billion of us on the planet! 

Whatever the reasons though, I think we all have a great deal to learn and benefit from these often overlooked and unexpected sources.

Amazing Afrigadget (www.afrigadget.com)

The most recent example of one such fabulous source of innovation and invention is called Afrigadget. Thanks to Kelly Rupp, my champion at Autodesk, and Jeff Wilk at TenCue for the link.

I highly recommend you check out some of the fascinating postings on the AfriGadget site.  Some recent ones that I think you might find particularly worthwhile and interesting include:

  • An interview with Simon Mwacharo, an entrepreneur whose small business CraftSkills, is based in Nairobi, Kenya. His business focuses on designing and building self-sustaining renewable energy projects in places that do not have access to the electric grid.
  • dan_sheridan "Powering African Schools with Toys", which is the story of a young inventor, 23-year-old Daniel Sheridan, and his vision of how children playing on a school yard teeter-totter (seesaw) could supply significant amounts of electrical energy for the area.
  • A fascinating online overview with lots of great links to mobile phone solutions from another great resource, Jan Chipchase, who works for Nokia. As AfriGadget says, Jan “can best be described as a design and usability ethnographer. He explores the way mobile phones are used worldwide, and reports back to Nokia’s design team. He’s a fascinating person to talk to, and I thought I might highlight some of the stories he’s come up with while exploring in Africa.”
  • The Village Phone project (by Grameen Bank) happening in Uganda. Jan has taken an excellent picture and annotated it with the important facts about this project in a rural Uganda.

    Village Phone setup in rural Uganda

    For more information about Jan, read this recent NY Times article, and of course, you can subscribe to his blog, Future Perfect.

Well, you get the idea, this site is just full of inspiring stories of powerful, yet often very simple, solutions coming out of Africa. I highly recommend the AfriGadget site as a worthwhile place to spend some time during your next web surfing session.

Benefiting without Eliminating?

As I noted at the start of this posting, one of the key reasons why developing regions are such a rich source of ideas and innovation is that they lack the prior use, habits, and infrastructure that are present in the more developed parts of the world. As you check out the postings on AfriGadget , consider one of the ongoing questions I ponder about all this:

How we can find a way to reap the benefits of these new discoveries, inventions, and innovations, have them spread to everyone and everywhere who could benefit, and yet not interfere or negatively change or inhibit these sources? 

The value is partly that people in these regions have not been affected by our thinking, models, assumptions, etc., and so what concerns me is how do we tap into these sources without affecting and changing them?

100 Days and it’s gone?

Perhaps we can't avoid affecting and changing them. Maybe we just want to be sure to maximize the benefits and innovation coming from these sources. This situation might benefit from a tactic I’ve long practiced with new employees, staff, or team members who join an organization that I am part of. I make it a point to meet with these new arrivals, not only to welcome them, but to tell them that for the next 100 days, they have a unique and special value to offer. Because they are new and not indoctrinated, they will see things differently than those who have been with the organization for some time. They will have different assumptions, and they will suggest different solutions to problems. My choice of 100 days is relatively random, but in the several decades I’ve been doing this, it seems to be the amount of time it takes before their newness is lost, and with it this unique and transitory value.

Of course, I am also quick to point out that this is hardly the end of their value (let’s hope!), but rather that this is the moment in time when they have a unique value to offer.  My specific recommendations are to have them ask those '”dumb questions” quite loudly and proudly, since they often serve as the spark of new thinking that leads to a better solution. I recommend that those who are around these new arrivals tap into this special value and ask the newcomers for their opinions, their perspectives, and ideas.

More commonly, new people tend to be quiet, study the situation, and assume that they won’t have as much to offer until they get “up to speed” with the norms of the organization and thinking of others, but that approach misses out on a great opportunity.

Learning from the OLPC example?

A more direct example, that I’m still pondering, is the OLPC (One Laptop Per Child) project and similar efforts like:

  • The Classmate PC, a low-cost laptop by Intel
  • Digital Textbook, a South Korean project that intends to distribute tablet notebooks to elementary school students, and put computers in the hands of the masses in many developing regions. 

More specifically, I wonder whether OLPC's decision to offer only the new equipment, but no teacher training, set curriculum, guidelines, and “how to” type of information, was a “bug” or a feature?  In part, this was apparently a budget issue—no funds for such materials and programs—but as you might guess, I actually think that purposefully NOT providing this type of training and guidance will produce much more innovative uses and outcomes than if all the “experts” had provided their guidance, opinions, directions, and methods.

Les extremes se touche?

However, I believe there are ways to bridge these two extremes of providing no assistance and providing too much.  There are LOTS of parallels here to what makes for great teaching and great learning, and I’ll explore some of these themes later. But for now, sparked by the brilliant light shining out of these often overlooked sources of creativity, I want to focus our collective attention on them to see what we can learn from them, and how we might all benefit more.

I am not suggesting that these developing regions are the only sources of inspiration, innovation, and ideas, nor am I suggesting that as they become more successful, they will lose this wellspring of inspiration. Certainly human history shows otherwise.  No, I’m pondering this idea with you because I’m anxious that we pay attention to the characteristics of innovation and invention. I'd like to see us work to find more ways to increase exponentially the volume and diversity of inventions, innovation, and discovery to match this world of exponential change and its accompanying challenges that we are now living in.

I think about these questions ALOT, and so I’d like to develop them a bit further in a future post.  For now, I leave you to enjoy and benefit (I hope) from checking out Afrigadget and stimulating you to both look for more and send along some of your favorite sources of innovation, creativity, and invention, wherever they may be.

And as always I’m VERY interested in your perspectives and views. Does this match examples that you are seeing?  What are some of the best sources for innovation, invention, and ideas that you are aware of?  Think about your last "Aha!" moment, streak of creativity, or invention.  What were the conditions and the environment as this was happening?  See any common elements in these?  Or do you see any common elements that we want to avoid—those that stifle or reduce creativity?  I'm anxious to hear your comments, and I’ll be back shortly with more of my thoughts on increasing the volume and diversity of creativity in the world.

June 06, 2008

Cool Tools I Use: SPOT on!

I truly believe that every one of us (yes, that includes YOU!) has cool tools that we use on an everyday basis and stories about how we use these tools and how we came to find and use them.  I'd like to hear about yours.  Meanwhile, here's another one of mine:

SPOTThis SPOT messenger system is one of my newer "can't live without" tools and a "mashup" of hardware and software technologies, namely GPS, satellite-based communications, realtime mapping, and more.  It is also an example of the kind of "advanced" functionality that is quickly moving out of the hands of experts and high budget projects or pure luxury objects into the consumer mainstream. This is a trend we are seeing much more of these days, and is one I see escalating exponentially in the years ahead.

Look, look! See SPOT run!

SPOT is a great example of the power of simple purpose combined with simple design.  It essentially does ONE thing very well: tells anyone you choose to know precisely where it (and you!) is on the planet with the push of a single button. It uses GPS to precisely calculate where it is when you push the "check" button, and transmits the latitude and longitude coordinates via the worldwide (almost) GlobalStar to a list of people (text message or e-mail) that you give it and to a website-based map. 

It costs less than US$150 along with an annual subscription of about $90. For people like myself who are regularly in very remote and varied locations, and involved in possibly life-threatening or risky situations, this is a no-brainer purchase.

Simply Great!

Simplicity is one of the things that makes this such a marvel for me and why it's made my list of Cool Tools to share with you. Designing for simplicity is in fact very difficult, and it seems a bit of a lost art these days, although it one I believe and hope is making a comeback.

The SPOT device itself is relatively small (about the size of slightly rotund older cell phone), and while I sometimes wish it were smaller, I must admit that I lose smaller things much more easily, and this device is not cumbersome. But if you were wearing it on your belt or carrying in your purse, it would be nice if it were smaller. I suspect that the size is mostly due to the lithium battery (replaceable), which is probably more suitable for safety in high risk safety situations.  It need to be very dependable and must last for a long time (years vs. days or weeks). Getting a "sorry low battery" warning is NOT something you want to see if you are using this.

Continuing with the simplicity theme... there are no wires, no plug-ins, no attachments, no protrusions (such as antenna), and it has a VERY simple interface consisting of only four buttons: on/off, OK (CheckIn), 911, and HELP, with a red/green indicator light for each one. 

How Do I Use It?

If you think you or others you know and love might have a good use for this device, you can read more on the SPOT website,  but here is the quick overview to help you see just why I think this is such a Cool Tool for me and perhaps for you.

SPOT has two primary functions that I use on a regular basis

Check in:  When I push the "Check In" button on SPOT it sends a short message with my exact latitude and longitude information via satellite to a list of people I have provided. Being satellite-based means this will go out independent of any phone or radio systems anywhere on the planet.*  It can take up to about 2 minutes for the message to go out via satellite, BUT it will go out as long as it has a clear view of the sky, which can be through windows, but not through steel or other physical obstructions.  Of course, this is not a major limitation, since its primary use is for outdoor activities. However, I've had it work well even inside buildings as long as it is placed in an outside-facing window.

*  This is not completely true as SPOT uses the GlobalStar satelite system and they do not quite have true planetary coverage, since there is a "hole" over the Pacific ocean.  Other than for those living in such remote locations and blue water sailing types such as myself, this is not much of a problem and will hopefully be resolved later this year or next when and if GlobalStar adds another satellite to their system.

These messages include both a short bit of pre-set text I can provide such as "Hi, this is Wayne reporting to you with my current location" and the lat/long coordinates at the time I pressed the button.  As part of the setup, I go the website and put in the mobile phone numbers (for text messages) or the e-mail addresses of the people I want to receive these messages. Thereafter, every time I press the CheckIn button, all of these people get this short message with my updated location. Simple, handy, powerful.

Having used this for the past few months while I've been out sailing, I've also come to appreciate that this lets everyone who cares not only know where I am, but also that I'm OK since I have had to consciously press the CheckIn button.

SPOT_howitworks_trackprogress_map2Track Progress:  The SPOT also has an automated position reporting option that they call "SPOTcasting" and I use this a great deal. When it's turned on (by simply holding down the  CheckIn button for 5 seconds), SPOT automatically transmits my lat/long coordinates every 10 minutes for the next 24 hours to a web server. 

 

SPOT_hot_cPanbo_smallOf course, it would be rather obnoxious to have these going to people's mobile phones or e-mail inboxes, so instead, these "SPOTcasting" messages are just stored on a server and are accessible to me as either a historical log, or as a set of points displayed on a map that I can share with anyone.  Initially, I could only provide access to people by giving them my login information and password for the site, but a few weeks ago they finally added my #1 wishlist request, which is the ability to create and share a web page that displays all my check and track points "live" on an interactive map like this. By combining or "mashing up" an interactive online map (Google maps) with a feed of my check points and/or track points as they are broadcast from my SPOT via satellite messages to this server page, I am able to provide access to the complete history of my travels and my current or last location to anyone with a browser.

* I do my best to practice the experiential learning I'm so often expound on here, and real-world use is one of the key requirements and values I have for these Cool Tool posts. If you're interested in a real world example of the use of SPOT type technology ,you can follow this link to my personal travels of late.  I'm writing this on June-4-2008 at about 14:07 UTC so I'll let you figure out where I was at that time. 

Emergency use:

Fortunately I have not had to use either of these yet, but SPOT has two more buttons for emergency use:

Ask for Help:  I would press this one for non-life-threatening siuations. It is diffferent from the CheckIn message because it sends out a pre-programmed message to my contact list, telling them I need assistance and giving them my location data and a link to it on Google Maps.

Alert 9-1-1:  This, as you might expect, is for life-threatening situations, and it's the one you hope you never need!  When pressed, this sends an alert to the Emergency Reponse Center and sends a distress signal. the appropriate responders at that location, such as police, Coast guard, country's embassy or consulate or other emergency response or search-and-rescue teams.  It also notifies my emergency contact person(s), which I have provided when I initially set up the device.

And that's it!  Simple, easy, powerful.  The SPOT is not for everyone, but this is part of what I had in mind for these Cool Tool posts—not a Top Ten list of what is most popular (there are lots of these for you already), and not just something shiny and new, but something very useful and valuable for the right person at the right time in the right context. We (both individually and as groups) are unique "snowflakes", as are our situations, and so these Cool Tools are aimed at helping all of us discover things that will match our unique needs or the needs of those around us, and share a part of the overall Snowflake Effect, which my great colleague Erik Duval speaks of and write about so often.

Hope this SPOT satellite messenger is of value and interest to you.

***********

Have  "Cool Tools" you use and want to share?  Send me your favorites with the following information:

  • Name of the tool and source for getting one. 
  • What does it do? 
  • How did you come to discover this? 
  • How do you use it? 
  • Why is it on your top ten "Cool Tools I Use" list?

May 30, 2008

Cool Tools I Use: Digital Pen and Paper

I truly believe that every one of us (yes, that includes YOU!) has cool tools that we use on an everyday basis and stories about how we use these tools and how we came to find and use them.  I'd like to hear about yours.  Meanwhile, here's another one of mine:

anoto pen This tool is one of those great examples where the very best attributes of the past can be updated with the advantages of today's technology. In this case, it's by combining good old pen and paper with digital technology.

I use Logitech's io2 and have been using it for over 5 years, pretty much nonstop.  Anoto paperIt does require that you use special "digital paper" but it comes in a good variety of sizes, pads, sticky notes etc., and they don't cost much more than regular paper and last a long time. The paper itself is very interesting and uses technology licensed from Anoto, one of the first companies to really break through with this type of digital paper, and is licensed by many makers of digital pen and paper. The Anoto-based paper works by having a very fine almost invisible set of little "dots" on each page.  Each of these dots has a unique identifier and so as you write on the paper with the pen, a sensor in the top of the pen keeps track of which dots you are passing over, so it knows exactly what your pen movement and motions have been and stores this digitally.  Then every time you insert the pen in its small pen holder base that hooks to your computer via USB, the software creates a full digital image of everything you've written or drawn on the paper. Think of it as digital carbon paper (if you're old enough to remember!)

logitechio2_thumb1_thumb[1]Sounds complex, but the beauty is that you just have a very plain looking "regular" note pad and a slightly larger than normal pen that you use exactly as you would any other pen and pad. However, now you get a complete digital copy and backup of every page, which is not only handy, but also enables you to send your pages of notes and diagrams to others.

You also have the option of converting your handwriting to digital text by doing some "training" to recognize your personal style of writing, and this is working better with each release. I don't tend to use this feature too often, since my purpose is to have a visual archive and I'm the only one who needs to read it. Good thing, since I'm often the only one who can!

The Logitech/Anoto paper I use also has a bit of "smarts" to it, so you can use areas on each page set aside to automatically create, for example,  a calendar item or an e-mail.  Or you can take other specific actions based on the notes you take. This is extremely handy, and it can be setup to take these actions automatically every time you put the pen into its cradle and upload the contents to your PC.

This same technology has also been used to create some other fun and interesting devices such as the "Fly" pen from Leapfrog.  This cool tool let's you do things like write a word in one language, and then hear it translated into another language through the speaker inside the pen. You can also literally draw a small calculator on the paper, and then start using it as a fully functional calculator!

Of course, what I'm really waiting for is truly digital paper and paint, where we have surfaces that are digital displays with resolution at the molecular level, but I'll save that for another posting and hopefully it will be a Cool Tool I'm using in the next year or two!  In the meantime, consider trying out the currently available digital pen and paper to help you preserve and share your notes and diagrams.

***********

Have  "Cool Tools" you use and want to share?  Send me your favorites with the following information:

  • Name of the tool and source for getting one. 
  • What does it do? 
  • How did you come to discover this? 
  • How do you use it? 
  • Why is it on your top ten "Cool Tools I Use" list?

April 21, 2008

Cool Tools We Use

cool tools Over the years, many people have asked about some of the "cool tools" I use to do some of the things I do, which range from presentations to podcasts, welding to woodworking, and sailing to speaking. 

In one such discussion a few months ago, long-time colleague Tom King, who now also works with Elliott Masie and the Masie Center as a "Masie Fellow", sent me the following note:

"I'm fascinated by some of the nifty tools I discover one way or another through contact with you. Things like doodle.ch or SlideShare or however the heck you get transcriptions of your podcasts. A totally separate and intriguing topic is how you quickly create such compelling, lengthy, thoughtful posts, podcasts & presentations. I've already seen quite a preso on "Whole New Mind" from you."

"Moving back to nifty tools....I think the interesting idea here is how these tools are discovered and shared-- and what makes them good. That process of discovery & recognition seems to be the long-term value, even if any given "nifty tool" has a place that is only ephemeral in the Internet-time mid-term time phase."

And he went on to say:

"For what it's worth, I think the best tools develop when the tool will "scratch an itch" for their very own developer... or someone near & dear to them. Likewise, I think the best recommendations for a tool comes from someone who uses it, and the second best source is a recommendation from someone who has a trusted/respected source that uses a tool. If the user is passionate enough to convey the value to that second party (who may not even use such a tool), and then recommends it to me.. well sometimes I find that is actually the best recommendation."

Couldn't agree more with your observations, Tom !  I too find great value in discovering such tools, tips, and tricks from you and others. 

Tom being Tom, he had already started to post some of his favorite tools, tips, and tricks on his blog Mobilemind (highly recommended BTW), and you can check out his lists of favorite Web Solutions and his favorite applications from earlier this year.

Cool Tools Kevin Uses:

Of course this is not a new idea. Another of my favorite people, Kevin Kelly over at Wired magazine, has has been doing a phenomenal job of covering a similar idea on his site Cool Tools.  His description is right on target for me:

"Cool tools really work. A cool tool can be any book, gadget, software, video, map, hardware, material, or web site that is tried and true. All reviews on this site are written by readers who have actually used the tool and others like it. Items can be either old or new as long as they are wonderful. We only post things we like and ignore the rest. Suggestions for tools much better than what is recommended here are always wanted."

Even Dads can be Cool!

And then there is the totally cool offshoot that sprang up a bit later by Chris Anderson at Wired magazine called Geek Dad.  Check it out, no matter what your gender or status. 

So Many Tools, So Little Time

But what about the rest of us?  I truly believe that every one of us (yes, that includes YOU!) has cool tools that we use on an every day basis.  Even more valuable are cool stories about how we use these tools and how we came to find and use them.  How many of the cool tools that you use did you discover by seeing someone else use them?  Many, I suspect, but the problem is that as great as such serendipitous discovery is, it doesn't seem to scale very well. Considering that there are about to be 6.6 billion of us populating this planet, I think we may all have a few more to discover!

Later on in my discussion with Tom, I noted that I too am fascinated by the process of discovery, and I often point out that discovery is the opposite of invention—that discovery is the finding of something that already exists—whereas invention is the creation of something that never existed before (though most often consists of new combinations of previously existing ideas or things).  My point is to emphasize the differences and the power of going after both. I’m equally intrigued by the differences between invention and innovation, but I’ll stop myself from digressing (lucky you!) yet again. I merely want to emphasize how strongly I agree with Tom's larger point which is the value of the process of discovery and sharing.

So, thanks to Tom for the push. I'd like to see what we can do here on OCOT and as a group to explore and discover more Cool Tools. For starters, here are some quick thoughts from me and questions for all of YOU:

  • Is this a topic that you would find to be of high value?
  • Would YOU consider contributing one or more of your top cool tools and stories of how you discovered it, use it, etc.?
  • Would this topic be well served by having a longer term “theme” or space on OCOT that is dedicated to “cool tools I use”? Or would one or two blog posts suffice?
  • Might we be able to create a template that would help people describe their cool tools and stories, and make it easier for others to discover and use them? 
  • Would a wiki-like capability work best for this, so that any given tool or technique could be expanded over time, so that other could add their examples of how they use the same tool differently, provide additional techniques or suggestions for getting more out of them, and add their own stories about how they came to discover the tool?
  • Might “Cool Tools I Use” be a big enough topic to deserve its own “space” (section of a site, whole blog/wiki itself, etc.)?  For example, this could be a really eclectic mix of tools, where we are looking to discover them in any and all applications, walks of life, etc.

Please send in your comments or e-mails to let me know your thoughts on these questions.

Serious Fun, so let's make this a game!

In many cases we cease to consciously think about these tools. We use them so frequently and for so long that they are part of our "unconscious competency".  To "discover" them again, you may need to start noticing them again. 

So let's turn this exercise into a version of a once popular game based on the premise "If you could only take 10 things with you to live on a remote island for 10 years (randomly picked numbers), what would those be?"  And in the spirit of a game, let's not get too literal with this. Let's imagine that our basic needs for survival are met and focus instead on those things we could otherwise not live without.  In most cases, we probably could live without these, we just don't want to!

And let's really do some coloring outside the lines with this theme and not restrict ourselves to computers or the net!  I could imagine collecting “cool tool” ideas for anything from cooking to car repair to computers or canoeing (today’s post is brought to you by the letter C!).

Let's get Started!

In the interim, I thought I'd get things started by creating a "Cool Tools I Use" theme here on OCOT and use this to collect and share some of the cool tools each of us have found invaluable and to also share, perhaps even more importantly, the ways we found them or how they found us.  What I'll do on OCOT to help with this effort is create a metadata tag called "Cool Tools" and make sure all "Cool Tools" entries are marked with this tag so you can find them easily in the future.

Oh, and just for clarity, let's be clear that this is NOT to be used for nor does it represent ANY endorsement of promotion of a company or a specific product. These are authentic stories about "Cool Tools" that we use all the time and would not want to be without.

Should be fun, and if not, we won't do it! 

Now it's YOUR turn!

OK, that should be more than enough to give you an idea of what I'm thinking about.  Now it is YOUR turn to think about the "Cool Tools" you use and would never want to be without.  Send me your responses to my previous questions and we'll follow through accordingly.

Meanwhile, have a "Cool Tool" you use and want to share?  Send me your favorites with the following information and I'll start collecting and publishing yours and more of mine.

  • Name of the tool and source for getting one.
  • What does it do?
  • How did you come to discover this?
  • How do you use it?
  • Why is it on your top ten "Cool Tools I Use" list?

I'm sure EACH of you have a list of tools you would not want to be without, and you probably have tools you know that are much better than the ones I have on my list. I can't wait to start to learning and benefiting from your cool tools!

w
a
yne
=====

December 13, 2007

Serious Play: Are We Humans the Biggest Computer of All?

Would you be interested in a future where the pursuit of fun and enjoyment was one our our major roles in life because it leads to solving extraordinarily large and complex world problems? For example, what if all of us helped to digitize all the content contained in all the books in the world? Almost none of this content is currently available on the Web or in any digital form and as such, is largely inaccessible to most. And would you be interested in a world where the relationship between computers and humans is a very positive and symbiotic one? I know I would. 

I'd like to bring your attention to some of the ways in which this is already happening. Let's see if this excites you so much that you'd like to not only participate in some of these processes, but also start to use some of these models to help solve some of the problems you and your profession or areas of interest face.

In my previous posting "Moving aLOM", I mentioned some of the exciting, yet daunting, challenges of the future of metadata, such as how to create, in staggering volume, some of the more "subjective" metadata—things like the infinite characteristics that describe people, places, and things—where we humans are still the only source. This effort would include things like creating metadata for all the images and videos out there—still a largely unsolved problem—the absence of which not only makes them very hard to find, but also makes the Web and computers very inaccessible to the visually impaired, which, with age, might include a lot of us!

The Exciting Work of Luis von Ahn

Luis von Ahn   Manuel Perhaps most notable in this area is a relatively young new professor at Carnegie Mellon University, Luis von Ahn, standing at right in this photo with his PhD advisor Manuel Blum. Luis has already completed some amazing work on what he refers to as "human computation" and how to put "wasted" human cycles to use in solving problems a computer cannot solve at this point in time, but humans can solve easily. Luis also picks up on a theme we have discussed here on Off Course - On Target in many other contexts—the power of the "network effect" achieved by connecting everything and every one together. Human computation is obviously focused on the latter, and Luis wants us to consider having all of our brains connected together as an extremely advanced large-scale distributive processing unit. Not to worry, no wires or direct connections to your head are required!

Before I go any further, and especially if you are more of a visual and auditory learner, let me recommend that you immediately watch this talk called "Human Computation" that Luis gave on July 26, 2006, about the power of human cycles. This 51-minute talk is part of the Google Video Text Talk series (also highly recommended), and while it is long by some current standards, I feel very comfortable recommending this to you, since I'm convinced you'll agree it was a VERY good use of your time (actually Luis' talk only runs 40 minutes, and is followed by about 10 minutes of a good Q&A session).

Another excellent reference for you, which contains more fascinating details and examples of von Ahn's work, can be found in Clive Thompson's article "For Certain Tasks, the Cortex Still Beats the CPU"  in the June 2007 edition of Wired magazine.

Games with a Purpose

But for those who don't have the time right now to look at these things more, here is a quick synthesis of what I find so exciting and interesting about the innovative use of our human "compute cycles", and the use of "fun and games" for very significant and "serious" results. What von Ahn likes to call "games with a purpose".

captcha One of the most common and effective examples of this type of human computation is one of Luis' first applications, which is known as "Captcha". The name may be new to you, but I'm sure you're already a veteran Captcha expert! Captchas are those slightly difficult to make out words that you are asked to identify and type into a box when you are signing up for web sites. Captchas are used for responses online and in other situations where we want to prevent automated "bots" from generating unending amounts of "spam" or other undesirable exploitations of such online experiences. The problem is how to differentiate between a human response and a computer response, and Captchas are a simple solution to this problem, as well as a simple example of a problem that computers can't solve by themselves.

captcha scanning

In itself, this doesn't sound like that interesting of a problem, although certainly it is an annoying one! However, part of what I would see as Luis' brilliance is in the more primary problems he is solving with this process.

In the case of Captcha, the real problem being solved pertains to my initial reference about the challenge of digitizing all the content of the world's printed matter, such as books. For more background on this digitizing and scanning challenge, you may want to refer to my previous posting from Jan 2007 "Books—the NEW old medium". Specifically, the problem is with all the words found in printed matter that scanning and conversion technology cannot make out, because the medium has a crease running through it, or it is partly missing, or other factors which make it impossible for the technology to recognize the words correctly.  Yet, show these words to almost any one of us and we can easily recognize the word.

So all those "fuzzy" words in Captchas are NOT just some random words that are blurred to fool a computer. Instead, these are the images of words which scanning technology has failed to recognize correctly! Luis refers to this specific application as ReCaptcha and you'll find much more information there, as well as instructions and free plugins for you to embed within your own sites, blogs, etc.

And that's just one side of why Luis von Ahn was awarded one of the MacArthur "Genius" awards and a Microsoft Research grant, for he has also managed to put these types of solutions into a game format that starts to look at solving these kinds of problems at a scale that is truly breathtaking! 

Solving World Problems or Playing Solitaire?

In his talks, Luis likes to use a very compelling metric of human-hours, and he often compares statistics on the the amount of human-hours that are "wasted", in his opinion, doing something like playing Solitaire on a computer. I too have always been amazed at the number of people I observe when walking down the aisles of an airplane, for example, who are hard at "work" playing Solitaire, but I had no idea just how much time is spent on this. According to the statistics that Luis uses, over 9 billion human-hours were expended playing Solitaire in 2003 alone! Better yet, he puts this into perspective by comparing this activity to such things as:

  • The building of the New York City Empire State building, which consumed about 7 million human-hours, and thus equates to just 6.8 hours of collective Solitaire playing.
  • Building the entire Panama Canal, which took 20 million human-hours and amounts to less than a day of collective solitaire playing!

Metadata for All Images?

image Now imagine if we were able to put this kind of "human computation" to more effective use AND still do so within the format of games that people can enjoy doing themselves! One example is another one of Luis' creations, and one that has been running with staggering results for over three years called the ESP Game. As we've discussed many times, experiential "learning by doing" is often one of the best ways to learn about something new, so I'd encourage you to not only read about the ESP Game on that site, but to play it for awhile. (Caution: can be very addictive and time consuming!) When you do, you'll see how it puts two or more players (there is also a single player version) into a friendly competition by typing in descriptive words for a given photo (that metadata thing again), and they get points whenever they both type in the same word.

So what? While progress is being made in image recognition technology, this is still largely a problem that computers cannot do. And ask yourself, do YOU take the time to "tag" or create all the metadata for the photos and videos that YOU post, such as who and what is in the photo? Didn't think so. Yet by using this type of game format, the ESP Game has been running for over three years with no drop off in popularity and as of mid-2006, it was very fast, very cheap, and very accurate. If this were done as a popular online game site, it would be possible to label all the images on Google Image Search in just a few weeks! No surprise then that the ESP Game has already been licensed by Google in the form of the Google Image Labeler, and is used to improve the accuracy of the Google Image Search. We humans are relatively competitive animals and we like to do what we enjoy, so this approach appears to have a lot of promise.

Yes, but WHERE is that object in the photo?

Another problem that is even more challenging than identifying WHAT objects are in the image is identifying WHERE they are in the image. To do this, Luis has created another game called "PeekaBoom". The first player sees an image along with a word that describes an object within the image, and then clicks on the image where the named object is located. The second player sees only the object that the first player clicked on and types the word associated to that object. Once the second player guesses the correct word, the two players move on to the next image and switch roles. More details are explained in the video (you really should take the time to watch it!).

Human Computer Relations: Parasitic or Symbiotic?

Luis also notes how this transforms the current relationship between humans and computers from what he calls a parasitic relationship to a symbiotic one where:

"...humans solve some problems, computers solve others, and together we work to create a better world."

Sound far fetched? Well, in the less than two years that his limited experiment of the ESP Game has run, over 75,000 players have come up with over 15 million "agreements" (matched words). This rate would indicate that 5,000 players playing simultaneously could label all images on Google Images in about two months. Think about that...5,000 is NOT a very big number when you consider the numbers on many gaming sites. Therefore, it should be possible to label all the images on the Web in a few months. Again, I strongly recommend that you check out the video to get not only more details, but to see just how accurate, pragmatic, and promising this approach is. 

For example, it turns out that the results of a game such as PeekaBoom can in turn be used to help train computers to recognize objects and their location. Turns out that one of the reasons that computers are not yet very good at this type of object recognition and automated metadata generation is that there is very little data and examples to use to "train" the computers on how to do it. By capturing the results of all the human play in location identification of objects within images, this data can then be used to train computers to do the same thing"—allowing us move on to new challenges... and more fun.

Super Side Effects

I think you'll agree that this approach not only shows great promise in terms of solving some very large scale problems, but has some surprising and equally amazing "side effects", like how some people have used this to help them learn a language. This approach has spawned its own game called Babble, where two English-speaking players are shown a sentence in a foreign language that neither of them speak, and are presented with a list of possible meanings (in English) below each word. Players try to agree upon a set of English words that forms the most coherent sentence. The result is that this activity is surprisingly effective in translating foreign text into English without requiring anyone fluent in both languages. Think of the possibilities of this running at a larger scale!

Another "side effect" of this approach is how many players have noted that they end up finding other people who think very much like them, and thus they have a great sense of "intimacy" and closeness with their counterparts who play these games. Therefore, many  ask if they can find out who their anonymous competitors are to continue the conversation. At this point in time, all the game players are anonymous and no identities are revealed, but one could imagine this being used as a way to help discover other people "like you"—ones you'd want to meet and get to know better.

Common Sense Isn't that Common; yet!

And lastly from von Ahn's work, check out his new game Verbosity, which helps to generate what he calls "common sense facts" (again just more metadata really). One player is given a word and the other tries to guess what it is by completing fill-in-the-blank-type templates, such as "It is a type of ____" or "It contains ___".  The player who entered the original word can answer "true" or "false", but can't use the word itself. All this is very much like some party games that many of you have probably played, but the important difference here goes back to the original point of the summative network effect and how this can all be put to greater use. In the example that Luis shows in his presentation, the word "milk" would have some common sense facts such as;

  • It is white
  • It is a liquid
  • It is often used to eat cereal
  • It has lactose

Again, computers can not currently solve this kind of problem, and it is another an example of the need for massive amounts of metadata. Imagine if we started generating massive volumes of these "common sense facts" and they were readily available to all. 

More Competition = Less Carbon?

carbonRally_270x265 Lest you should think this is just a "one man show" from Luis von Ahn, I want to point out that there are many others who have been developing, adopting, and adapting similar models. For example, "Carbonrally: Carbon Challenge", which you can learn more about from the Nov. 20th, 2007 Webware post "Carbonrally: My carbon footprint's smaller than yours" by Martin LaMonica, is an application that is showing some great promise for improving the reduction in greenhouse gas emissions or the "carbon footprint" of individuals and organizations alike. Carbonrally adds the dimension of some fun and healthy competition to do better than others. As Martin describes it, Carbonrally is "tapping into people's tribal competitive spirit".

Whew!  That's quite an introduction to what I believe is both a powerful and profound pattern emerging—where the natural pursuit of fun, healthy competition, and challenges are combined into a game-based model that has already shown some of the ways we can solve large-scale present and future problems. It also creates a whole new relationship between us and technology. This model is not only interesting and fun, but it is a fascinating example of "user generated metadata", which I mentioned in my previous "Moving aLOM" posting.

Your Turn to Play!

Besides raising your awareness about "human computation" and the power of this approach, I also want to encourage all of us to put more time and energy into figuring out how we can inject more fun into work and other problem-solving situations. As you do so, I think you'll see an important job or task or problem  can be more fun if it's solved with some kind of game play, and where the solution remains very much a human one.

We can not, for now at least, expect computers to come up with such fun and game-based solutions by themselves! 

For starters, if you have websites or other applications where you have problems preventing spam or other misuses, consider taking advantage of some of the freely available plugins and nullities, such as those from the ReCaptcha site. Longer term though, please put some thought into which problems you could address with this model, and the ways you could do so by injecting the fun and challenge of a game-based approach into the more serious problems you need to solve...then share them with us here at Off Course - On Target.

I'm reminded of the great quote from Brian Suton-Smith who said:

"The opposite of play is not work; its depression!"

And I look forward to hearing all the innovative and creative ways you will come up with to solve problems—large and small—and replace depression with play. Have fun!

November 20, 2007

Visualization Finally Coming to Interfaces Near You

I hope you've had a chance to check out the previous posting on "Musical Snowflakes" and try out Slacker and the just released Social.fm as examples of mass personalization and the Snowflake Effect in the world of music. If not, or if you didn't notice at the time, when you do try out Social.fm, you can experiment with the new visualization interface model that is becoming more popular, and which is in some Apple applications, such as iTunes and the new Mac OS, Leopard, where it is known as "Cover Flow".

As effective as it is simple, this technology restores the ability to flip through a stack of papers or albums and quickly stop at the one you are looking for or one that catches your eye. You'll quickly understand it after a few seconds on the Social.fm site.  You can also run this short video about Cover Flow. 

CAUTION:  Severe risk of time loss ahead!

YouTube has also started to include a version of this visual "flip through" interface. After you've watched a video clip such as the one above, you get a horizontal band of other related videos along the bottom that you can flip through with your cursor, see some of the underlying metadata about the one you are hovering over, and then watch it with a click. Very slick!  It's not only visually appealing, but it simply works well. And because the videos you are flipping through are all related to the one you just watched, see if you don't find yourself discovering many other unexpected things as you watch more and more. 

It is quite amazing how much you do discover and learn in the process. Tying this example back to music...if you have not already done so, try using YouTube itself as a music discovery site. I think you'll be amazed at how much new music and artists you discover.

Right now, these are very simple implementations of visual interfaces, but they are examples of the continuing rise of visualization that is much needed within our human computer interactions. It's time to start planning for how you will take advantage of such visual interfaces as they become more commonly available for use with any kind of content within any application and on any OS. And imagine that the visuals will start to contain more information and have greater dynamic relationships between each item that you can see. An early example of this type of interface is shown in the Visual Thesaurus, demonstrated in the short video clip below.

While you ponder all these new developments from the music world, keep in mind that music is simply one area we can look to for inspiration and examples that we can adopt and apply to our own context.  While I believe that most everyone likes music, and will find value in these kinds of services, the real benefits (and the reason for my highlighting these music examples) are to encourage their adoption in other wildly divergent ways. 

These examples help us find and listen to music that is highly personalized to be "just right" for us. Now imagine having these same kinds of Snowflake Effect capabilities that help you find "just the right" content of any kind—from text to images to video and audio. What uses can YOU imagine?  How will YOU use these as they become more and more prevalent and available?

Be sure to share your thoughts and experiences with the rest of us. I look forward to hearing from you.

November 15, 2007

Musical Snowflakes Continue to Fall All Around Us

The world of music continues to be one of the richest sources of examples for the Snowflake Effect, where mass personalization, mass customization, mass contribution are all available to try.

The list of examples continues to grow exponentially.  A "Do It Yourself/ Build Your Own" model calls for a radical redesign, and this is what most products and services will need to adopt if they expect to survive in the future.

If you haven't tried using this aspect of mass personalization in the music services area, I'd recommend you check out the "Social Music Overview" page from TechCrunch for a list of options and a brief overview of each. Then, to best understand and evaluate the experience and the potential, you really need to try it yourself. 

See if you think that there is no turning back now. The genie is out of the bottle and there is no putting it back!  The vector of mass personalization and the Snowflake Effect is inevitable and will become the expectation that we have for most products and services, because we now know it is possible—a great thing from my perspective. But let me know your reactions and experiences as well.

Right now though, I'd like to bring a few of the newer developments and advancements from the world of music to your attention. 

Slacker isn't!

My first example is Slacker, and contrary to its name (in many cultures the word "slacker" refers to someone who does not try or work very hard), this site is a real winner. It's currently my top pick for the Snowflake Effect as its applied to music. 

slackerplayerYou'll find a good overview of Slacker in this PC Mag review. On TechCrunch, you'll see that the founders of Slacker (each of whom is an online music veteran) have very big ambitions indeed.  In addition to their Web-based music service, which will compete with others such as Pandora, MOG, and Last.FM, Slacker is about to release (Dec 2007) a new portable player, which is reviewed here and is pictured on the left. This new portable player is WiFi-enabled, so you can have music streamed right to it, and synch it with your desktop and music collection. They have also announced a satellite car kit so you can have this music wherever you are. 

One notable addition over most other music personalization services is that the desktop version of Slacker (Windows only for now unfortunately) enables you to incorporate your own music library in the mix. What most impressed me, however, was the well designed interface that enables new degrees of personalization.  I'm referring to the overall human computer interface, not just the way it looks. 

Slacker is impressive and a significant improvement over other services. You can do as much or as little customization as you like quickly and easily. And no matter where you leave off in this customization, Slacker works to the maximum degree possible.

For example, my former favorite, Pandora, requires that you provide constant feedback by indicating that you like or don't like each song. If you stop providing this feedback, then it stops playing after an hour or two. This is all very understandable since it can't continue to improve without some additional input, so it knows if the music is continuing to be just right for you at just that time or not. However, most of us are unwilling or unable to constantly provide this feedback for every song while it is playing—at least not by the current norm of manually clicking a thumbs up or thumbs down button or a 1-5 star rating.  This method is too interruptive on a continuous basis. 

Slacker, in contrast to all the others I know, is set up to do the best it can with however much feedback you give it. Obviously the more you give, the more you get. However, that Slacker will continue to work very hard at playing music that is as personalized as possible to the information you've given it is a huge improvement.

slacker fine tune

I'm very big on the "discovery factor" of this kind of personalization, and this is another big plus of Slacker, which is why I'm using this as my current best example. As you use the Slacker interface to personalize the music, you are constantly exposed to more and more alternatives. Yet this does not overwhelm you with too much choice, because you can take it or leave it. Again, Slacker maximizes as much feedback as you've given it and keeps on playing great personalized music.  One particularly valuable new function is the ability for you to set the "discoverability" factor to any degree you like.  This is nicely summarized in the PC Mag review:

"To tweak your listening experience further, Slacker provides four ingenious fine-tuning options. Artist Discovery lets you control how much variety you'll get beyond the chosen artists (a lot, a little, or none at all), and Popularity determines whether you get "fringe" song selections, "hits," or something in between. The Favorites tool determines how often the selected station plays those songs you've tagged as favorites. Finally, there's Year, which narrows the selection to Classic, Older, Recent, or Current. (You can leave all these options set to Auto if you'd rather not get so specific.) Neither Last.fm nor Pandora offer anywhere near this kind of fine-tuning; the most you can do is vote yea or nay on the current song selection (which you can do in Slacker as well)."

Social.FM

Social-fm-inaction Want more examples of the richness of the music world?  Check out the just released Social.fm, which is (as you might guess) a widget designed for  music sharing within social networks, such as FaceBook. Read the Nov. 12th Webware review "Social.fm rolls out fancy looking Facebook app, DIY widgets for everyone else" for a good overview of this new service. In addition to a nicely integrated FaceBook version, Social.fm has also announced that they are working on integrating better with with Google's OpenSocial initiativeThis is worth keeping an eye on IF and as OpenSocial creates a standard that enables interoperability for widgets across all applications and OS.  This is still a long way off and somewhat of a long shot, but it's very much worth rooting for and following up on.

Social.fm's announcement of Social.fm Mobile is also great example of convergence. This technology turns your smartphone into a music player for everything from your own music collection to digital radio and podcasts,

So, are you Off Course from your usual thinking, and where you are looking?  Most likely. But On Target? Even more likely!  Enjoy your experiential learning and I'll be back soon with more.

November 11, 2007

The Lego of Gadgets

SMAW_welding_af_ncsHow could I not like Rafe Neeleman's recent posting on Webware called "Bug Labs: The Lego of Gadgets"?!  Here's so many of my favorite themes all wrapped into one: Lego block modularity, mashups, gadgets and the whole DIY ethic (Do It Yourself). 

OK, I confess to having a severe gadget addiction that dates back to my early youth in an earlier era where it manifested as hot rods, restoring antique cars, woodworking, metalworking, sewing, and other pursuits. The DIY gene is very dominant in me (along with just being plain cheap). A friend and I were just discussing this idea this past weekend, when it worked out "cheaper" to go buy a new MIG welder and some other tools to build some custom stainless steel brackets that were going to cost too much to have made by a local shop:

DIY labor = less $$ + new toys tools

What's not to love about that formula?

If you have any similar tendencies, do take the time to check out the Bug Labs site. It appears to be the work of a very passionate group—my favorite kind of people! On their new web site, their stated inspiration is:

There are so many great gadget ideas that haven't been thought of yet. With BUG, we want to unlock and inspire the discovery and creation of as many of these devices as possible.

BUG_BaseUnit_hiroP_medRight now, they have a "BUGbase" unit (image left) which is the size of an old tape cassette (remember those? If not ask your parents) and is (their site described it); "a small hackable Linux computer" that has the basic components you need for most devices such as a CPU, USB, LCD interface, battery, WiFi, etc.

 

BUG_group_smSome of their initial add on hardware modules (image at right) include a GPS, digital camera/videocam, touch sensitive color LCD screen and an accelerometer/motion sensor—all of which snap together with the BUGbase, of course, and can be programmed with the open source software SDK.

They apparently have a full development environment called Eclipse which is also open source and according to Rafe's posting, "looks to be philosophically similar to the Bug hardware—that is, highly modular."

While Bug Labs is still pretty high up the geek/DIY echelon, I do hope that this is evidence of an evolution towards a more modular and interoperable level, enabling mashups for hardware, much as we are seeing on the software side with widgets and the like. 

 

USB_TypeAB_Diagram_svgOnce again however widespread adoption will depend upon the emergence of standards, be they de facto or de jure that will make everyone's modules interoperate and "snap together". What would Lego blocks be without standard "pin" size?! 

On the good news side we are seeing how something like the relatively ubiquitous USB connector has sparked an explosion of devices that all work off this same standard (even with the slight hiccup of there now being two USB connectors—A and B). This ability to use the same cords to plug any USB compatible device into any USB port has been a huge improvement in the interoperability of hardware and the exchange of power and data between such devices as cell phones, cameras, GPS, scanners, printers, etc. Heck, some of them even span the great Windows/Mac divide! 

On the other hand, no one seems to have been able to come up with a standard DC power plug in!  Even within the same manufacturer, it seems like every new laptop I get, for example, has a slightly different size connector, which renders all my other "brick" converters useless and means almost none of us can share them when we are together. 

So here's hoping that efforts like Bug Labs can start to make some significant progress towards standards that matter! In the meantime, all you DIYers like me, have fun creating more mashups, and be sure to share some of your creations with all of us.

November 04, 2007

The Encyclopedia of Life and the Network Effect

We are rapidly evolving towards a networked world—NOT "network"  in the technical sense, but the concept of networks wherein literally everything and everyone is a "node" and is connected to every other node. As this degree of connectivity becomes more and more pervasive, a whole new set of characteristics begin to emerge and our world as we've known it changes dramatically. 

One of these characteristics or traits of a networked world is what has been referred to as the network effect wherein the addition of more "nodes" multiplies the value to all the other nodes and to the network overall. Historical examples include technology such as the telephone, cell phones, FAX machines, e-mail, IM, etc., where we can easily see the power of the network effect as each new "member" or node of these networks multiples value of the overall network of all the other nodes.  For example, the value of the first cell phone, FAX or e-mail was essentially zero, and the addition of each unit multiplied the value for everyone else in the "network".   As a result, as soon as you had one of these items you immediately started persuading everyone else to get one because otherwise the value to you was diminished.  An early example of the so called "viral marketing" effect we are seeing much more of now.

The term "network effect" was first coined by Robert Metcalf, a brilliant mind and the founder of Ethernet, among many other things. But what is becoming clearer is that the network effect is not limited to technical networks and is, in fact, extremely pervasive. The Encyclopedia of Life is one such application of this network effect.

Encyclopedia of Life

EarthEast2The Encyclopedia of Life (EOL) is best summarized by the opening text on the site:

"Comprehensive, collaborative, ever-growing, and personalized, the Encyclopedia of Life is an ecosystem of web sites that makes all key information about life on Earth accessible to anyone, anywhere in the world. Our goal is to create a constantly evolving encyclopedia that lives on the Internet, with contributions from scientists and amateurs alike. To transform the science of biology, and inspire a new generation of scientists, by aggregating all known data about every living species. And ultimately, to increase our collective understanding of life on Earth, and safeguard the richest possible spectrum of biodiversity.

And here is a good review of EOL by National Geographic News as well as the ubiquitous Wikipedia reference.

Of course pictures and video are even better so be sure to check out their video clip that will quickly show you how EOL works and and this collection of demonstration pages that show how rich and extendable the data will is. 

If you have a bit more time  (about 22 minutes) I highly recommend that you watch the following video:

As E.O. Wilson accepts his 2007 TED Prize, he makes a plea on behalf of his constituents, the insects and small creatures, to learn more about our biosphere. We know so little about nature, he says, that we're still discovering tiny organisms indispensable to life; yet we're still steadily destroying nature. Wilson identifies five grave threats to biodiversity (a term he coined), using the acronym HIPPO, and makes his TED wish: that we will work together on the Encyclopedia of Life, a web-based compendium of data from scientists and amateurs on every aspect of the biosphere.

But EOL represents even more than the two themes I've touched on here and in my last post. More about this next time.

October 18, 2007

Oh Really? - Computational Photography

One of the most significant trends shaping our future is the redefining of what is "real" and specifically, bringing everything and anything into heightened and full three-dimensionality (or more), definition, and fidelity. I refer to "real" in the sense that we believe it "exists", and that we are increasingly:

  • Losing the ability to distinguish between what is real and what is unreal.
  • Losing the ability to distinguish between originals and copies, real and synthetic, real and unreal, real and virtual, here and not here.

This trend includes such things as the so-called 3D web, virtual worlds, the Internet of Things, 3D scanning and printing, and 3D human/computer interactions and interfaces, to name but a few. Will there be any such thing as "unreal" in the future? 

Since I am fascinated with and fixated on this topic, I'm going to develop it as a theme. Perhaps we'll call it "Oh Really?" and pursue it much further over a long period of time here at Off Course - On Target (OCOT). I've previously written a few articles on this subject, such as Coming Soon to a Desktop Near you:  Massive Amounts of 3D for the Masses and will cover this area more, but we'll also get into some of the many other aspects of the changing (let's hope!) ways we interface and interact with technology and are making these much more "natural" and "real".

For today, I want to briefly bring your attention to some exciting new developments coming out of Adobe Systems R&D work on new 3D camera lenses and some software they've developed for processing the resultant images. As you'll see, this technology opens up whole new possibilities, not just for photography, but for some amazing new ways of "playing with reality" by enabling you to go back into previously photographed scenes and change the images. Adobe is referring to this "computational photography" and as with many of the stories we cover here at OCOT, this one is interesting not only for the specific example, but especially for the larger topics and issues it reveals. 

Here's the story and it comes most appropriately from Dave Story, Vice President of Digital Imaging Product Development at Adobe, pictured here (thanks to Audioblog.fr) holding the original lens.

Dave Story Adobe For a quick overview of Adobe's research, you may want to start by checking out "Adobe shows off 3D camera tech" on Crave. This topic originates from a recent demo Adobe did in France showing their initial R&D work with a prototype camera lens consisting of 19 different lens elements that provided multiple views at slightly different angles and what Dave described as being a bit like what a multi-faceted insect's eye would see. 

Fortunately for us, Luc from Audioblog.fr was at the demo with his video camera and has put up this 10-minute video clip.  When you first get to this site, you will also see that we still have a way to go with machine translation (in this case by Google), but bear with it and be sure to check out the video at the end to get the best understanding of what "computational photography" might lead to.

adobe_focus_brush_10_8_2007_270x140 Of course, the serious fun begins once the hardware and software can take over and use these multiple images and angles to enable some very new and different possibilities. For example, they are now able to dramatically extend the concept and functionality of a "brush" in terms of what you can do with a "virtual brush" when working on photo images. In the video (and this screenshot from it) you can see Dave Story use what he calls a "focus/unfocus brush" to go into a photo and shift the focus from one statue to another in the photo. He goes on to suggest that they can also create a "3D healing brush" that would enable you to, for example, get rid of an obstruction in the original photo.

You will also see how they are able to move the "camera" after the photo has been taken. The movement in this case is very slight, but this idea of being able to capture moments and then go back and manipulate them AFTER the FACT is one of those possibilities which are equally and concurrently frightening and exciting. Something very powerful is going on here. 

Imagine If

Take this out quite a bit further and consider the potential when we have a full set of 3D data for every single pixel in digital images!  Imagine the manipulation you could do to both still and moving images; think about how you could go back into a scene or a "captured moment" and look at things from different angles, perspectives and focus. We've already been seeing advances in video camera work on movies and in televised sporting events, where they are able to move the camera through a full 360 degrees and all six degrees of motion, but now imagine YOU being able to move and manipulate the imagery on your own AND AFTER the fact!

The Future is Already Here

Or consider the uproar that has already been happening around the 3D "maps" that Google, Microsoft, and others are creating by having 3D mapping trucks drive through an area (large cities for now), taking a complete set of digital and laser images of the entire area. These images are then stitched together, so you can go from a spot on a map to "being there", enabling you to look around from that spot and see a full 360 degree surround of what you'd see if you were "really" there. The concern, by the way, is over privacy (or lack thereof) , and of what would be captured by all these images, which are constantly being updated.

This is another one of those things you can really only learn and appreciate by experiencing it, so if you have not already done so try this(I'll use Google for this example, Microsoft and Yahoo offer similar features):

  • imageGo to Google Maps.
  • Click on the "10 Market Street" listed in the left window (or anywhere in San Francisco for that matter).
  • click on the "Street View" button on the top of the map area.
  • Move the "little orange person" icon that shows up on the map to some intersection on the map.
  • Move your cursor around in the street level photo image that appears to look around.
  • Move your orange person icon up or down the street to look around there.

Scary?  Exciting?  Make you think about more possibilities if this is just rev 1.0?? YES!

And we think we have problems now (and we do) with not being able to tell the difference between an "original" photo, and one that has been altered!  Just imagine the degree to which this technology scales those problems exponentially!  Apropos to our larger theme here of full 3D reality and blurring the distinction between what is real and what is not, you can easily see how this recent example of "computational photography" is taking us in that direction and dramatically transforming what were previously just 2D photos, maps, and images.

"Computational photography is the future of photography," Story said. "The more things we can do that are impossible to do in a camera, the more powerful people's ability to express themselves becomes."

Quite true, and so once again, the great question that arises from such exciting new technology developments is what will you, and we collectively, DO with such newfound capabilities?  And what might we want to agree NOT to do?  What uses can you think of applying this to?  What problems can you now resolve with this?

I hope you will enjoy our foray into the world of 3D and the new reality, which of course is really just a matter of us finally having technology and ourselves catching up to the world as it's always been; VERY real and very multidimensional.  Oh Really?

Technorati tags: