reality bites

We're in the Big Easy, baby! And we're just a wee bit frazzled because there's simply too much to do and see, both in and around Nawlins, and at the APS March Meeting. They were handing out Mardi Gras beads in the press room (minus the usual requirement of flashing one's chest), where conversations covered everything from Eliot Spitzer's disgrace and the future of science publishing, to which one of the myriad competing parallel sessions one should attend. Should one go hear about block copolymer thin films or pyrochlores (rare earth metals)? Graphene transport or silicon photonics? Locomotion in complex fluids, or biological networks?

Or should one simply blow off an afternoon and take in the local sites and sounds? It's tough to resist the temptation in an iconic city like New Orleans -- one of the few towns (along with Montreal) where folks can pronounce my last name. Mostly, I have been working, although I did stop off at the legendary Cafe Du Monde for chicory-flavored cafe au lait and fresh beignets, and last night I indulged in a scrumptious dinner at Commander's Palace (in the Garden District) with Physics of NASCAR author Diandra Leslie-Pelecky -- gumbo to die for, and we both heartily recommend the bread pudding souffle for dessert. Alas, my shellfish allergy is severely limiting my dining options around these parts, where crawfish, crab and other crustaceans appear in some form in virtually every dish. But we can deal. At least I'm not allergic to beignets, which would be tragic indeed.

Perhaps in some future virtual world, I will be able to savor all the forbidden shellfish-based delicacies with no ill effects, and it will be almost like the real thing, because, according to University of Illinois physicist Alfred Hubler, I will inhabit a "mixed reality" state where there is no clear boundary between the real system and the virtual system: "The line blurs between what's real and what isn't."  Really, he said that. In a charming Teutonic accent, no less. It reminded me of a scene in The Matrix, where that despicable turncoat Cypher is dining with the Agents and observes that even though he knows the meal isn't technically "real," it feels and tastes just like it's real, and if it's good enough to fool the human brain, it's good enough for him after all those years struggling aboard the rebel ship Nebuchadnezzar. "Ignorance is bliss!"

Personally, I prefer the real world, with all its imperfections, but it's tough to deny the appeal of virtual worlds like Second Life. Not only can you have cafe au lait and beignets in a virtual New Orleans, but your avatar can literally make like Neo and fly there, with no need for cramped, overcrowded airplanes and the indignities routinely inflicted at airport security checkpoints by the TSA, just because they can. Oh yes -- we can all be The One, and wreak appropriate revenge on that over-zealous TSA employee in the Philly airport who confiscated the Spousal Unit's contact lens solution and my favorite lip gloss. Not that I'm bitter....

*ahem* Anyway, Hubler's just completed an experiment (the link is to his blog -- how cool is Hubler?) that he believes supports the existence of mixed reality states, using a real system -- in this case, a standard mechanical pendulum -- coupled with a virtual system (a virtual pendulum) that was programmed to follow the well-known equations of motion. He and his  colleagues sent data about the real pendulum to the virtual one, while sending information about the virtual pendulum to a motor that influenced the motion of the real pendulum. They found that when the two pendulums were of different lengths, they remained in a "dual reality state" in which their motion was uncorrelated, and thus not synchronized.

That in itself is not especially enlightening. But then they discovered that when the pendulum lengths were similar, they reached a critical transition point and became correlated, or, in Hubler's words, "They suddenly noticed each other, synchronized their motions, and danced together indefinitely." It's a lot like a typical phase transition, in fact: the critical temperature/pressure point wherein matter moves from one state (gas) to another (liquid). In this case, the phase transition occurs when the boundary between reality and virtual reality disappears.

This is the "mixed reality" state, where a real pendulum and a virtual pendulum move together as one. The trick is real-time feedback. Scientists have coupled mechanical pendulums with springs to create correlated motion, but without the staggering computational speed now achievable, coupling pendulums with a virtual system simply hadn't been possible. Per Hubler: "Computers are now fast enough that we can detect the position of the real pendulum, compute the dynamics of the virtual pendulum, and compute appropriate feedback to the real pendulum, all in real time." [That's the quote from the press release, but he said almost exactly the same thing in yesterday morning's press conference.]

As flight simulations, immersive VR, and online virtual games and worlds become increasingly accurate in their depictions of the real world, Hubler believes such "mixed reality" states via such "bidirectional coupling" will become more common. They could be very useful. Lasers, for example, are useful because of the synchronization of molecular motion. Laser light is "coherent," and thus all the molecules "help each other." Hubler thinks his lab-induced mixed reality states could be used to better understand real complex systems with a large number of parameters, by coupling a real system to a virtual one until their constant interactions result in a mixed reality state -- for instance, modeling neurons by coupling a real neuron with a virtual one.

Of course, Hubler admits that while there are benefits to be realized from such an effect, it could present problems. As an example, he pointed to the infamous wobbling of London's celebrated Millennium Bridge when it opened to much fanfare in June 2000. Thousands of pedestrians started walking across the bridge, and at first, nothing happened. Then, the bridge began to sway slightly until, quite suddenly, the wobble intensified to such an extent that people started walking in near-perfect unison without meaning to: left, right, left, right -- an enforced Sherman's March or something. The people began exhibiting the same coherent behavior as the molecules in laser light when the number and density of pedestrians on the bridge reached a critical threshold, resulting in the sudden transition to synchronized motion. This, in turn, exacerbated the bridge's wobble even more. The city was forced to shut down the $32 million bridge immediately (although it reopened in 2002 after being outfitted with strategic dampers, at an added cost of $8.9 million).

Similarly, while the human brain can be tricked, in The Matrix, into thinking one is consuming actual haute cuisine in a virtual environment because that environment so closely depicts "reality," there is also a downside. Remember what Morpheus told Neo after he failed to make that first virtual jump in the simulator, and, finding he was bleeding from the impact with the virtual pavement, said, "I thought it wasn't reality." Saith Morpheus: "The mind makes it real." You die in the Matrix, you die in the real world, because "The body cannot live without the mind."

Sure, it's just a sci-fi movie, but Hubler mentioned a series of recent experiments in what he unfortunately termed "out-of-body" experiences. He didn't mean anything mystical by it. He was just describing the effects when study participants were outfitted with 3D goggles that allowed them to see themselves from behind, via real-time video feedback. Then someone poked the participant from behind with a stick, making sure the "virtual" version of said participant was also poked. Eventually, they were able to only poke the virtual participant, yet the "meat world" version would see the action and immediately react as if he/she had actually been poked. The line between the real and virtual worlds had blurred to the point that study participants inhabited a "mixed reality" state, according to Hubler.

To me, this says that future generations of Second Life and other online games could become very exciting indeed, and almost indistinguishable from "reality." We're not there yet, if anyone finds this worrying. (As someone noted during the press conference, imagine if economic transactions in Second Life became so strongly coupled to, say, the real New York Stock Exchange that it caused a major market meltdown and folks didn't just lose their virtual shirts, but were bankrupted in the Real World as well.) Instantaneous interaction is a critical requirement and while we can manage this in the lab with real and virtual pendulums, expanding that to an entire virtual world will require even faster computers, as well as far better probes and actuators and other supporting device technologies. We've got a decade or so to prepare before The Matrix becomes "real" - or whatever "real" is going to mean by then.

Comments

[Michael]

Perhaps in lieu of the context of the blog entry, you could've titled it reality bytes? :-)

btw, very cool story today.

[No]

Congrats on being highlighted on msn.com (I think). I have read some of your previous posts and find them engaging and insightful. I'm sure there are better compliments than "engaging and insightful" but I will have to invest a little more time in reading more of your posts in order to gush in a truly sincere way.

Warmest Regards,
No

[Jenny C]

Sorry to hear about your shellfish allergy. My big sis has this problem and she recently discovered that she can eat oysters. Not trying to send you to the hospital or anything, but wouldn't that be sweet if you could have a big crispy oyster po-boy?

Caught your link at msn.com

Jenny in Mandeville
just north of y'all

[Jo]

I love this article! The Combustible Edison looks pretty good, too. I have a slight allergy to crab, but luckily it's just the headache kind and not the throat-close-up kind.

Definitely catch you later!
Jo

[Robin]

Nice blog:

I'm glad to see that people in the big N.O. can say your name, when I did some research at Tulane last year, I inquired at the local temples about the enthic habits and the changes as well as the affects to the local Jewish population. At one of the local temples, the staff were very polite throughout the converstion. As I was leaving one of the office staff stopped me and not only asked how to spell my last name which has been around as long as the Torah but the she mispronounced it to boot. I found out later that most of the staff was Christian and was only helping out that temple until the regular staff returned.
And don't feel bad about the allergy, just be happy that no one has tried to poison you yet to seafood as a joke which landed me in the ER for several hours. The worst part is I never knew I had a seafood allergy because I do not eat it. After the "joke", I was told that they liked me. I had been a good sport about it.
Looking back, I happy the locals did like me, I do not want to think about what would have happened if they disliked me. I have mostly good memories and people that I met and I would not trade it for all the seafood in the south.

From seventy miles north of N.O.(Hammond),
Robin

[Master Shake]

What a fascinating article. I always get scared for people who immerse themselves too deeply into online roleplaying games. giving these games more significance would only feed the problem. Its sad when you think about the amount of people who let these "virtual realities" consume their lives.

[Jim S]

Just discovered your blog. Fascinating!
I hope you enjoy my fair city (NOLA, which is a strange and wonderful place. Just be careful. Tip: Go the the Carousel Bar at the Hotel Monteleone for a cocktail.

[J]

Just found you through msn. A place where nerds are cool. Thanks.

[Bilal]

Ah, I tried Cafe Du Monde and the beignets were to die for. I recommend the crawfish etoufee on rice at Jacques-Lmons. The wait is almost two hours, but it is definitely worth it! :)

[j a higginbotham]

go to jean lafitte park or take a swamp tour

go to central grocery (opposite more less beignets) and get a muffuletta

try some roast beef po-boys and red beans and rice

[Nipper]

This is one of the best articles I've read in a long time, thank you so much! "-- for instance, modeling neurons by coupling a real neuron with a virtual one." Hmmm.... potential for treating neourological disorders? Am I getting ahead of myself? Yeah, I've had dreams like that where I sort of notice my own virtual self. It's scary and peaceful at the same time, n'est pas? That reminds me, I have to eat! :)