Robotic Photographer 107
Boojum137 writes " ExtremeTech has an article on a robotic wedding photographer named Lewis. Lewis's hardware stats are modest, so he uses a clever trick to locate people based on skin tone, which is also independent of race. After locating potential subjects with a myriad of sensors, including sonar, laser range finders, and infra-red, he tries to frame the shot according to photographic rules of composition. But the real innovation behind this "red trashcan" is its ability to fade into the background. According to Lewis's creators at Washington University's Media and Machines lab, because of the robot's passive nature, people tend to ignore it after short period of ogling. This allows for some great natural shots, instead of the typical forced and self-conscious shots from human wedding photographers. And, in case you were wondering, Lewis is going to live up to his name in November."
Easy way to get good wedding photos (Score:1, Informative)
Re:Easy way to get good wedding photos (Score:2)
Re:Easy way to get good wedding photos (Score:3, Interesting)
Best pattern I've seen = pro to do the ceremony and a *brief* set of posed shots afterwards, disposable cameras for the rest.
The "robot photog" is not going to be a cheap piece of machinery for a long time, and a dozen disposable cameras in friends'/relatives' hands will get more and more interesting photos than a single robot could possibly produce.
Of course, at robot weddings with robot guests, things may be different...
(Don't forget, because of my limo experience I've been to more wedding than most people, literally hundreds of them.)
- Robin
Re:Easy way to get good wedding photos (Score:1)
My wife and I did this at our wedding, and several guests walked off with "our" cameras.
-Ed
docbrown.net [docbrown.net] NEW!
Graphic Design, Web Design, Role-Playing Games...all the good stuff
Lewis + Paparazzi = Terminator 3? (Score:2, Funny)
Reality TV (Score:1)
What other applications would this have? In airports or shops to spot out suspicious behaviour without raising much attention?
you can barely see it (Score:4, Funny)
Re:you can barely see it (Score:2, Funny)
Re:you can barely see it (Score:2)
I would guess within the first 12 hours of its deployment.
Re:you can barely see it (Score:2, Insightful)
Human's are funny that way.
Re:you can barely see it (Score:1)
BUT make sure you put a sign saying this is NOT an ash tray. Nobody needs a blazing, screaming robot streaking across the dance floor.
Re:you can barely see it (Score:2)
Re:you can barely see it (Score:1)
Re:you can barely see it (Score:1)
Not that I'm the type to do this... (Score:1)
You could also get those much desired shots of the groom making out with the maid of honor and use it for some pretty heavy blackmail material.
This opens up so many avenues... think of the possibilities!
talent (Score:1)
Going haywire (Score:2, Funny)
A robotic wedding photographer went haywire earlier today. The "Lewis" robot killed and injuring half a wedding party when it suddenly became selfawareand began shooting people with it's build-in laser.
In a comment from the University who build it claimed that the laser-range finders were harmless.
The casualties were quite high since noone could hide from the infrared cameras. "Lewis" found them and did away with them.
The weird thing was "Lewis" suddenly seized its frenzy when it ran out of film??
Totally incognito (Score:2)
But the funny thing is (Score:1, Informative)
It's nonsense to say that wedding photographs have to look posed. Many photographers are experienced at taking candid pictures - that's what street photography's all about.
I hope it's trash resistant.... (Score:1)
Skin Tone independent of race? (Score:2, Interesting)
Are they really trying to say that the machine does just as good a job of identifying all skin colors? I'm willing to believe that, but the statement that skin tone is independent of race seems a little goofy.
Re:Skin Tone independent of race? (Score:1)
Sees Skin.... (Score:4, Funny)
Yes... (Score:3, Funny)
Re:Sees Skin.... (Score:1)
I think the robot is male (Score:3, Funny)
That pretty much describes the way most guys recognize chicks (especially in sunny climates)
...but the poster is female. (Score:2)
>
> That pretty much describes the way most guys recognize chicks (especially in sunny climates)
The poster of that comment must be female.
A male poster would say "Face? Never seen one of those..." *rimshot*
Re:...but the poster is female. (Score:1)
As a former wedding photographer, (Score:5, Informative)
Problems? You want problems? We got problems!
1. It's too short. Candid shots from that level, looking up at the subject, are not flattering. And people don't buy wedding photographs that don't flatter them.
2. It's digital, I guess, but in any event uses some kind of video camera to capture images. That's (probably) crap. Still captures from video cameras are of lesser quality than a good digital camera and good digital cameras (that is, "good" by pro photo standards) are as expensive as your house. Weddings are one of the few times in their lives that most people will actually pay good money for high quality photographs. Digital has its place at the low end, but is something as expensive as this is sure to be going to be cost-effective at the low end? I kinda doubt it. Good wedding photography still requires film, preferably nice, wide rolls of it. Show me a machine that can operate a Hassy and we'll talk again.
3. Yes, adult humans tend to ignore something like this after a brief period of familiarization. But there are lots of kids running around at weddings. Ever show a 4 year old the hamster dance page? After 30 seconds, you're bored but they're just getting started. They'll giggle for hours. Same principle here. Just wait till a few unattended kiddos (and there's always at least a couple of kids at every wedding whose parents are nowhere to be found while they tear a path of destruction through the place) notice this thing and decide to play "Let's push over R2D2!" with it. It'll happen.
4. Good wedding photography (Wait - this comment might not be a good one since we've already established that this device is only worthwhile at the low end - but I'll go ahead anyway...) requires making art (sometimes hack art, but art nonetheless) quickly. That requires aesthetic sensibilities and brainpower that this thing just doesn't have.
One last note - I can understand the concept. There are WAY too many wedding photogrpahers in this world with gigantic egos who act like a wedding is a get-together for the purpose of taking pictures. They take over and try to run the whole show. After dealing with them, I can certainly imagine being motivated to invent a machine that would just shut up, do the job, and not get in anyone's way. But that's a by-product of pain-in-the-ass photographers, not really a good reason to develop a new machine. A truly good photographer knows how to be totally unobtrusive 98% of the time. The solution is to not hire bozos. The solution is not to try to replace photographers, even if it's just a few at the low end, with a machine that will necessarily produce substandard output.
Re:As a former wedding photographer, (Score:1)
Seriously though, a lot of social photography is about relationships between people, and if a robot has no idea which one is the bride's cousin and what she's doing behind a hedge with the best man, it's going to miss a lot of intereting stuff. Though most wedding hacks I've seen miss that too. I'd love to see pictures from this machine, if only to emulate that "mindless robot" look.
Disclaimer: I am not a wedding photographer. [ripserve.com]
Re:As a former wedding photographer, (Score:2)
It would be cool if it had both a video camera and a better quality still digitical camera mounted at about the same spot, that could get around some of the image quaity issues I imagine.
So this probably won't replace a human in the loop, but hell...people put those cheap disposables on the tables for the guests, I think the bot has at least the potential to supplement or replace that.
now if they could have one fly around ala a probedroid....that'd be kind of cool. Mount it on a little helicopter...and maybe have an optional base station so people could compose their own shots...
Re:As a former wedding photographer, (Score:2)
1. It's too short.
For full-body shots, this is much less of a concern. Yes, if you are trying to take head-shots, you don't wnat to do that from waist level. But then, if people are sitting down, you're at about the right height.
2. It's digital
Current digital SLRs are pretty good quality, actually. 6MP is not at all bad, and only costs about $3k including storage media. This will give you something about equivalent to 35mm photography. Not 6x6/6x7/6x9 Hasselbrad, but a lot of wedding photography isn't done on medium format.
Also, note that this was for unposed pics of the guests, not posed pics of the wedding party. It isn't replacing the wedding photographer (yet).
On this topic, I have a 4MP point-n-shoot digital camera (Canon S40), and it does very acceptable 5"x7" prints. I'll replace it when 20MP digital cameras come out that will do acceptable 8"x10" prints. Until then, it won't be worth it to me.
3. "Let's push over R2D2!"
Yes, this is a problem. Make it heavy enough and you'll use more battery just moving.
4. Good wedding photography
As stated, this is currently for candid shots of the guests, not the posed wedding party pictures. But even so... a lot of wedding photog "art" is still following simple rules. (And a lot of wedding photogs can't follow even those rules, ending up with some really bad wedding pictures I've seen.)
I don't dispute that the system has limitations. And using a video camera for captures is not my first choice either (though it's probably easier for the subject-recognition system... constant video capture). But it's a concept system. Give them a couple years to turn it into a product, and (aside from "Let's tip over R2D2") it can be a decent system for its intended purpose.
Re:As a former wedding photographer, (Score:3, Funny)
Re:As a former wedding photographer, (Score:4, Insightful)
Your final note about getting a GOOD photographer is the real solution. (at least until we are ALL replaced by robots). I had a great photographer at my wedding, totally unobtrusive and a real artist. We also had some friends who where good photographers that we asked to take B&W candid shots. Admittedly as art students we had a lot more knowledge of photographers (and friends with BFA's in photography) but there are good photographers out there. For candid shots, if there is an art school nearby getting a student who is really interested in street photography (probably most of them) to do candids would probably get you some really nice candid shots for very little money (If you want unobtrusive just pick one without too many piercings & maybe pay them extra wear something that *isn't* making a statement
Gay Robot Photographer (Score:1, Flamebait)
Is the robot photographer gay? [globalcrossing.net]
C3P0 is such a drama queen.
This is a good thing (Score:2, Informative)
What it does show is that it is feasible to do more work in this area - despite its size, people lose interest (although I would imagine this is more to do with wedding-associated alcohol than anything else...) and let it click away without ogling at it - all it is is fairly simple technology appliying simple rules (e.g. face should be in centre or photo or wherever) and then takes a few pictures.
While a lot of these will be crap (same as for a human photographer) what this does allow is more natural photos, where people are not posing, or forcing smiles, or having to hold their smile just a bit too long as the cameraman waits for whatever moment all cameramen seem to thnk comes about 5 seconds after asking everyone to say cheese (don't you hate that?).
So we get lots of natural photos, discard the rest, and end up with some good ones which we might not have achieved with a human.
In the long term, though, this might have much more application - we can get it to recognise terrorists, criminals, finally get the intrusive Minority Report style advertising, and maybe we can train Lewis to recognise cleavage.
Re:This is a good thing (Score:3, Funny)
It's a good thing so many of us geeks are so stereotypically asexual.
I mean, this would be the perfect thing to have at a /.er's wedding. Except that you'd just get roll after roll of close-ups of geeks' noses as they examine the wedcambot for 3 hours while the reception goes on in the background.
Groom included. ("Huh? Oh yeah, yeah, I do, I do, whatever. Just gimme a few minutes, I think I can get a Quake server running on this thing! Tell the best d00d to bring his laptop, we're gonna have wireless LAN gaming at the reception!")
Re:This is a good thing (Score:1)
funny thing about this - it does happen. a former friend had setup a sega genesis in another room at his reception for kids. the groom and bestman spent most of the reception playing altered beast. which explains why that marriage didn't last.
I've seen/played with it... (Score:5, Informative)
The photos it "composed" were actually quite good as it would use the rule of thirds when trying to set up a photo. The only real problems I saw with it from a tech standpoint was that the lighting in that area of the convention center was a bit yellow so their white balance was off and the robot had the embarasing habit of totally ignoring anyone with very dark skin. At the time I was talking to a student from a local school who was there who happend to be black and we let the robot take a few pictures of us... when we went to look at the pics every single one of her was cut off as she was basically being ignored as "background".
The other problem were the batteries - I saw them change the batteries on the 'bot once and there were a *LOT* of what appeared to be very heavy lead -based batteries - they looked like motorcycle batteries, but I'm not sure. Apparently the bot lasts for a few hours on a single charge, but then you have to swap out all of its batteries (I think there were at least 5 of them)
Re:I've seen/played with it... (Score:1)
I read that NBC bought ten of them to use to shoot Friends.
Re:I've seen/played with it... (Score:2)
Another good thing is that to save money, you can use the whiny-female-personality bot on all characters!
Good concept. (Score:2)
However it would be interesting to tie this in with high end digital cameras r even film. Theoretically it would not be difficult to teach a computer the basics of photograpic technique and asthetic ideals (framing, compositional percentages, light qualities) and get them taking photographs better than 90 percent of people) weddings especially. There is an art to wedding photography, but most of it is donkey work and getting people into frame with the right relatives and friends in every shot (unless you have to deal with force 8 gales on a clifftop like my last commision
That is when it would get to be something more than just an image tracking and recognition system whcih is pretty old hat. Teaching a computer how to distinguish a good from a bad photo would impress me.
Although it would put pay to some of my business admittedly
neat but primitive.. (Score:2, Informative)
next most wedding receptions are at dark places... so without the ability to flash (as I highly doubt the low cost video camera is a 3ccd 0.05lux color array with plossl lenses costing around $15,000.00 (for the CHEAP one.. Ours was $35,000.00 but we wanted Zoom)
It's a great proof of concept, and with some upgrades it can be a really cool device. but it needs to get away from video for the camera and use a regular Off the shelf 3megapizel digital camera with flash or 35mm film to do the job.. I certianly dont want my wedding photos to be nothing but low rez,underexposed,blurry NTSC captures..
Re:neat but primitive.. (Score:1)
To make it really perfect... (Score:2)
kiss the bride (Score:3, Funny)
Yeah, but can it kiss the bride [bdnet.com]?
Other uses... (Score:2, Interesting)
But the real breakthrough is the ability to identify a target among a group of people. Let's just say that this project was DOD funded.
Re:Other uses... (Score:2)
Wedding Singer (Score:1)
A few more details (Score:5, Informative)
So I'm a student at Washington University, and I know the people who programmed Lewis. A couple of points:
Anyway, it was a lot more work than you'd imagine to get Lewis to function properly. Lots of things you don't think of crop up (The laser's can't see the legs of a table. Micheal is pale and other people aren't. Wooden doors are approximately skin toned.), and the problem is intrinsically difficult. The skin tone stuff alone eats up most of the processor, nevermind the path planing and mobile obsticle avoidence. For SIGGRAPH he was running on reduced hardware too: he has a dual mobo, but it isn't as reliable as the singe-processor one used at SIGGRAPH.
What's the definition of "robot"? (Score:2)
Actually, that was more of a remotely piloted vehicle or a drone, wasn't it? Although the Dod has done some research in autonomous vehicles, a remote controlled mechanical man is a lot more usefull for killing people. We need a different term to use for autonomous, self-controlled mechanica then we use for glorified RC cars on steroids; unfortunately common usage seems to refer to both as "robots". Wouldn't "Robot Wars" be a lot more cool if there wasn't a geek with a joystick actually controling the action?
Is quality PC-based photography possible? (Score:1)
So, my thoughts were always toward using my laptop to take pictures. You can't a much better preview screen than a 14-inch TFT LCD. The only problem is, where can you get a high-quality 'web cam'? Keep in mind, the desired effect is that the laptop would the bulky and expensive part. I don't want to hang a $1000 friggin DV camcorder off of my laptop.
Compression and Exposure time (Score:1)
I'm not a photographer by any means and that's why I can't justify buying a device designed only for that use.. I've heard of high end digital cameras that have a variable shutter speed / exposure time. That would be a nice feature since colors are not very rich at very low exposure times--whether on film, CMOS, CCD, or whatever. This might be a feature that is very difficult to integrate into PCs.. I would imagine that this would be a software feature, which would likely not get anyhwere near the desired effect.
Fades into the background (Score:1)
I don't think it is possible for a Dalek to go undetected at a party.
http://www.users.globalnet.co.uk/~mimrie/dalek/
Sheki
Why a robot? (Score:1)
Nah, self-navigating robots are far more cool.
"Natural" (Score:2)
IOW, people blinking, coughing, scratching, and picking their nose.
Personally, I find other people's wendings a huuuuuge borefest. It takes every trick in the book to get out of one. If you want to make use of robotics, then make one that can transform into the look of a person and go as a proxy.
What a relief (Score:1, Troll)
Perhaps one of the most boring things a human can have to do... especially the weddings.
Something like this might force a lot of artist wanna-bes to get real jobs
Audio input (Score:2, Insightful)
I remember a gimmick 35mm camera a while back that came mounted on a tabletop tripod with a servo and directional mic. When the microphone picked up loud noise, the camera swiveled around and shot, the theory being you'd pick up the wildest party moments on film.
An add-on item at wedding mills (Score:1)
Dalek Photographer? (Score:2)
Start Dalek Voice
I am the wedding photographer! You will line up at the Head Table! You will obey! CIR-CU-LATE! CIR-CU-LATE!
End Dalek Voice
(Lameness filter wouldn't let me use caps for the Dalek voice)
And I though my wedding was scarey....
Digital composites (Score:2)
Or you could just hire a decent photographer, maybe do the time consuming stuff ahead of time, and leave a bunch of disposable cameras around for the reception.
Not that i can in any way fault the robot idea. It does, in fact, kick ass.
(And one last nitpick, it's not really fire engine red, it's Research Robot Red [irobot.com]. If it's anything similar to what ActivMedia uses on the Pioneer robots, it's an amazingly impervious, apparently epoxy-based coating which can only be removed with a grinding wheel or similarly serious abrasive.)
Re:Digital composites (Score:1)
ARGH!!!
The "altar return" should last no more than 15 minutes, absolute max, no matter how big the wedding party. I've done full sets at traditional Mexican catholic weddings (read: more than 30 people in the wedding party) in that time frame. I've done small wedding parties in under 10 minutes. There is absolutely NO excuse for keeping everyone waiting for an hour. That's just pure incompetence on the part of the photographer.
passive nature (Score:1)
I have photographed a couple of weddings. People seemed to ignore me the entire time (ie. no period of ogling, sniff-). I guess I am just one of those people who lurks in the background, going unnoticed. 'tis true, I did end up with a great deal of "natural" (excellent) photographs, some possibly embarrassing memories.
Ciao, -xtype
Methods for finding skin (Score:1)
The trick for those of you are interested is to convert you image from RGB (or whatever format you have your image in) to HLS coordinates (hue, lightness and saturation). Or TLS (tint).
As skin (regardless of race excepting albinos) is colored with melatonin and the "color" varies with the amount of melatonin the hue is roughly a constant for most people. Using that and LS info and connectedness you can improve your hits.
Of course there are better methods and a google [google.com] reveals some of them.
Using hue and ratio of red/green ratios [bu.edu] seems to work very nicely.
Lewis' methods for finding skin (Score:1)
Two caveats: first, changing lighting conditions shift where skin falls in the chromosity plane, so the UV look-up table needs to be retrained for new environments or automatically shifted to account for lighting. Second, we found that because we ignore the Y component, certain shades of red are labeled as skin even though they dont resemble skin to a human eye. As such, for more robust skin detection the Y component cannot be completely ignored.
Michael Dixon
Media and Machines Lab [wustl.edu]
Computer Science and Engineering
Washington University in St.Louis
Lewis's webpage updated (Score:1)
Technical details, clarification (Score:2, Informative)
As a member of the team working on the Lewis project, I'd like to provide some additional technical details. It should also be noted that the Lewis project is not intended to replace human photographers. It's an easily accessible research-oriented endeavor to explore human/robot interactions in a real-world environment.
Specifications:
Processor - Lewis is a B21r mobile research robot from iRobot Corporation [irobot.com]. It's powered by a single 800Mhz Pentium IV processor. This CPU must handle all of the motor drive and low-level robot tasks such processing the data from the large array of sensors. On top of this CPU load is the task of finding faces, navigating crowds, and taking and processing the photos. The two additional processors to be installed in the future will allow Lewis much more power for its photographer duties.
Camera - Lewis currently uses a Sony DFW-VL500 [technical manual [sony.co.jp]] digital 1394 (Firewire) camera. This has a 1/3" CCD that produces 640x480 color images at up to 30 frames per second. Image output is YUV 422 format and is not compressed. The built-in 12X zoom lens is sensitive to 14 lx (F1.8). Higher-resolution 1394 cameras are available, but these do not have built-in lenses; this is bad because focus, aperture, and zoom must be fixed.
Safety - The entire enclosure is lined with bump-sensitive panels, so that if the robot runs into anything, the currently executing program is terminated, the motors are halted, and the brake is applied.
Operating System - The operating system on Lewis is a standard Linux distribution using kernel version 2.2. Various libraries for control of the motors, sensors, pan/tilt unit, and camera are used.
A couple of other comments: the camera is not an NTSC video camera. It was chosen because of the easy ability to control zoom, focus, and aperture from software. Since our goal at the moment is not film-quality pictures, this camera suffices.
Sample photos are available on our website [wustl.edu]. We have been slow in posting samples due to privacy concerns, not because the pictures are bad. We have over 3,500 photos, and I'd say well less than 2% are false hits -- photos of doors, walls, elbows, etc.
Lewis 'Wedding Photographer"? (Score:1)
(From the article) Lewis is able to determine that it's seeing a human by recognizing that it's looking at a pair of legs
Spotted it yet?
What about the bride [virginbride.co.uk]
Use the Force (Score:1)
Security (Score:1)
Now all we need is... (Score:1)
I was snapped by this guy at SigGraph. (Score:2)
it's designer. I think it's a lot more cool (and *clever*)
than it first seems.
It's not so much that it's invisible (*obviously* not) - it's
just that he's slow moving and quiet and generally unobtrusive.
When you pay attention to him and pose, his camera makes an
audible (and unnecessary) "CLICK" - but when he's just quietly
rolling around capturing 'natural' photo's, his camera goes
quiet.
He's all novelty to start with - so he gets a bunch of
posed photo's - but soon people lose interest and get
lost in conversation and/or alcohol & wedding cake - and
then the robot's ability quietly roll around grabbing
photo's comes into it's own.
It's software automatically frames pleasing photo's
according to the usual 'golden ratio' rules. The version
at SigGraph had a base station that would allow guests
to view photo's and have them emailed to them.
I liked it - and I'd definitely invite it to my wedding.
If I had to find a criticism, it is that it's framing
algorithm doesn't cope well with very short people - notably
children. I'm sure that could easily be fixed.