Lightroom: Please add face recognition to Lightroom (ability to specify region metadata)

  • 313
  • Idea
  • Updated 4 years ago
  • Implemented
  • (Edited)
Do you plan to implement a face recognition defined by keywords in Lightroom someday ?
Photo of ManuelL

ManuelL

  • 1 Post
  • 0 Reply Likes

Posted 8 years ago

  • 313
Photo of BenD

BenD

  • 25 Posts
  • 10 Reply Likes
I'm all for this IF sufficient Dev resources are committed to to it's being implemented well. In other words, if it's going to be half-assed, don't bother. There's plenty of other things to tweak and improve closer to LR's core functions.
Photo of D-Two

D-Two

  • 2 Posts
  • 0 Reply Likes
@BenD: Well Put
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
First a face detection would be OK
-> I mean just detect faces with out saying who is there can help a lot.
Then add face recognition

But the most important thing is to be able to tag an image region (like a face for instance)
1. Start to make it general : ability to associate a region (saved in xmp) with a Keyword (normal kind of keyword we have already)
2. then these Keywords can be used for face taging
3. then in the database some of these keywords can be associated to face characteristic allowing an algorithm to make face recognition.

Finally the most important in face recognition is not how well the algorithm performs, but how well results are presented so that you can easily correct any errors or validate good guess.
Maybe we can group faces by similarities (with a given threshold) like Picasa seem to do.
A same person may then appear in different such group (because the person got older, or ...) and a same keyword (person keyword for instance) would then be associated with 2 or more face characteristic. this way we can eleminate the problems of photoshop element who get worse at guessing people faces when you have tagged too many faces of the same person (old faces pollute the ability to detect youger faces and vice versa)
regards
Eric
Photo of John R. Ellis

John R. Ellis, Champion

  • 4599 Posts
  • 1242 Reply Likes
The Metadata Working Group, of which Adobe and Microsoft are members, has already defined a standard method for representing regions and metadata associated with those regions. In particular, keywords, map locations, and persons (as already defined by the standards) can be associated with regions. This all gets stored in XMP metadata, of course.

See "Guidelines for Handling Image Metadata, Version 2", section 5.9 for more details.
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
that is exactly what we need!
I would like then LR to offer us the ability to tag region and link them with Keywords(whether it is a face region or not),( and Person In Photo IPTC/XMP tags when we specify it is a face region).
That would be the firrst step towards face recognition.
Second step would be to extract faces (just face recognition - no person identification) , so that it would improve manual face tagging.
Third step would add the face recognition.
When I speak in term of step I mean version of lightroom, as I understand that developping all that at once may take time and may not be free of bugs.
So we can take time to get there.
Photo of Steve McGinty

Steve McGinty

  • 7 Posts
  • 5 Reply Likes
Picassa's face recognition works really well..

I would hope though that if Adobe do add this feature (please do) that they do not get tempted to incorporate this into social networking sites... I do not like the idea that people can tag your picture on line without your permission. let alone be able to publish your photo online.....
Photo of Dan Zemke

Dan Zemke

  • 5 Posts
  • 11 Reply Likes
Google just acquired a facial recognition software company named Pittsburgh Pattern Recognition. See

http://blogs.wsj.com/digits/2011/07/2...

So Apple has it, and it looks like Google will be using it. It sure would be easier to keyword photos with face recognition, assuming it worked well. Instead of viewing it as a gimmick for the masses, as opposed to serious photographers, try viewing it as a workflow automation improvement that will become a requirement over time.

Fast forward a few years. Imagine LR creates an XML file, or mini DB of attributes attached to each photo, derived from things like image processing, GPS coordinates and date/time. Potential keywords could be presented for easy selection like: Dad, Julie, John Warnock, Christmas, Wedding, River, Mountains, Horse, Fog, Dawn, Yosemite, Motorcycle, Woman, Rain, Tornado, Fire, Red, Fruit ... You get the idea.

This kind of stuff will be prevalent for still and video captures in a few years, by all the computer-based applications (desktop and laptop and maybe tablet).

So Adobe - lead or follow?

Dan
Photo of Dan Zemke

Dan Zemke

  • 5 Posts
  • 11 Reply Likes
And not just Macs and PCs. What if Picasa and YouTube have auto keywording assistance and LR doesn't?

Will more LR users begin uploading their photos to a cloud for post processing that LR doesn't provide?
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
Note that Picasa 3.9 is now embedding the face information into the xmp, using the standard developped by the Metadata Working Group, of which Adobe and Microsoft are members.
Seems that those defining standards are not able to follw them (microsft photo gallery saves the face information using its own implementation, adobe photoshop element store the faces in a database only)
I love adobe products so I hope you will catch up
regards