Lightroom: Please add face recognition to Lightroom (ability to specify region metadata)

  • 313
  • Idea
  • Updated 4 years ago
  • Implemented
  • (Edited)
Do you plan to implement a face recognition defined by keywords in Lightroom someday ?
Photo of ManuelL

ManuelL

  • 1 Post
  • 0 Reply Likes

Posted 8 years ago

  • 313
Photo of Christopher R Souser

Christopher R Souser

  • 23 Posts
  • 5 Reply Likes
I don't think I would use facial recognition in Lightroom and not sure how others using it for professional use would use it either.
I can see how someone using Lightroom for keeping track of family pictures or something could use it.

A professionals I would assume that you are tagging your images with the names of the models or clients at the time and may or not photograph them again, and if you do your workflow would likely have you tagging them appropriately at that time too. So when would you use it really?

What might be useful is a pattern or shape algorithm that you could select say a "Bridge" in an image and then it use that as criteria for going out and finding other bridge pictures in a 'batch background mode' and doing the same for other things like wolves, birds, bears, towers, or other "General" objects.. without getting down to this bird vs. that bird detail.

Christopher
Photo of Jay Curtis

Jay Curtis

  • 2 Posts
  • 0 Reply Likes
Having a library of 60,000+ photos that are being brought into Lightroom in bulk, it would be beneficial to have facial recognition. New users with a large library do not have the luxury of adding tags as photos are taken as that point has already passed.

So whether a professional or an amateur with an extensive collection of photos, making the process of adding and quickly tagging photos easier would seem to be a positive selling point. Especially since most other software including i-Photo, Picasa, Aperture, etc. have this feature. Even Photoshop Elements has a rudimentary facial recognition feature.
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
Taking wedding photos. That is a huge help, unless you know every guest each time you do the job. :)
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
There is already feature request for shape/color detection algorithm, you can go and vote for it : http://feedback.photoshop.com/photosh...
It is already implemented in photoshop element, still waiting for LR to get it :(

being ironic : if you do your keywording properly you shouldn't need that function either , should you ;)
Photo of Son Nguyen

Son Nguyen

  • 61 Posts
  • 12 Reply Likes
I'm not here to shoot down the request. If it is implemented in the end, then it's good. I'm just here in hope that someone can educate me what is the benefit of Facial recognition besides "oh, I want to pull out all the photo of uncle Bob".
I do wedding. Do you guys keep track of all the guess name? So the couple will come to you and say "We want the photo of us and Uncle bob". And during the ceremony you keep track of all the guest names so you can tag it in later?
Regional tagging is understandable. I can see the advantages of it.
Photo of seanhoyt-dot-art

seanhoyt-dot-art

  • 340 Posts
  • 55 Reply Likes
I also do weddings and tagging guests would never be something that would be time efficient, even if it meant training the software. What would be USEFUL is during the pruning process to have LR know >where< the faces are but not >who< they are. I don't care >who< they are.

So what's useful for that? Imagine a 27" monitor (I have one) that could show you a grid of all of the faces in a group photo. You could instantly see both the composition (wide shot on right) and grid of faces on the left and make very, very quick judgements about sharpness and facial expressions. So much time is burned zooming in and panning around each shot, remembering which one is better than the rest...

Also, imagine if Lightroom's Auto Exposure could use the faces to do intelligent image exposure adjustments... Currently, a brighter background or a spotlight totally throws the immature software algorithm for a loop. 1% of the time these auto-correction features work. Recognizing faces and treating them correctly in the develop mode (auto correction) plus saving time on showing you faces in Library mode while you cull would save HOURS and HOURS per job.

That's why Adobe should work on this. Not for searching your catalog. For speed and intelligently assisting me.
Photo of Jim Isaacs

Jim Isaacs

  • 5 Posts
  • 0 Reply Likes
I am trying to identify the names in family history photographs that are 120 -90 years old. We have some names and the ability to check for family characteristics would help
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
It does not need learning. All faces are classified/grouped by degree of similarity. So you just need to type the name once for each group of faces. It can be much more efficient than a human.
Photo of Justin Kling

Justin Kling

  • 8 Posts
  • 2 Reply Likes
It increases the long-term value of every picture you take if you can identify things that may be forgotten in the future.

In this picture, who are the 2 players making the tackle? You can't see the names or numbers on their jerseys. But maybe one of those players is gonna get picked in the first round of the draft this year, making this picture desirable to news outlets. There are tons of situations, both professional and personal, in which image region metadata makes a picture more valuable (either financially or emotionally). Just because it doesn't benefit the kind of work you do doesn't mean it isn't valuable to other professional photographers.

http://www.indystar.com/picture-galle...
Photo of Rick Tucker

Rick Tucker

  • 12 Posts
  • 4 Reply Likes
Unfortunately, the "editors" of this forum have combined two feature requests into one thread that are entirely different.

One is facial recognition across different photos.

The other is the ability to specify region metadata to tag regions of photos with metadata, like photo tagging on Facebook. This is not just for face tagging, though! I want to tag buildings, national monuments, bridges, and so on.

I and others submitted the latter request, which I still believe to be a prerequisite to the former. Adobe was a direct party to the regional metadata tagging standard, but as far as I can tell have not implemented it in any of their products. That's what I want!

All the best,
- Rick
Photo of Rob Cole

Rob Cole

  • 4831 Posts
  • 388 Reply Likes
Rumor has it Lr5 will have face recognition (certainly Adobe has been working on it, since there are tell-tale signs in the code). Whether they also will expose general regional tagging, - dunno...

Disclaimer: it could be face recognition won't be done for Lr5 final either, I really don't know... (so don't spread rumor ;-})
Photo of seanhoyt-dot-art

seanhoyt-dot-art

  • 340 Posts
  • 55 Reply Likes
I'm hoping so much it's "face recognition" and not full blown "facial feature discrimination recognition".... I don't care if the person is Chris or Steve or Mary. I just want LR to know where the faces are and 1) zoom in intelligently on each face for proper analysis and 2) maybe auto corrections with care for skin tones in the image. Something intelligent. It's about time.
Photo of Gary Ap Kohls

Gary Ap Kohls

  • 1 Post
  • 0 Reply Likes
Region tagging and face recognition are both in Photoshop Elements. PSE's management of tags is lacking as I've written about elsewhere in this forum but the region tagging works pretty well and recognition too. It's inexplicable to me that LR hasn't done this yet. Time to beef of the LR development effort and provide a smooth path from PSE if Adobe wants to grow its customer base.
Photo of Rick Tucker

Rick Tucker

  • 12 Posts
  • 4 Reply Likes
By the way, what is a "Promoted Response" in this forum?
Photo of Rob Cole

Rob Cole

  • 4831 Posts
  • 388 Reply Likes
One with 3 or more stars, I think.
Photo of Rick Tucker

Rick Tucker

  • 12 Posts
  • 4 Reply Likes
Please separate the requests into two different ones: (1) Facial recognition; (2) region metadata tagging.
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
It is already done
Photo of Kent Messamore

Kent Messamore

  • 49 Posts
  • 29 Reply Likes
I agree. We need facial recognition. I have hundreds of family photos many of which have no tags. If you don't want to put facial recognition into LR then give us some way to import tags from an application that already has facial recognition.
Photo of Jim Isaacs

Jim Isaacs

  • 5 Posts
  • 0 Reply Likes
I agree with Kent
Photo of Dario Ribeiro

Dario Ribeiro

  • 1 Post
  • 1 Reply Like
hey Adobe, could you please provide us out of the box facial recognition, this is a must have feature for LR.
Photo of Rob Cole

Rob Cole

  • 4831 Posts
  • 388 Reply Likes
Face recognition will probably be in Lr6 (Adobe has definitely been working on it) - but don't quote me ;-}.
Photo of Stefano Klett

Stefano Klett

  • 1 Post
  • 1 Reply Like
I will definitely never purchase an upgrade if will not include facial recognition

Stefano
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
Since adobe seem to be working on the feature, just a short note to be sure that they handle all cases:
I have recently had (for the second time) a problem with 2 persons having the exact same name (family name and first name identical)
If I use keyword for persons name, I can only create 1 keyword. Which means that when I filter the photo by this keyword, I will find both persons, which is not what I want. I would like to be able to create 2 times the same keyword.
But I am OK if it is not possible with keyword.
However, when we will be able to tag faces, I really hope we can create 2 or more face tag with the exact same names( but representing different people)
This is possible in PICASA
regards
Photo of Rick Tucker

Rick Tucker

  • 12 Posts
  • 4 Reply Likes
What I do (in keywords, not region metadata tags) is to create two separate keywords for the people with the same name. For example, one keyword would be "Wagner - John (born 1855)" and another keyword would be "Wagner - John (born 1880)". I would like to do the same in region metadata tags once they are implemented in Lightroom.
Photo of Babar_e

Babar_e

  • 138 Posts
  • 24 Reply Likes
Note 2
we should also be able (or the software should be able to do it automatically) disable a face for the training data (training the computer to recognize other faces of the same person).
Indeed I should be able to select a face taken in very bad conditions where, I only, can know it is a face. for example some portraits in very contrasted light, where you may only guess silhouettes,... or even the back of someone head, or some head half or fully hidden by some objects,...or worse part of the body that is not a face because the face happens to be hidden but I still want to remember who was the photographed person (ok that is not intended to be used like this but I am sure some including me will)
And finally we should be able to move/resize the region. I hate it when PICASA recognize someone, but the region it draws is so big that it includes other smaller faces in. These faces cannot be tagged afterwards, since they are part of an already tagged region!
Photo of Eugene Master

Eugene Master

  • 26 Posts
  • 15 Reply Likes
When I import a batch of photos, I will go through each one and tag names as keywords of individuals present in each. I have smart collections built to each person's name. So then if I want to find and pull up all the photos of a particular person, I simply open their collection. At the same time, I also tag events and sometimes even objects. For example, my dad's birthday I will tag with:

Year, Birthday Dad, Dad's Name

Thereby I can pull up specifically his photos, or photos of the event. This allows me to keep my photos organized in folders by date, but still have individual events tagged, and individual people.

I also have a lot of photos of my sister's twin babies. All babies already look identical, it's even harder when they're actually identical. I would like to be able to use a location tag, and tag each individual twin with their proper name so that 20 years from now I can go back and confidently say who is who.
Photo of Kent Green

Kent Green

  • 4 Posts
  • 0 Reply Likes
Hi Eugene;

I understand how keywords and tags could work, but...keywords do not help when there are already thousands of photos without tags in the application database. Face recognition would be a fantastic tool for making the first cut at sorting the archive, and then additionaly applying names and keywords.

Kent Green
Photo of Gary Kohls

Gary Kohls

  • 3 Posts
  • 2 Reply Likes
I have approaching 20K photos in Photoshop Elements. I've face tagged many of this pictures because it allows me to identify individuals in group shots. In some cases, I've taken my computers to family events and gotten assistance from older relatives in identifying people in early 20th century pictures. I'd love to upgrade to Lightroom but will not walk away from face tagging as it is a critical part of my photo archiving activity. Changing to Lightroom is a non-starter until it can preserve all PSE metadata.
Photo of Dirk Lenzkes

Dirk Lenzkes

  • 7 Posts
  • 0 Reply Likes
This reply was created from a merged topic originally titled
Face detection in Lightroom.


This is more a vote-for than a new idea I guess. I'd really like to see this feature in Lightroom. Good examples are products such as iPhoto or Google Picasa.
Photo of Douglas Ansel

Douglas Ansel

  • 8 Posts
  • 0 Reply Likes
At the very least, at least add the ability to show embedded XMP-MP data (which I believe Adobe jointly developed with Microsoft for person metadata in photos...)
Photo of seanhoyt-dot-art

seanhoyt-dot-art

  • 340 Posts
  • 55 Reply Likes
RIGHT! My Nikon D4 already has found faces in my shots. It's there. LR just has to read it. Then LR could let me 1:1 zoom on each face in the shot for quick inspection. That's all I want, Adobe.
Photo of Justin Kling

Justin Kling

  • 8 Posts
  • 2 Reply Likes
So there are 2 issues here:
1) image region metadata- implement this immediately. You (Adobe) decided on a standard in Nov 2010. It's useful for tagging people (Grampa, Grampa's brother Chuck), items (Grampa's childhood tricycle) and location information that isn't obvious from GPS data (the house Grampa grew up in).

We as a society are taking, editing, sharing, archiving, whatever-ing photos at an astonishing rate. If we want all these pictures to be anything other than digital garbage to peers and future generations, we need to identify what we're taking pictures of in ways that our audience (family, friends, clients, students, historians, colleagues, etc) can use.

If I were Adobe, I wouldn't let an employee write code for any other feature until this was implemented. The standards and framework have been in place for years. JUST DO IT.

2) facial recognition- the holy grail of image region metadata is, I'm sure, for it to intelligently tag itself with relevant information. Users shouldn't have to manually identify Grampa, the software should just identify Grampa automatically. That's a great idea but it's a bonus that makes image region metadata quicker and easier to apply. I'm sure Adobe is working on this and I'm sure they want it to be excellent but in the mean time PLEASE give me the ability to tag faces manually while you work on how to do it automatically.
Photo of Medwyn

Medwyn

  • 18 Posts
  • 0 Reply Likes
Love both of these ideas.
Photo of Rick Tucker

Rick Tucker

  • 12 Posts
  • 4 Reply Likes
I'm certainly hoping that Adobe implements region metadata tagging soon in LR. That said, they haven't fixed a problem in DW that I reported nearly two years ago, that worked quite fine for my many HTML files for dozens of years previously with lotsa tables that I readily edited with DW. In the past year, every time I try to edit an HTML file with a large table, DW becomes nonresponsive, on the fastest Mac that exists and with the most memory, when I try to edit HTML files in DW with lotsa tables. Again, I reported the problem over a year ago. Adobe responded saying that the problem was with OS X (Mavericks at the time, though I have upgraded to Yosemite the latest.) I'm no longer using DW for this. I am now converting my large tables to a MySQL database with PHP queries. That should not be necessary. I don't even need DW for my new regime. Sadly, I say. My HTML and so forth that worked really well for a dozen years can no longer be edited by DW; DW slows down so much to be unusable. And now it doesn't work at all. This is a reverse of Moore's Law. The more I want my solution to work, the less it does. Hence, my need to abandon the solutions (Adobe Dreamweaver and tables) that worked so well for me for a dozen years, but no longer. I have an entire website that has worked seamlessly with old-style tables that DW now just simply sends my high-end Mac into a catatonic state. As noted, I have relied on DW to prepare and support this site for a dozen or so years. However, DW no longer has any value to me. DW freezes when I try to edit an HTML file with a table of several hundred items, and hence is unusable. I could say more but I would be wasting my time. And Adobe has not been responsive to me. I have paid to the hilt to Adobe for CC in the past couple of years, and yet on this DW front it has been totally unusable to me since DW in unable to edit even the most basic HTML files with tables that I have been very successful and happily editing over many years. Sorry for the diatribe, but Adobe has not recognized the problem here.

- Rick
Photo of Kent Messamore

Kent Messamore

  • 49 Posts
  • 29 Reply Likes
I agree. We need the ability to recognize faces in Lightroom or at least bring face tags over from Photoshop Elements.
Photo of Thales

Thales

  • 4 Posts
  • 2 Reply Likes
This reply was created from a merged topic originally titled Face Recognition Sub-System.

Hello,

There have been a lot of talk about a face recognition option under the Abobe umbrella.
It looks that all request don't have a proper answer or solution besides an external plug-in for lightroom.
With that in mind, and looking to enhance the utility of Adobe applications I would like to know the reasons for ignoring those demands. Maybe is a technical or license problem, or maybe it have not yet catch the attention of Adobe, or it's a secret to be revealed in the future.
In any case someone has to come up with a proper explanation. It doesn't matter the in which direction it will come, but I, has a long time customer, deserve the right to know if this viable or not to Adobe.
Thank you
Photo of Kent Messamore

Kent Messamore

  • 49 Posts
  • 29 Reply Likes
I agree. Facial recogniction would be a very valuable addition to lightroom.
Photo of Bob

Bob

  • 6 Posts
  • 0 Reply Likes
I have both Elements with face recognition and Lightroom 5 which I guess does not have it. Does anyone know if I tag faces in Elements first is there any way to update that data to Lightroom if I am referring to images that were previously imported?
For example if I exported a large group of images from Lightroom, then imported them into Elements, used facial recognition and then imported them back into Lightroom, would Lightroom catchup or just create a bunch of duplicates.