Lightroom: Allow facial recognition feature to re-index a folder/collection

  • 164
  • Idea
  • Updated 7 months ago
  • Implemented
  • (Edited)
Currently it is not possible to invoke a re-indexing of facial recognition data at either the global or folder/collection level. For my purposes re-indexing at the folder and collection level would be sufficient.

Reason: when a face is removed from a previously indexed image it is not possible to automatically recognize faces other than reviewing many images and manually applying a face region.

See this forum discussion: https://forums.adobe.com/message/7472...
Photo of Wolfgang Eilers

Wolfgang Eilers

  • 51 Posts
  • 1 Reply Like

Posted 4 years ago

  • 164
Photo of Andreas Giordano

Andreas Giordano

  • 1 Post
  • 0 Reply Likes
Same for me. I need this function !!
Photo of Laurent

Laurent

  • 1 Post
  • 0 Reply Likes
Hello, it would be really helpfull to have this fonction allowed !
Photo of Robert Frost

Robert Frost

  • 427 Posts
  • 73 Reply Likes

If you flip your images horizontally, you can get LR to start indexing again, and it does find some missing images. When it has finished just flip them all back again. The faces flip back as well.

But to re-index a folder from scratch again, perhaps because like me you have accidentally deleted some faces, is more complicated. It can be done as I've just done it on a folder of 6000 images, part of a 100K catalog.

Step 1 is to backup the catalog, twice if you are of a nervous disposition!

Step 2 is to select the images in the folder you want to re-index from scratch, and export them to a new catalog (without originals or previews - you just want the data in the catalog)

Step 3 is to download a browser that allows you to look at and edit tables in the catalog. I use DB browser for SQLite < https://github.com/sqlitebrowser/sqlitebrowser/releases>

Step 4 is to open the new catalog containing the images to be re-indexed with the browser (NOT with LR ).

Step 5 is to find the tables in the browser that pertain to face recognition. I found four containing face info

Adobe_libraryImageFaceProcessHistory

AgLibraryFace

AgLibraryFaceCluster

AgLibraryFaceData


Step 6 is to delete all the lines of info in these tables. Just select all the lines in a table in the usual way and then click on delete at top right. Repeat with the other face tables

Step 7 is to save the edited catalog without the face info, and exit the browser.

Step 8 is to open LR with your main catalog, and remove the contents of the folder you are about to reimage. Remove the files from the catalog, NOT from the disk. This process can take some time. I watched it using the Performance monitor in win10, because although deleting the images from the catalog is more or less instant, deleting the previews is a more lengthy affair which seems to occur when LR feels like it.

Step 9 is to import the images from the edited catalog without face info back into your main catalog, where they will replace the ones you have just removed that had face info.

Step 10 is to tell LR to make new previews for these imported images (all your editing data is still there - you have not lost it), and then to start face recognition on this folder.


I have just done this and all my faces of named and unnamed people are now back; the main catalog passes the LR integrity test and I'm now back where I was yesterday before I accidentally removed all those faces.


It would of course be easier if Adobe coded this for us!


Bob Frost


Photo of xprs

xprs

  • 8 Posts
  • 13 Reply Likes
I appreciate all the effort the above response entailed but....This is a conceptually simple process: Select files that need the facial recognition reset, then reset, then do a new scan. The above description of 10 steps and accessing tables and such is way too complicated. This complication should not be visible to the user.

When facial recognition was introduced, I processed my catalog (130,000) files. At that point, facial recognition was so bad, most of the results were junk. Since then facial recognition for new photos seems a lot better. I need help resetting or re-indexing without needing to know where LR stores tables and stuff and following 10 steps.
Photo of Terry Moore

Terry Moore

  • 2 Posts
  • 1 Reply Like
This is an important feature that needs to be implemented.
Photo of Anthony Edge

Anthony Edge

  • 91 Posts
  • 8 Reply Likes
I recently imported my 80,000 photo library. Things were progressing well until I discovered whole folders and many images (5000) were "unable to be found". Doing a search for missing images and manually reconnecting each folder, fixed many issues, but now none of these 5000 photos have any facial recognition and there's no way to initiate it. They were skipped (because they were missing, even though the paths were correct), so that's it. No 2nd chances! This is madness.
Photo of Andreas Amrein

Andreas Amrein

  • 7 Posts
  • 0 Reply Likes
Recently I tried the trick to
(1) "select all the images"
(2) "flip them horizontally" 
(3) "run the face recognition
(4) flip back (the recognized faces stick)
Like this was able to find by the thousands, but still not sure got all of them...
Photo of Anthony Edge

Anthony Edge

  • 91 Posts
  • 8 Reply Likes
Can you describe the actual tools/menus you used to do this? 
I can't see how to flip multiple selections,or "run face recognition".
Thx
Photo of Andreas Amrein

Andreas Amrein

  • 7 Posts
  • 0 Reply Likes
(1) You select the folder or group of pictures you want to scan by simply clicking on them
(2) In menu "Photos" you click "Flip horizontal"
(3) You select the "box with face" on the lower bar (this will start looking for faces, where you confirm the names, rename or discard
(4) (when done) in menu "Photos" you click "Flip horizontal" again, et voilà...
Photo of Ray Toscano

Ray Toscano

  • 12 Posts
  • 7 Reply Likes
This feature request has been around 2 years and Adobe hasn't yet added such basic control?! REALLY?

I imported 100K photos and Lightroom CC crashed half way through the face recognition. Now I can't get it to re-scan the the appropriate folders to fix this.  Vary frustrating.
Photo of Andreas Amrein

Andreas Amrein

  • 7 Posts
  • 0 Reply Likes
Yes, they don't stand out for listening to the customers and caring about even such simple things. 
Try me solution posted two months ago with the "flip horizontal" approach. I was able to solve it all. Also would suggest not to do all 100k in one go, but break it down by one folder or group of folders at the time? Good luck.
Photo of Ozgur Guney

Ozgur Guney

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Please add "Reindex Face Recognition" to LR6.

Face Recognition cannot be reset for removed photos from Face Recognition list. Please add Reindex Face Recognition command to the menu
Photo of staylor15

staylor15

  • 2 Posts
  • 3 Reply Likes
Adobe, please implement this feature.  It's been a long time coming.  It's time.

I accidentally removed a large set of face regions (an entire person) when trying to clean things up (because there are so many poor matches in face recognition).  Because my mouse clicks / keyboard commands were lagging behind by 15-30 seconds depending on what I was doing (I have a lot of pictures but clearly Lightroom has performance issues), I apparently removed a "person" that I REALLY want back.  This particular person (the face regions identified for this person) was found around 8000 times in my photos (that I spent hours assigning and correcting the face assignments) and now it shows 35.  I clearly multi-selected a huge amount of face regions that I shouldn't have (again, LR was processing my commands with a 15-30 second lag time).  I want to undo this (but I'm not sure how it happened and it is no longer in my undo queue.

PLEASE ADOBE...  I WANT TO RESCAN A SET OF FOLDERS TO GET THIS PERSON BACK!!!  THERE IS NO WAY I AM DRAWING 8000 FACE REGIONS MANUALLY.  That's really not a "workaround".

Adobe - I get it.  I screwed up.  But Lightroom isn't really making it easy for me and I can't seem to fix this.  

Can someone from the Lightroom team simply reply to this thread so everyone isn't left in the dark feeling like we are being completely ignored?  Just a bit of customer service would be greatly appreciated.
Photo of Andreas Amrein

Andreas Amrein

  • 7 Posts
  • 0 Reply Likes
Hi staylor, I had the same issue with the lagging and even the crashing on a fully updated high-powered Mac....
My solution was to select all photos (ok do by folder if you have several thousand like me), flip all horizontal. run the face recognition, assign the faces and then flip it back. 
Was able to regain a few thousand like that but not sure it's all of them....at least something. 
Normally Adobe should get their act together (this has been pending for years) and simply modify the function to
(a) Keep the assigned faces
(b) reopen all the unassigned ones.
Should not be too difficult....if you care.
Photo of DJ

DJ

  • 6 Posts
  • 6 Reply Likes
Sadly adobe has the worst facial recognition in the industry. Amazon, Apple, google, all figured it out. I think Adobe developers have been lagging behind for quite some time and the more features others implement the more we see their lacking.
(Edited)
Photo of somehume (4sq SU2)

somehume (4sq SU2)

  • 2 Posts
  • 0 Reply Likes
Does Adobe actually read these forums? We're now 2 years out and facial recognition in Lightroom is still crap. Meanwhile, Google previously in Picasa and now in Google Photos has facial recognition that could cause the CIA to increase their budget for Kleenex. Even Facebook has decent facial recognition. The truly sad thing is that both of these are free-to-user products.

Come on Adobe, you can do it!
Photo of remove_b4_flight

remove_b4_flight

  • 87 Posts
  • 12 Reply Likes
I want Lua plugin interfaces for face recognition because already people in my photos named as caption.
If Lightroom could use this database, makes large efficiencies at face recognition for future shoot.
(Edited)
Photo of Ed Beck

Ed Beck

  • 1 Post
  • 0 Reply Likes
I just imported 6000 family photos and ran facial recognition on them. Now I find I have to go back and make sure that all the photos are properly tagged. About 25% are not tagged properly. I really wish I could re-scan instead of going through them one-by-one to make sure they're tagged.
Photo of Mick

Mick

  • 5 Posts
  • 1 Reply Like
I've just tried the flip photo suggestion in Lightroom Classic CC 7.2 without success (first tried horizontal flip and then vertical flip when horizontal failed) but neither worked.
Whats the point of Adobe putting automatic facial recognition as an option in a program when you can't rerun it on a set of photos?
Adobe seems to be recommending that we all get RSI (Repetitive Strain Injury) by manually selecting each photo and individually tagging them :-(
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
Is there an update on this?  I haven't seen anyone from Adobe chime in on this thread as I have on many, many others. 
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
I would also like to bring this "idea" post to folks attention as a few ideas how to improve the feature even futher than just a re-index command. 

https://feedback.photoshop.com/photoshop_family/topics/people-view-progress-bar-button
Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1606 Posts
  • 529 Reply Likes
Please check out the next Lightroom update.
Photo of Terry Moore

Terry Moore

  • 2 Posts
  • 1 Reply Like
What do you mean the "next" update?
Do you mean the latest update? Ot the one that hasn't been released yet?
Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1606 Posts
  • 529 Reply Likes
By "next", I meant the yet to be released Lr 7.3.
Photo of xprs

xprs

  • 8 Posts
  • 13 Reply Likes
thanks, hope it works. it would be about time.
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
Where should I be looking for the planned features of the next update?  Is there a website with this listed. 

Also Simon, I have a lot of men with facial hair changing over time and also a good number of African Americans in my photos. If you were interested, I would love to talk about the handling of these images. 
Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1606 Posts
  • 529 Reply Likes
Official Response
Lightroom 7.3 is now available https://feedback.photoshop.com/photoshop_family/topics/lightroom-classic-7-3-is-now-available

This version of Lightroom contains a much improved face engine and the ability to re-index photos for faces. See 
https://helpx.adobe.com/lightroom/help/face-recognition.html#find-faces-again for details.

Cheers,
Photo of DJ

DJ

  • 6 Posts
  • 6 Reply Likes
Wahoo! I can't wait to try this tonight!
Photo of Larry Colen

Larry Colen

  • 27 Posts
  • 7 Reply Likes
Unfortunately, this does me no good whatsoever as I refuse to switch to the subscription version of Lightroom.
Photo of Jean Barrell

Jean Barrell

  • 10 Posts
  • 7 Reply Likes
Any chance of adding this to Lightroom CC?
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
This reply was created from a merged topic originally titled Lightroom Classic People View — Rescan Feature at folder, subfolder, and image le....

The community has been requesting a rescan faces feature for 4 years now... Can someone please comment on the timeline for this functionality?

If you are a people view user and want this feature, please support this thread and the original one located here: https://feedback.photoshop.com/photoshop_family/topics/lightroom-6-cc-allow-facial-recognition-featu...



Photo of John R. Ellis

John R. Ellis, Champion

  • 4528 Posts
  • 1211 Reply Likes
The Find Faces Again feature was implemented in LR 7.3: 
https://helpx.adobe.com/lightroom/help/face-recognition.html#find-faces-again

Is there something you want that this command doesn't do?
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
Yes, it's not "suggesting" matches for vast swaths of my database. So if I have a group of five people, one of whom I know. The other four will just sit there. If I meet them a year later, I have to explicitly search past photos for them. It doesn't go back and suggest "backwards" as it were.
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
I don't want to re-index by drawing the boxes better. I want to re-index by getting suggestions for people added to the database before the keyword was linked to a picture. About 1/3rd of my currently "unnamed" people have no suggestion for who they may be and there are pictures that are near exact duplicates taken seconds apart that it doesn't even "suggest" the person keyword, let alone match and group them into a stack.
Photo of John R. Ellis

John R. Ellis, Champion

  • 4528 Posts
  • 1211 Reply Likes
"I don't want to re-index by drawing the boxes better."

The Find Faces Again command re-runs the face recognition (suggested names), not just redrawing the face rectangles.   

"About 1/3rd of my currently 'unnamed' people have no suggestion for who they may be and there are pictures that are near exact duplicates taken seconds apart that it doesn't even 'suggest' the person keyword, let alone match and group them into a stack."

If face recognition is not working well for you, it would be best to start a new topic (a bug report), since this topic is about re-running face recognition, and that feature is implemented.
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
John, here's a scenario...

I took photos of a group with 10 people in it, two of whom look somewhat similar. A colleague helps five of the people including the two similar ones. If I were to run "re-index" on this image and it redraws and makes new suggestions for all ten people. How would I distinguish which one was which?

Additionally, I shouldn't have to relabel 27,000 faces to get new suggestions on the remaining 7,000.

To me this re-index feature is somewhat useless and does not address the problems that I've seen occurring or those that others are describing.
(Edited)
Photo of John R. Ellis

John R. Ellis, Champion

  • 4528 Posts
  • 1211 Reply Likes
"I shouldn't have to relabel 27,000 faces to get new suggestions on the remaining 7,000."

Agreed.  That you have 7000 faces that LR isn't identifying is a serious issue that should be in a separate topic.

But this feature request (and the thread in the user forum that motivated it) was about very specific, narrow functionality: Re-running the the face indexing/matching on a photo after you've deleted face rectangles from it. Originally, that wasn't possible. Now, with the Find Faces Again command, it is. 

The Find Faces Again command also helps some users upgrade to the new algorithm introduced in 7.3: "If you've previously run face-detection manually on your photos, perform the steps recommended below to upgrade the existing face records in your catalog to the new face engine. ... The steps listed below are not required if you have enabled the Automatically Detect All Faces In All Photos option in Catalog Settings."

But Find Faces Again just reruns the existing algorithm.  If the algorithm didn't find matching faces the first time around, rerunning it won't make it any better the second time.
(Edited)
Photo of Phil Cochetti

Phil Cochetti

  • 29 Posts
  • 1 Reply Like
John, yes, I posted a thread about it 11 months ago that is unanswered.

https://feedback.photoshop.com/photoshop_family/topics/people-view-progress-bar-button

THe post that I added two days ago about this issue was merged to your re-index feature and it doesn't handle my issue!

https://feedback.photoshop.com/photoshop_family/topics/lightroom-classic-people-view-rescan-feature-...


Photo of John R. Ellis

John R. Ellis, Champion

  • 4528 Posts
  • 1211 Reply Likes
"The post that I added two days ago about this issue was merged to your re-index feature and it doesn't handle my issue!

https://feedback.photoshop.com/photoshop_family/topics/lightroom-classic-people-view-rescan-feature-..."

That post was merged with this topic because it was requesting the same feature as this topic (and referenced this topic).  Why topics get merged: 
https://feedback.photoshop.com/photoshop_family/topics/making_auto_import_simpler?topic-reply-list[s...


Photo of John R. Ellis

John R. Ellis, Champion

  • 4528 Posts
  • 1211 Reply Likes
"I posted a thread about it 11 months ago that is unanswered. 

https://feedback.photoshop.com/photoshop_family/topics/people-view-progress-bar-button"

Adobe tends to prioritize and respond to the topics that get the most replies and votes.

But neither of these posts directly mentions what seems to be the most serious concern, that you have thousands of photos that aren't getting good suggestions.  That deserves a separate topic directly describing those symptoms.