Lightroom CC: User contributions to enhance Sensai image recognition

  • 9
  • Idea
  • Updated 9 months ago
  • (Edited)
Whenever the search in Lightroom CC does not find any applicable results, offer the possibility to suggest photos you would have seen relevant. 

Of course it might be tricky for users to respond with what they are searching for, but it would be witty to add a sense of gamification and machine learning to Lightroom CC's (Sensai) search functionality. It would at least increase my sympathy to it, since I would know that manually categoritzed photos would now also get found.
Photo of Lukas Ziegler

Lukas Ziegler

  • 7 Posts
  • 1 Reply Like

Posted 9 months ago

  • 9
Photo of Barry Young

Barry Young, Director of Engineering, Lightroom products

  • 56 Posts
  • 53 Reply Likes
This is something we are looking into to make search more intelligent than it is today. Can you give a real world example of what you would expect in the failure vs. suggested search terms results? 
Photo of Lukas Ziegler

Lukas Ziegler

  • 7 Posts
  • 1 Reply Like
One idea is to use the Keywords (K) panel to show with which Sensai attributes an image is associated (like in the Sensai/Photoshop prototype showcased at MAX).

Another thought is to use the "404 page" of Lightroom's search for motivating the user to refine the search results. One idea would be to gamify the failure screen, allowing users to tag images which currently can't be categorized with a high accuracy yet.

My concrete use case was that I was looking for a photo with a book on it. At first searched for "Book" without a result, then "Buch" (in German), since I'm still not sure whether Sensai searches in the language of my IDE, or whether it is English only. Since I knew that I have a photo with a book on it, I would now be willing to tweak LR for delivering the right results in the future. What I did was to add the respective keyword to the image.

So my third suggestion is to translate the search input and the keywords from the users, in case languages get mixed.
Photo of Barry Young

Barry Young, Director of Engineering, Lightroom products

  • 56 Posts
  • 53 Reply Likes
These are good points. We actually deliberately hide the auto-tagged keywords from the keywords panel since it might be overwhelming for users to see the data. But I have heard this feedback before so it's something for us to consider.  The search does support localized keywords for the auto-tags. Translating the input is an interesting idea.
Photo of Jao van de Lagemaat

Jao van de Lagemaat

  • 175 Posts
  • 47 Reply Likes
I would love to see the auto tags somewhere and be able to suggest corrections where it is way off
Photo of Mike Dunford

Mike Dunford

  • 31 Posts
  • 9 Reply Likes
I kind of like the "gameify" idea (although it might not be well-supported by the professional photographers). I'm a simple sort, easily motivated by badges and similar, which has probably resulted in me doing far more Google Maps stuff (as part of their "Local Guides" thing) than I otherwise would have. 

Failing that, the "mark as irrelevant" option would be a huge help, particularly if the search remembers that for the marked images. For many searches, marking irrelevant results would be fairly quick for individual users. (I did my own search for "book" and got 104 results. 9 of the top 10 are correct, most of the rest aren't, but could be marked as irrelevant in less time than it took me to compose this reply.

Another suggestion might be to make the auto-tagged keywords available either to selected users or on an opt-in basis. I know I'd be willing to participate in something like that. 
Photo of Morten Mitchell Larød

Morten Mitchell Larød

  • 18 Posts
  • 7 Reply Likes
Could we mar images not relevant and be given the option "Not relevant"?
Photo of Barry Young

Barry Young, Director of Engineering, Lightroom products

  • 56 Posts
  • 51 Reply Likes
Yes, this is a very popular request! Training the search machine based on user input is on our list of things to support.