PL4.3.6.32 Ghosting Ratings for Same image in different directories (Win10)

No it doesn’t. Yet another difference between Windows and Mac :crazy_face:

I can’t as I don’t pay rent for software that isn’t as good at editing images as PL5 :wink:

If this what Lr does, it makes for a very good reason not to use it. Being compatible with Lr doesn’t mean that PL has to copy what they do. DxO should rather lead the field in excellence in metadata handling rather than sinking to Adobe’s poor and confusing level.

2 Likes

@joanna I am a little concerned that I have not fully understood the rules that you are proposing!? During Beta testing this was mostly new to me, I had never used a hierarchical keyword in my life so the way that I went about testing was to compare various programs and the way that they handled various scenarios to see if I could understand the logic.

I restarted that process in the my post above; I was always concerned about mixing PL5 with its “apparent” obsession with ‘hr’ keywords (subject) with ‘dc’ only programs, Adobe Bridge in this test.

So I used one program IMatch to compare the results with PL5 and also to see how your proposals stack up against what these programs are doing with the data. The comparison is Test 2 - animal|mammal|bear and Test 4 - animal, mammal, bear and animal|mammal|bear all explicitly added by the user (me), principally to see what happens!

One problem I had back in Beta testing was that using this approach threw up more inconsistencies than I expected, if we add your proposals then things get even more complicated. So for test 2 we have

                                     IMatch                      PL5

   Subject                      animal|mammal|bear         animal, bear, mammal
   Hierarchical Subject         animal|mammal|bear         animal|mammal|bear

IMatch fails to include the flattened keywords in the ‘dc’ Subject which PL5 has included but PL5 leaves out the hierarchical key from the Subject field and, as a consequence ‘dc’ only programs have no sight/idea of the hierarchical nature of the keywords!

Surely for compatibility the Subject must also contain animal|mammal|bear? Hence, in this case shouldn’t the keywords be Subject = animal, mammal, bear, animal|mammal|bear and HR Subject =animal|mammal|bear?

When we get to Test 4 with the “overloaded” set of keywords we have


                                      IMatch                         PL5

   Subject                      animal, mammal, bear         animal, mammal, bear
                                animal|mammal|bear             
   Hierarchical Subject         animal, mammal, bear         animal, mammal, bear
                                animal|mammal|bear           animal|mammal|bear

Based upon your “recommendation” you would suggest that the flat keys have no place in the HR Subject (it does make sense) but I would suggest that animal|mammal|bear should be present in the Subject field to maintain compatibility with ‘dc’ programs. During Beta testing I declared such a key in Bridge and by the time that PL5/LR had finished with the photo the displayed photo in Bridge no longer had the (hierarchical) keyword that Bridge had assigned to it!!??

The other comparisons that I can make show what an absolute “pig’s breakfast” this area is, we may criticise DxO for not getting it “right” (and they had plenty of expertise to tap into) but I am not impressed with what some of the other programs are doing with keywords either! I am not a standards expert but when I see a keyword “vanish” from Bridge I feel that something has gone very wrong!

A league table of what is in the photo after each of the programs has finished putting in the test data. Test 03 is left deliberately blank just in case I need another JPG for a further test.

What is the “right” way to populate the Subject and HR Subject is what we are now discussing in this topic.

I have not included IPTC in the spreadsheet which I can on request (please send bitcoin to the value of …)

As a great friend from the southern US used to say - “Thar’s yer prawblem” :laughing:

I awoke at around 5:00 this morning, thinking about this, and had to do some research there and then. As a result, I think may have discovered an explanation for the differences you are seeing.

I am now fairly much convinced, but couldn’t find a definitive reference, that adding “composite” keywords to the dc:subject tag may have come about at a time when somebody wanted to, somehow, record hierarchy before Adobe introduced the lr:hierarchicalSubject tag.

From what I can see, apps like iMatch and PM try to be compatible with that practice, even though it was no longer necessary with the arrival of the lr:hierarchicalSubject tag.

I’m not sure what you mean by “dc only programs”

Adobe Bridge is definitely not a “dc only” program, it both reads and writes the lr:hierarchicalSubject tag.

PL5 tries its best to be MWG compliant and is correct in not writing composite keywords to the dc:subject tag. The only minor niggle that I find with PL5’s writing of lr:hierarchicalSubject is that it sometimes writes non-hierarchical keywords as well.

To my mind, adding such composite keywords to the dc:subject tag should be regarded as a defunct and purely legacy requirement and, upon finding such, any decent app should update them by moving them to the lr:hierarchicalSubject tag.

I will stick my head above the parapet and dare to say that any app that does write composite keywords to the dc:subject tag is not adhering to MWG guidelines and should not be relied on.

On the other hand, PL5 needs to “tidy up” what it writes to lr:hierarchicalSubject, omitting purely non-hierarchical keywords.

Absolutely. It goes against MWG guidelines.

And I would have to disagree if PL5 is to be seen as a “correct” manager of keywords. Which isn’t to say that PL5 shouldn’t read and convert such into its correct form. If a “dc only” app can’t cope with that, it is that app that is at fault, not PL5.

I did try PM for its free trial period and, from what I remember, it could read lr:hierarchicalSubject. I can’t say for iMatch but, if it can’t, I would regard it as deficient and not MWG compliant.

Maybe during beta testing, but now, assigning my test hierarchies in Bridge gives me an XMP file with…

   <dc:subject>
    <rdf:Bag>
     <rdf:li>Satsuma</rdf:li>
     <rdf:li>Orange</rdf:li>
     <rdf:li>Fruit</rdf:li>
     <rdf:li>Couleur</rdf:li>
    </rdf:Bag>
   </dc:subject>
   <lr:hierarchicalSubject>
    <rdf:Bag>
     <rdf:li>Fruit|Orange|Satsuma</rdf:li>
     <rdf:li>Fruit|Orange</rdf:li>
     <rdf:li>Fruit</rdf:li>
     <rdf:li>Couleur|Orange</rdf:li>
     <rdf:li>Couleur</rdf:li>
    </rdf:Bag>
   </lr:hierarchicalSubject>

… and PL5 picks that up perfectly as…

Capture d’écran 2022-01-13 à 11.32.39

… even though Orange is duplicated in the keywords field.

Even with the matter of an abysmal and cramped UI for keywording, I would say confidently that I would rather use PL5 over any of the others that you have talked about because it is the lost MWG compliant. If the other apps you have tested can’t read what PL5 writes, then they are wrong.


N.B. Since the release of PL5, the integrity of keywording has improved on what it was during the beta, but I would still take the recommendation to try and stick to a single metadata manager rather than move back and forth between them. This becomes even more important in the light of your findings.


N.B.B. Don’t ever use composite keywords in the dc:subject tag. It is apps that allow this that are the source of a lot of the headaches people are finding with compatibility, not PL5, which is “almost” MWG compliant.

1 Like

Here is your table “marked” for correctness :wink:

The HR subjects marked as wrong in Test 01 are because those apps are unnecessarily, but not necessarily wrongly, adding non-hierarchical keywords to the HR subject. In any case, adding them will not cause problems for searching or transmission of hierarchical data.

For Test 04, the first three are marked wrong for the same reasons as Test 02 - adding of composites to the Subject is incorrect. The last two are “sort of” right and, as with Test 01, there is nothing that should affect either searching or transmission.


Side note

PL5 seems to search based on HR subject. This might not be strictly wrong but it does restrict results and make predicates harder to define. All searches should be based on Subject alone.

I’m not sure if I understand the first part of the statement: I find DPL5 metadata in .dop sidecars, no matter if virtual copies are present or not. This would mean that metadata is written to .dop sidecars unconditionally in order to provide MD to virtual copies that might (or might not) be added later, even if the database had been deleted in the meantime. Note that I have no problem with that.

I do propose that DxO also read such MD from the .dop sidecars in order to restore or complement info to the database. If MD were also present in the image file or .xmp sidecar, some kind of dialog should appear to let the user select what action should be taken.

Imo, a sync warning (@BHAYT) is no valid solution in a world of more than one app editing metadata. Simply overwriting MD read from whatever source has been prioritized by someone who is not the user is not a decent way to act either.

Update: Check this out: PL5 Tag Field not read from .dop file - #37 by Musashi

1 Like

@Joanna sorry about “causing” you to wake up early and be so “rivetted”/“inspired”/“puzzled”/“cross” (delete or add or replace as appropriate) that you could not get back to sleep. The central heating has had the same effect on me! Finally having plumbed the central heating into the mains water supply (via an appropriate non-return valve) we flushed the system out (and pushed up the water bill) because the new pump was still not coping.

One bottle of X800 cleaner later and slowly, slowly the heat started reaching the farthest parts of the bungalow, just in time because we had a hard frost last night. Today/tomorrow the X800 has to come out to be replaced by X400 cleaner which can stay in for 1 month!

I just updated to the latest version of Bridge 11 (not Bridge 12) on the test machine and that has only ever used ‘dc’ fields, at least in all my tests!? Zoner also still seems to stick to ‘dc’ fields even when inputting an hierarchical keyword. By this I mean that those programs only set ‘dc’ fields and only display from ‘dc’ fields. I am currently downloading the latest version of Bridge and when that is installed I will retest and update the post and the table as appropriate.

I understand that now and I am “sorry” for being such a “naughty” tester but if programs that are on the market only use ‘dc’ fields and start using the hierarchical keywords it certainly looks “weird” when the keys you entered vanish after a “visit” to LR or PL5 or …

Sometimes ignorance of the accepted way of how things work is actually an “asset”, it leads to discovering the oddities that those only treading the right path can miss!

I think there will be problems with users of older products that might be disappointed except that the chances are that they will never have used hierarchical keys!?

I think that you meant “it is the most MWG compliant”.

Understood and I discovered that they could be added just by experimenting but if there are any real users out in the world then …

An updated version of the table, if any one wants the spreadsheet I can make it available and they can add Photo Supreme, Capture 1 or whatever!

Can you post a link to a share?

@platypus try this Dropbox - Public - Simplify your life it is an xls file and please tell me if it downloads successfully.

Added listing for C1 and DPL5 (Mac).
meta data setting _01-B.xls.zip (3.1 KB)

Notation is a bit different, but more accurate imo. Change as you think you should…

Note that

  • DPL5 reads C1’s keywords correctly.
  • LrC only displays “bear” as keyword from DPL .xmp sidecar. LrC’s notation of hierarchical keywords is similar like DPL5’s.

New in Lightroom: lr:weightedFlatSubject

@Joanna I have read the details about setting hierarchical keywords in Bridge. I have downloaded the latest version on my main machine but no matter what I set I cannot get Bridge to write anything but ‘dc’ fields!!

I set the keywords here:

and have not found any other field that looks a likely candidate!

@platypus I did amend your fine work but also left it intact. I wanted to see the keywords without the added xmp “stuff” they were “confusing” an old man, i.e. I “could not see the wood for the trees”. So here is your version slightly altered;

and I have attached the spreadsheet here Copy of meta data setting _02.zip (12.3 KB).

What is the intended purpose of lr:weightedFlatSubject?

Expressions in square brackets are like opening and closing brackets (the one with the /) and x stands for the content that is packed between the brackets. That’s not too complicated, is it.

I have no idea what the new tag is about, it’s new in LrC11. Phil Harvey knows about the new tag(s).

attn. @Joanna and @sgospodarenko

Sorry, I missed the last 24 hours of discussion on this topic (wrong TZ/other things going on).

@BHAYT - I saw your post PL4.3.6.32 Ghosting Ratings for Same image in different directories (Win10) - #73 by BHAYT, but I didn’t understand how you originally generated the dc:subject and hierarchical keywords in your examples (i.e., in which program(s)).

Regarding IMatch specifically, your findings don’t match what I see. I have a NEF raw image for which I used IMatch to add the hierarchical keyword ‘animals|mammals|bear|black bear’ (to the attached XMP sidecar, not the NEF). _DSC0388.xmp (7.5 KB) Note that IMatch records the hierarchical keyword as ‘animals|mammals|bear|black bear’ and dc.subject as:

dc:subject
rdf:Bag
rdf:lianimals</rdf:li>
rdf:limammals</rdf:li>
rdf:libear</rdf:li>
rdf:liblack bear</rdf:li>
</rdf:Bag>

This is as I would expect. Note especially that dc.subject generated by IMatch doesn’t include a hierarchical keyword, again as I would expect, but your example for IMatch showed otherwise. This is why I would like to see how you generated your examples.

I then processed the NEF in PL5. In its Metadata section, PL5 shows only ‘black bear’ in the Keywords tag. In the Keywords section, it shows:

animals
mammals
bear
black bear

I then did an ExifTool dump of the output jpg metadata (ExifTool dump of PL5 output jpg.txt (22.0 KB)
). The only keyword it contains is ‘black bear’ in [XMP-dc] Description (i.e., in dc-subject) and no reference to hierarchical keywords. As has been discussed elsewhere here, the hierarchical nature of the keywords has been completely lost in the output image. PL5 may retain these in its database for the raw NEF, but it’s disconcerting for it to have lost them in the output image! To do so seriously interferes with any efforts to comprehensively manage keywords.

[In addition, PL5 has added an entire Legacy IPTC section to the output file that did not exist in the original NEF/XMP! That’s a problem, although outside this discussion.]

@BHAYT - To recap, given the number of program you’re testing for metadata handling, it’s important to know the processing sequence(s) that you used in your examples, particularly the program(s) used to originally generate the data. I do appreciate the effort you’ve been putting into this.

@jch2103 I will read the post properly later and check my results but most of the programs were run stand-alone, no simultaneous opening of programs and restricted to their own directory, I say most because it is possible that PL5 was open during one test but I will check the results and post any addendum when I can.

Apparently this is an Adobe-created tag: “LR 11 added a very limited ability to order the keywords for export to Adobe Stock but not other stock agencies.” See https://community.adobe.com/t5/lightroom-classic-ideas/p-custom-sort-order-of-keywords-instead-of-alphabetic/idc-p/12526371/page/5 for more details. Doesn’t look useful for much else due to limited adoption.

2 Likes

@jch2103 Sorry but I did the animal|mammals|bear|grizzly bear test on one of my raws and the xmp contained ‘dc’ subject of animal|mammals|bear|grizzly bear and ‘hr’ hierarchical subject of animal|mammals|bear|grizzly bear !

Mine on the left and yours on the right! We need to get our IMatch settings aligned!

Edit 2022-01/14:-

@jch2103 looking at the preferences options the ‘Metadata’/‘Keyword Export’/‘Write path elements’ did the trick! So I now need to repeat the IMatch “tests” again and the Bridge “tests” when I finally find out how to make that product produce ‘hr’ fields! I still need your settings so that I don’t risk “offending” you again!

The original tests also included putting all the outputs into PL5 and exporting to a JPG and the IMatch tests (and Bridge) will need to be redone and then some way of publishing the results determined!

So for the test in question that I carried out on the RAW in my test group we now have

To mark a difference between tests I add a keyword of “test” and this is in the hierarchical group.

Good morning guys,

Thank you for such a detailed comparison. All your reports and findings will be carefully analyzed by the dedicated team on our side.

Thank you for the feedback.
Regards,
Svetlana G.

@platypus I was not genuinely confused by the notation but rather in the spreadsheet I wanted to concentrate on the keyword data without the ‘xmp’ packaging but thank you for your concern and in the light of @jch2103 response and my “discovering” the preferences option for IMatch I can repeat the IMatch tests.

@Joanna I need your help to sort out the “problem” with my configuration of Adobe Bridge so that I can get it to use ‘hr’ data.

@Stenis Can I drag you into this discussion and can you please do me a favour and verify the Photo Mechanic data when you have time. I am trying to represent the facts in each case not peddle “untruths”.

Then I can feed all the settings into PL5 and determine what it makes of them and what is to be found in the exported JPGs, which was my original intention!

The updated spreadsheet with the amended data for IMatch (animal|mammal|bear):

Copy of meta data setting _03.zip (12.8 KB)

Ahah!!!

It finally clicked! You are working in the IPTC metadata palette, which you should not be touching with a barge pole, unless you explicitly want IPTC metadata for purposes other than keywording.

Keywords stored in dc:subject and lr:hierarchicalSubject are part of the XMP namespace, not IPTC.

In Adobe Bridge, select the Keywords tab instead…