Synchronise PhotoLab

That is why I propose

  • manual launch
  • one way “integration” sort of sync - call it master/slave, if you still want to use these words
  • exchangeable roles

Note: If .dop sidecars contained “everything” about the respective image, things could get fairly straightforward. As of DPL5, the one thing missing in the sidecar is “advanced history” as far as I know. If AH were excluded from the task, things would be trivial.

Remember: It’s all about using two (or more) computers and getting a built-in feature that ensures that differences can be eliminated, if the user chooses to to so.

I use SyncBackFree. Once it created a sync list I can choose which on I want to delete. Not perfect especial when you work with more places. In my case 2 pc’s and the NAS.

George

@platypus I am sorry but is it really that complicated (putting to one side, for a moment, the issue of projects and indexes).

When a copy of the database is taken and worked upon on another computer then new photos and their attendant “baggage” (the twin sidecars DOP and ‘xmp’) is/are unique and can be added back to the base system, in my case using Beyond Compare and for others their choice of comparison software.

The sidecars are a “sort” of Audit Trail except that they represent the end of the chain of changes rather than the whole chain. However, if photos already in the “base” database are changed while out on assignment then attempting to replace the DOPs will cause issues because of their unique Uuid which will no longer match with the database and results in Virtual Copies.

I believe that any changes to the embedded or sidecar ‘xmp’ data will simply be absorbed as if they had been made externally by another program, photo editor or DAM.

So the gating issue for harmony is the Uuid check. Therefore provide a feature to override the Uuid when a change is detected on an

  1. Individual
  2. ‘All’
  3. Session
  4. Preference basis

and harmony is restored.

Could it be that simple - over to you?

Re-indexing should resolve new keywords etc (I hope) but that does leave transferring projects and anything else I haven’t thought about!?

This does not handle deletion but rather than physical deletion mark images as ‘deleted’ using Tags, ratings, colours(sorry not in PL5), keywords etc. and then execute a physical deletion using the selected criteria on both systems as and when appropriate.

This may not be a “super duper” synchronisation process but would take minimal work from DxO developers and might help those that want this feature.

The issue of preparing the laptop database ready for the next trip then comes up and that is effectively the reverse (I think/hope).

This is still two machines with two databases and two sets of assets which may or may not be identical copies and transferring those assets between the two machines if/as/when required, it requires

  1. A “simple” fix to DxPL (a Uuid override)!?
  2. A change to work habits, i.e. no physical deletion
  3. Good comparison software to transfer the various assets from one platform to the other etc.
  4. A user that understands the implications and possibilities of “corrupting” one or either of the two environments if they lose “focus” at any point. Use database backup before embarking on any such exercise. Being able to have DxPL multiple database aware would be useful (please don’t start the discussion I have seen for Lightroom about one database or many versus indexing versus …, leave it up to the individual user to make the decision but simply provide the facility)
  5. Better directory management within DxPL (the ability to rename a directory exists but it would be useful to have a facility to delete a directory which would be useful in the “battle” to better organise the assets.

PS: It is a “little” tedious to have to (re-)visit every directory in order for DxPL to (re-)discover a directory and “import” as a Virtual Copy, or ask for options (Uuid override ) etc. and hence some form of Import option that can selected at an appropriately higher level of directory would also be useful option potentially in this case and for importing keywords on a wholesale basis etc.

Adding assets to DPL’s database is easy, removing them is a little bit more involved.

Add assts

  • Open a new folder and you’re set (better not spread new images over several folders)

Remove assets (without deleting the image files)

  • Open a folder of images that should be removed from the database
  • Delete images from within DPL, the quit DPL
  • Move images from the trash to their original folder

If one wants to keep the databases of multiple computers “in sync”, the most current database must be copied to the other computer(s). In order for these databases to have the links to all files, new folders must be copied to the other computer(s). While this does not sound too complicated, it takes some discipline, or database(s) and file repositor(y/-ies) drift away from each other.

As of today, DPL offers nothing to simplify a multicomputer sync. Lightroom does a better job in that it

  • discovers discrepancies between catalog and file repository
  • offers a choice for metadata copy (either DB → file or file → DB)
  • can remove assets from the catalog without moving those assets to the trash

I can imagine several ways to implement DPL sync, but I’d be (pleasantly) surprised if DxO came up with DPL sync real soon.

1 Like

@platypus This is true if they are genuinely “New” i.e. never before seen by DxPL in the directory that you navigate to! If DxPL thinks it has seen that directory before then the Uuid check comes into play with all DOPs that may be present in the directory and VCs will be created where there is a Uuid clash!

Unless someone, i.e. DxO, provides a ‘Uuid clash’ ‘override capability’ via ‘yes’/‘all’/ ‘session’ and/or Preference options. This would take a day or so to implement and the user would need to use their own compare software to put the data in the correct place to be discovered. But this basic functionality is arguably simpler to implement than the current VC creation and management logic!!

Remove assets also requires DxO development but is also a lot simpler than many of the things already implemented, i.e. allow actual deletion of directories as well as files and allow the removal of a file, selected files, and directories from the database, i.e. the remove option needs to be extended to directories and both the file and directory remove needs to have an additional option of ‘From disk’, ‘From DB’. The DB option should do just that and leave DOPs intact along with ‘xmp’ sidecar and the original photo!

Another days work for the developers and without it we are spending days writing these posts and countless amounts of time trying to achieve what would be simple with a few “minor” extensions to the code!!

I would like to see a multiple database option added - 1 more days development!

I would like to see an ‘Import’ option to which the Uuid override options I have suggested would also be available. This could import data from any external media, USB disks, memory sticks, another computer across the LAN with an import directory and a target directory. The target would be new or existing and the Uuid clash would be handled using the same process as I have just mentioned.

This is a longer task so I would give the developers a couple of weeks to develop that code. While it might be seen as a retrograde step (to much like Photo Mechanic, LR, C1 etc.) here it is for a very specific reason not as the only way to introduce new photos to the product for the first time but to add new and “remodel” old photos.

As for DxO implementing any of these we need to start pressuring them to look after their current user base as well as chasing new customers, particularly when I believe that some of the items I have mentioned are actually straightforward to implement.

PS: I still consider PL5 is one of the best programs to use, to navigate etc. it is just that it can be even better @sgospodarenko.

PPS: Include a check that the incoming DOP is “newer” than the database/DOP it is replacing in the ‘Uuid override’ situation and offer an additional option to continue etc… Development might take a little longer than my initial estimate which didn’t include formal design and agreement of design, scheduling of development, (development), localization, full testing, regression testing of a release, documentation (localized of course), packaging of the release and the release process itself to name just some of the steps from conception to being in the eager hands of the user.

Plus separate development, testing, release etc. for Win 10 and Mac versions!

@platypus while I believe that my proposals above are not difficult to implement, they require development from DxO and even if that is (hopefully) forthcoming in one form or another it does not solve the problem today or in the intervening period while we are waiting for such features! A lot was discussed in a similar topic How to use PhotoLab on multiple Apple Computers - #27 by John7 and @John7 had described his technique there, i.e.

and @platypus wrote

Unfortunately I would not recommend either of these approaches because although they will work I hate the idea of deleting real data under any circumstances because the onus is on me to get things right and not wind up trashing the data completely!

So will the following provide the solution slightly more safely?

Re-Import Procedure for PL5:-

  1. Change the name of the folders to be re-imported to e.g. -saved 2022-01-18 (i.e. the date of the operation within PL5. All images DOPs and sidecars will be maintained on disk and in the PL5db. The data is intact in all environments except a DAM and/or other file editors you may use which have their own DAMn database etc. etc. but this is supposed to be a temporary operation and what I am proposing is no worse than the wholesale deletion of the data!

  2. Terminate PL5 (not actually necessary but better safe than sorry).

  3. If all the data from the other computer is to be added wholesale, i.e. it is the latest version and nothing is required from the old directory then simply copy the new data to the system with the original name.

  4. Restart PL5 and navigate to the original (original name which now has the new data) directory and it should re-import the data it discovers.

  5. Verify that everything is as it should be and delete the (previously renamed) saved data at you leisure by deleting from disk, PL5 does not currently possess a directory deletion command.

Things are slightly more complicated it you want/need to mix and match data from more than one directory from more than one location because you started working in PL5 on your return and forgot to import the work from the laptop etc. etc.

  1. For maximum safety you could (should) copy the incoming contents to another location on the machine to be updated.

  2. Using your favourite comparison software (Beyond Compare in my case) compare and contrast the two directories, the original to be replaced and the new to be used and copy anything from the old to the new that is required and that must include the photos, the ‘xmp’ sidecar and the DOP sidecar. This then gives the new content that you wish to add to PL5 in a consolidated form and leaves the original and the new still intact ( so the process can be repeated as many times as required until it is it right!!)

  3. Execute the Re-import procedure for PL5 described above.

This process does require “swing space” on the receiving machine, on the main machine when importing from an “away trip” and on the laptop when preparing from an “away trip”.

Re-Syncing Metadata:-

But I have a problem with part of @John7’s original statement

I should have picked it up at the time but I have only recently returned to testing keywords that I hadn’t done for a long time when the original posts were made, principally about later DAM changes to keywords etc. not being picked up by PL5 and forcing PL5 to “catch up” with these changes by the deletion process.

If the ‘Sync’ option is set in the ‘Preferences’ PL5 will automatically pick up any such changes when you navigate to the specific directory (possibly only the specific photo - needs checking) and there is a warning given when you set the ‘Sync’ option about the possibility of data falling down a “crack”.

Alternatively select the photo or all the photos in the directory in PL5 and use the ‘Medata’ ‘Read from image’ command which should refresh all the metadata using the sidecar ‘xmp’ for RAWs and the embedded ‘xmp’ for JPGs etc or RAWs if you are using the DAM to update the RAW itself (I have done tests on that using Photo Mechanic). WARNING:- This is NOT a perfect strategy, I repeat that this is NOT a perfect strategy, I repeat ….

It is not a perfect strategy because it can (will) overwrite any keywords that have been added to PL5 that have not been automatically “flushed” to the external sidecar/embedded ‘xmp’ (please note that PL5 only uses the sidecar for RAW files) as a result of the the ‘Preferences’ ‘Sync’ option, or manually “flushed” to the external sidecar/embedded ‘xmp’ using the ‘Metadata’ ‘Write to image’ command.

Any left in PL5 that have not been “flushed” will be lost with the ‘Metadata’ ‘Read from image’ command - YOU HAVE BEEN WARNED sorry about the use of capitals and bold but it is a trap that could catch the unwary (probably me when I forget my own advice!)

‘Rating’ changes should be in the DOP but also in the ‘xmp’ but ‘Tag’ data is only stored in the DOP and a ‘Sidecar’ ‘Import’ should sort those out but they are only set by PL5 itself!

Keywords in the DOP are not currently used (who knows what might happen in the future)

It is possible @John7 that you had problems with getting PL5 to accept or recognise the changes but we did not have an opportunity to explore the issue because I failed to question why you had to execute your strategy. PL5 has never “played nicely” with ExifPro and refuses to automatically recognise any changes made to keywords (to JPGs) by that program because it ExifPro makes those changes without changing the ‘date last modified’ file timestamp.

In most tests I have been conducting (PL4.3.6.32 Ghosting Ratings for Same image in different directories (Win10) - #114 by BHAYT things work well with PL5 but I have not tested Photo Supreme which I think you have mentioned in one post or another.