Hi. I've had my catalogued images on a network drive for several years. Recently had a major failure and re-built the drive, re-loaded from backup etc.
Unfortunately, since the overall requirements for the drive had changed over the years, when re-building I didn't re-create exactly the same folder tree as before. While all my images are there (30,000+) and in the same relative tree as when they were catalogued, they are one level higher in the overall tree. As a result, the catalog (PSE7) doesn't marry up with the path to the folders and Organizer displays a red 'off-line' media icon for every single image. (None of the images is marked as needing to be re-connected since Organizer thinks the problem is the media being off-line rather than it being on-line but with a different path.)
With this many images, re-cataloguing the images isn't a realistic option. What can I do to get Organizer to recognise the drive is not off-line media and that the images are all there but on a different path ?
Thanks for any help.
To cut a long story short ... the original network drive was a Maxtor in RAID1. When one of its HDD died, it instantly became unbootable. Support told me there were no user replaceable drives inside and that as it was out of warranty to throw it away ! What's the point of RAID1 if you have to do that ?
Instead I downloaded hacked firmware and rebuilt with two new HDDs, then re-loaded from a USB back-up drive. Had been running fine again since. But its NAS functionality is limited compared to modern devices and I wasn't prepared to repeat the exercise when a HDD died again. So I bought a new NAS, moved the HDDs into it, re-formatted, and re-loaded my Catalog from the USB drive again (ie. not from the re-built drive but from a backup taken before it failed). Downtime for the whole thing was about a fortnight which I could cope with. But the new NAS has different reserved share-names (as well as a different volume #) so I couldn't use the original names that are in the Catalog and anyway I wanted to split the data between more than one share to exploit the additional functionality. So when re-loading I put the images into a folder tree starting at the share-name root rather than one level lower. I expected to have to do a lot of "re-connect missing file" operations.
Instead I found that Organizer doesn't think they are disconnected, but off-line, so doesn't allow you to try re-connecting them. Starting over with the missing tree level re-inserted isn't an option because I can't create the same root share-names on the new NAS anyway, and its volume # will still be different. What looks to be needed is a way to get Organizer to accept the folders are online and allow me to re-connect the images, as if everything had happened on a local drive, not a network drive.
Any ideas gratefully received.
Oh boy, that could be a tough one. Offhand, all I can think of is to directly modify the database with a 3rd party SQL query tool. See if this discussion seems to apply to your situation:
http://forums.adobe.com/message/3649698#3649698
As always, should you or any of your Impossible Mission data become damaged, the Secretary will disavow any knowlege of your actions. Good luck! ![]()
Ken
Thanks for the pointer - looks helpful. The two obvious differences with my situation are:
(1) that my catalog is PSE7 rather than PSE9. Would you expect this procedure to work similarly for PSE7 as for PSE9 ?
(2) that the drive/volume in the db will have changed but so will the path (although the new path will be systematically derived from the original path so should be possible to simply strip a string out of the original path and substitute). Is the path stored as a column of simple string data per image in the db ?
I've used SQL before but not for several years so willing to give this a go if it will work on PSE7.
The PSE Organizer (at least version 8 and earlier) doesn't properly handle reconnecting files on network drives. But there is a trick to force it to reconnect; see method 4 of the following FAQ:
http://www.johnrellis.com/psedbtool/photoshop-elements-faq.htm#_Quickl y_reconnecting_large
But before using that method, I highly recommend that you restore the original file paths of your photos on the new NAS. After you've successfully reconnected, you can then safely reorganize your folder tree using the Organizer commands.
While you can edit the catalog database file directly using database tools such as "sqlite3" (and some programmers will find that straightforward), I definitely don't recommend it. Such methods often end up taking much more time than you think.
The "psedbtool" utility will give you an overview of what's currently going on with your catalog:
http://www.johnrellis.com/psedbtool/
But it won't make any changes to your catalog.
sea-monkey wrote:
(1) that my catalog is PSE7 rather than PSE9. Would you expect this procedure to work similarly for PSE7 as for PSE9 ?
I honestly don't know for sure -- I've only examined the tables and done this with a PSE9(10) database. However, I expect that it's likely to also work with PSE7. You'll have to first make a copy of your catalog database file (using Windows Explorer) and test it on the copy.
sea-monkey wrote:
Is the path stored as a column of simple string data per image in the db ?
Not exactly. It is stored as a string in different formats in two columns in the media_table table. This is a sample of the three columns in that table that describe the fully qualified path of an image:
/Pics/Misc/cabin_done.psd /pics/misc/ cabin_done.psd
I wouldn't recommend altering those values, although it is tempting, because it would be very tedious (and prone to typo errors). If the original SQL query in my link works for you, count your blessings
and let the Organizer do all the reconnection work.
Ken
John R. Ellis wrote:
The PSE Organizer (at least version 8 and earlier) doesn't properly handle reconnecting files on network drives. But there is a trick to force it to reconnect; see method 4 of the following FAQ:
http://www.johnrellis.com/psedbtool/photoshop-elements-faq.htm#_Quickl y_reconnecting_large
But before using that method, I highly recommend that you restore the original file paths of your photos on the new NAS.
Thanks John. Problem is that the original root folder name is a reserved word on the new NAS, so I can't re-use it and so can't re-create the original tree structure. But method 4 in your FAQ does appear to work in this situation - ie. with both a different volume # and a different root and path to the folders. Great ! It's going to be very tedious but should get everything recorded in the correct places again.
Thanks for your help.
BTW, I was getting stack overflows causing psedbtool to crash at first. Appeared to get rid of them by dismounting drives from my PC - is there a limit on the number of connected drives it will support ?
photodrawken wrote:
I wouldn't recommend altering those values, although it is tempting, because it would be very tedious (and prone to typo errors). If the original SQL query in my link works for you, count your blessings
and let the Organizer do all the reconnection work.
Thanks Ken. SQLite works fine on PSE7 db. Reveals a lot of junk data, despite the fact that the catalog was completely accurate on display until the mis-match between NAS paths. As you'll see in another post, there appears to be a way to re-connect without editing the db via SQLite, so I'll try that first and maybe clean up the junk with SQLite afterwards (or maybe leave well alone) !
Thanks for your help.
sea-monkey wrote:
I was getting stack overflows causing psedbtool to crash at first. Appeared to get rid of them by dismounting drives from my PC - is there a limit on the number of connected drives it will support ?
I hadn't received any previous reports about too many connected drives, and I don't have ideas what might be going wrong there. Unfortunately, I don't support "psedbtool" any more, having moved to Adobe Lightroom two years ago. LR isn't perfect, but its Library does seem to be actively supported by Adobe, unlike the Organizer.
The "junk" will accumulate primarily because files have been removed from the catalog (using the Organizer, of course) -- when an application tells SQLite to "delete" an entry from the database, that entry is not removed, only marked by the database as "not available". So, over time, a lot of dead wood accumulates. What the "Optimize" function in PSE's Catalog Manager does is physically delete those entries from the database file, resulting in not only a smaller file but also less stuff to wade through when the database is searching for an entry (when you use Organizer to search for a tag, e.g.).
That dead wood doesn't accumulate in "enterprise-class" databases like MS SQL Server, because the database engine periodically purges the database as part of its automatic maintenance processes. That's one reason I have this fond dream that at some time in the future PSE (and Lightroom) will switch to MS SQL Server Express, which uses the same database engine as the "big" SQL Server.
Ken
Feedback for future reference:
Well, it's taken two full days but method 4 from the FAQ linked above in this thread has worked to allow PSE to re-connect all the images files that had been restored onto different network share paths than the ones PSE7 thought they were on. But that method doesn't help for files with video mime-types (and presumably not for any other files types for which the PSE Catalog doesn't support the same meta-data insertion).
So at that stage I had 30,000+ images correctly re-connected and listed as on-line and 322 videos that were still listed as off-line. By trial and error I then discovered that the selecting the Properties panel > Meta-data tab > Complete radio-button forces PSE7 to attempt to re-connect to an off-line file, just the same dialog as the method in the FAQ, except that it only works one file at a time - very tedious but the only way I can see to get video files correctly listed.
My thanks to John and Ken for their help.
North America
Europe, Middle East and Africa
Asia Pacific