That's ok, progress is being made. You have deteermined/discovered that you have duplicates in your catalog.
You may well have shifted these duplicates in Finder and then reiported them. Trick is to move files inside of Ltghtroom so as the links are not broken (most of the time!!).
Now you have a choice of which you want to remove from the catalog. I suggest you keep the latest version (editing) and remove the other from the catalog. The one you remove from the catalog (and from the catalog only) can be either the one linked to a file or not, if it is the "missing" file you retain in the catalog you will have to relink it after removing the duplicate.
Give this a whirl carefully and slowly and let us know after you have had a first attempt.
I've done this type of thing as have many, many Lightroomers so don't panic, it is usual to end up in this position once only!!![]()
I fired up the windows box and tried to export the catalog from LR3.6.
I was prepared to transfer the 12,000 images.
In the end 8000 images were missing no doubt backup scattered and off my windows box for more space.
I imported that catalogue in to LR4.
All but 1 lousy image couldn't be found.
EVERYTHING ELSE WAS DETECTED ON MY EXISTING CATALOG IN LR4.
I can't go back and can't go forward with my collections. I cannot resolve the newly found "?" i the folder's panel even though they have drive letters that are out of this world and they were all but hidden to me. ( sorry John you were tright of course).
But I am still wallowing in the mire.
I spoke with Matt Kozlowski today twice about this nightmare of mine during his LR4 seminar.
First he said, it sounded like a mess and i may have to create a new catalog and start over, but he said there was a way to save the information contained in the collections but he would cover some of that in his class, but after he breezed through that section I asked him again about it at the break. He said, theoretically, the collections should come back back I don't think he understood what I was talking about. He gave us his twitter account for questions but who knows if he'll respond after class.
I am sorta fine with stating over somehow especially since there is so many things wrong with my LR catalogue and how it is organized.
Te one thing I will have to research is what if anything can be done to re-associate the collections i have with the images if I do go in and create a new catalog.
Those collections are really priceless in the amount of time it took to build....but the edits on the idividual images still exist in the ALL pictures...i will have to go and see if this is true.
I spoke to 3 other poeple at this seminar who had very similar issues with their catalogues.
thanks
http://forums.adobe.com/thread/623364
djpaige worked on this very same issue about 2 years ago with very nearly the same exact symptoms I have. My problem is I have done some much OUTSIDE of lightroom, even outside of the original platform that light is about to explode. I have to stand back and look at this but i have such a huge deadline friday and this is such a distraction.
I will get a screen shot when i get downstiars..Oh wait....I have the same time machine backup here on my mac book pro with the same disaster.
Here are the screen shots and it is far uglier that I ever envisioned now that I noticed the volumes in that panel... the second through 4th link are heineous long collumns of question marks of death as Matt referred to them....
Just for the record — I have had this problem too. I had to "remove" the photos from my LR3 (B2) library and then reimport them from disk to straighten it all out. Although I'm not entirely sure what would've caused this for just a few select photos, LR3 definitely did not want to import the photos when I had gone through the ritual of identifying where the missing photos were on disk. Instead, it insisted that the photo already existed in the catalog. Julian Bleecker
thanks for sharing the misery. I have a manual method for fixing my Collection. I select a "missing photo" in the Collection, and then switch to the main Catalog where the "missing photo" will appear next to its idential "present photo." I then delete the "missing" one and drag the "present" one into the Collection.
Are all of these from the same catlog and computer? The C drive, etc look like Windows format and the MacHD is well a Mac HD.
Folders/files will show as missing if drives are not connected.
How many drives do you use and can they all be connected at the same time?
Also how many catalogs do you have???
i only have one catalog. the one updated to lr4.
I know it is painful to start at the beginning of this post for background.
I don't think it is possible to reconnect the drives....they may have differnt names, drive letters since it was all coming from windows xp-pro or connected to that box, thus the nightmare volumes. I posted last year about those volumes and someone explained what they were when I began to see these volumes looming but since they were always closed and I never had an issue seeing or interacting with my collections I never paid any atention to them. Now they are radioactive.
All the images associated with All the collections are on the ELEMENTS ext. HD shown .
I sorta made progress. I hooked up or woke up both network drive and attached two other external HDs and managed to tell LR4 where thisone image was located. It gave me the same song and dance but this time acknowledged the new location of the file on the network drive but still gave me the thing about the file was associated with another photo or the same photo.
No, a brand new catalog will not know about collections.
You could have a workaround if you still had your old system on the windows box in working mode, i.e. without any mess and ?s there.
Which you have not, if I understand this thread.
So maybe you will only arrive at new collections by redoing all this work from scratch.
What I would advise then, though, is to insure your future collections by a feature which can be written into xmp and thus travel along the image file:
For each collection define a keyword and put them under a parent key word called "redundant collection membership", so you do not clutter your keyword list on root level.
When you have created a collection, select all images of it and assign the relevant keyword, then cmd s to save this to your xmp-part of the files.
This would enable to easily recreate collections by importing into a brand new catalog.
It may be what Matt may have meant, but you seem to lack the prerequisite now.
Generally for all future: fingers off from finder or windows explorer once you use LR!
You do every move inside LR!
Cornelia
I fired up the old box and there is as big a mess there all along but for some reason it never failed like it is now. When I try to resolve a question mark and point to its location it say the file is already associated with another file. very aggravating. I convert everything to DNG as far as I can remember. The problem that has caught up to me is I did a lot of moving around out side of LR.
But this really sucks.......
The problem is that the catalog thinks or knows that a file is already in the catalogue so I can't restore the ^&$%&^$ collection...
why isn't there a solution to this?
uggg
In my view you are really at the point where you've little to lose by starting anew. Thanks to everyone else who has tried, but we've all been asking similar questions and getting nowhere.
So what I would do now is use Finder to gather up all your pictures into one place, so you know you have everything. This can be under a single top level folder - maybe call it "Photos in Lightroom" . Start a new catalogue, and import that folder, selecting Add in the Import dialog.
You will lose Collections - Matt was either trying to get away from you or didn't know what he was saying.
And from now on, observe these rules - any pictures that are recorded in LR should only be moved using LR. That one is strict! Secondly, switch on the Catalog Setting to auto write XMP files. Third, use keywords and other metadata rather than collections to add the basic data that groups and categorises your pictures. See Collections as more of a reporting or gathering function, and use smart collections to find images meeting certain criteria. Learn from the experience and follow these rules!
Once everything is in this one new catalogue and your pictures all in Photos in Lightroom, clean up the rest of the mess using Finder. Maybe just drag it into one Big Mistake folder and see if you can forget it.
Either do this or get someone to help you. I know someone in Baltimore who could help himself or could find someone. Email me if you want his name.
John
Continued
Now, if the above doesn't appeal, look at the links in the bit I quoted below. You have lots of question marks on folders. As I said before, you could right click each of these - the folder and NOT the photo - and Update Folder Location. You may be able to point each folder to its current location, and that may reduce the 10000 missing photos to nil, but I'm not betting on it! You're probably better off starting again and following my rules.
"I will get a screen shot when i get downstiars..Oh wait....I have the same time machine backup here on my mac book pro with the same disaster. Here are the screen shots and it is far uglier that I ever envisioned now that I noticed the volumes in that panel... the second through 4th link are heineous long collumns of question marks of death as Matt referred to them....
"
@john. It looks like this is where this is headed no doubt and I will have to follow 1-2-3.
but for this:
Now, if the above doesn't appeal, look at the links in the bit I quoted below. You have lots of question marks on folders. As I said before, you could right click each of these - the folder and NOT the photo - and Update Folder Location. You may be able to point each folder to its current location, and that may reduce the 10000 missing photos to nil, but I'm not betting on it! You're probably better off starting again and following my rules.
If I were able to do this with the pointing each folder to it's current location we would n't be here...thanks!
When you import into Lightroom, all that happens is that Lightroom creates a link to the location of the files/folders....they are not IN Lightroom.
The vast majority of your 10000 missing images are the ones that were in the My Pictures folder structure on the C drive of your Windows PC. Simple question.....when you moved over to the Mac, did you copy those folders as well? Because if you didn't, that explains all your problems. But if you did copy them to the Mac, where are they? If you know, then you follow the instructions that John has repeatedley given you, right-click on the My Pictures folder, choose "Find Missing Folder" and in the resulting browser window navigate to the copy on the Mac and click OK.
Sorry if I am sounding impatient, but I didn't ask anything about collections. In your screenshots - the ones I quoted - in LR's Folders panel are folders with question marks on them. Each of those represents a Finder/Explorer folder. If you now go into Finder (the Mac's version of Explorer) where are those folders? Can you find one in Finder?
this is the message:
and this is the other message
I have said where the locations of the files are many times through out this post.
Folder location for some files are on the ELEMENTS EXT HD. some are on this HD.
With the exception of being dead wrong about "?" in my folders panel I have told you everything.
I have done all that john more than dozens of times...and still get the same messages i the end.
at this point this horse has been dead for a long time....
thanks for your help!
v.
"Is the other location a folder on a drive somewhere?" You say yes.
"If so, connect that drive and in LR right click the folder in the Folders panel, update location."
But we're still getting nowhere. I think it's time for a clean start as I described above, or getting someone in. Best of luck.
John
Show me two things:
1. A screenshot from Finder which shows the location and folder hierarchy of the 2009 year folder (and individual dated 2009 sub-folders) which according to the Lightroom Folders Panel screenshot were on the network share \\Ls-lgl46f\share\
2. A screenshot from Finder which shows the location and folder hierarchy of the My Documents folders which according to the Lightroom Folders Panel screenshot were on the C drive of your PC
Those two folder structures account for almost 10000 of the 12000 missing files, so if you have kept the folder hierarchies identical when you presumably copied them over to the Mac then with two simple relink commands you have most of your catalog sorted out.
@Jim...I will respond later...
This is art show weekend for me and let me tell you guys it has been a heartbreaking ordeal FINDING my images without collections. Some of my images all dressed up a ready to go are no where to be found. I had a number of images I couldn't find.
I some how find jpgs, ( I never have shot jps in 10 years) and also the dng files which should have the edit on them.
SO FRUSTRATING. It is beyond frustrating.
Most of us on this discusion are not new at all to LR.
If I am getting an specific ADOBE LIGHTROOM message that is a result of a specific conditon created by the end user- THEN WHERE IS THE SPECIFIC ADOBE REMEDY for this Problem. They went through the trouble of coding an error message.
Matt Koslowski may have been trying to get rid of me if he didn't have time to address this issue or if he didn't understand this issue but I went public with this problem in mid-may and the knowledgable people here can't figure it out...not that this has not floated around the internet before...
This same problem happened on this forum last year and I provided the link above where djpaige worked on it: http://forums.adobe.com/thread/623364
THIS IS A CRIPPLING CRIPPLING condition and if it ever happens to anyone here, not that it would since you all know how to avoid this callamity, you would feel what I feel.
So at this point....JOhn you said you knew someone in Baltimore. OR is there specific ADOBE one-on-one support, paid if availble I can seek ?
This is MUCH more than an inconvenience..... and I think I need to bring in professional support here but like I said in bold above, why would this be necessary?
Thanks for the suggestions...@jim...i have to set up my booth and wil hitcha later...thanks
As you have 2 records for each image (one now missing with ?, one supposedly "good") you too must have done some action to reimport from the new storage destination, as did the other poster from your link. He did it by sychronizing a folder, you admitted in your reply no. 57 that you did, after the move to your mac.
These supposedly "good" ones are now your problem, because they do not know about collection membership, but they hinder you to re-associate the complete records with the proper file, which is indeed the same.
So the way out:
Remove (just REMOVE, not delete from disk!!!) the supposedly "good" specimens from your catalog, the re-associate, on folder-level preferably, the question marks. Which will work now, because there is no redundant record left to interfere.
If you did not change the folder structure underneath MyPictures between your windows box and mac box this should be fairly quick.
The challenge is to find the redundant images to remove them.
You cannot blame Adobe or LR for this situation, as it was of your own doing, in the wrong action to move LR from one computer to another.
Reimporting or synchronizing folders is always a bad idea, if you have data to loose in your catalog.
Once sorted out I would stress my recommendation again to use keywords for collection membership and display the collections then as smart collections.
Good luck, Cornelia
How do I know what or where the good specimen is? "Remove (just REMOVE, not delete from disk!!!) the supposedly "good" specimens from your catalog".
When I follow the "?" to point to the file/and folder, that I know is there, It comes back with the duplicate message that I get every time.
It will then say...i think...."show in folder ort show in library or catalog...........................IS THIS THE ONE I WANT TO DELETE?
of course, right????
we are very close C!!
I am not blaming Lightroom or Adobe for this situation because I moved files outside of LR of course.
What I am miffed about is the fact that when this thing happens to me an ADOBE error message window comes up and says such and such.
There should be an adobe solution to this or any cooresponding message window they wrote in the lighroom program for to appear whenever any particular event occurs.
Thanks Cornelia....I am not at my computer right now. but I can't wait to get home and fix this thing once and for all.
Hi Vincent,
This is my suggestion how to proceed from here. It is like heart surgery on your LR catalog, so even it is currently a mess, first start LR, set it to backup upon next exit, and exit. Tick "optimize cataloag" also, have a coffee while that lasts. LR now closed.
Then append the backup-catalog filename by MESS_StartingPoint. Just in case.
We should not do any deletions on file level, but again, cautious - could you empty your trash bin in Finder? So if you should make mistakes, you have only LR-stuff to recover in?
Now you should just label every entry in your LR catalog, before you actually DO anything.
If my theory is right, you have 3 categories:
We need to identify and cull SuspectedDuplicates.
Then you should be able to re-associate on top-folder-level with a "?" to the equivalent top folder now on your Mac drive, and no more error messages and no more "?" afterwards.
So to do this labeling: first define the 3 keywords. If you have already a long and clean keyword list, start with a parent keyword for organization like "DisasterRecovery" and put the other 3 as child keywords. So you will not pollute your list and easily cleanse it afterwards.
To identify the ToBeFound you just run the command from All Photographs, then Library - Find Missing Photos again, put your cursor inside this new collection, select all, and apply the first keyword ToBeFound. If you do not use colour labels already for other purposes, you could as well mark them as "green", for easy visibility.
To identify the TooRecentForWindowsBoxs filter All Photographs for "Date is after <date of your move to mac>", select all, assign the keyword TooRecentForWindowsBox, and maybe treat them with another colour, such as yellow.
Now all the rest should be SuspectedDuplicates, so filter for "Keyword is neither ToBeFound nor TooRecentForWindowsBox". Mark them with the keyword "SupectedDuplicate".
Now have a hard look at them - this is the risk: you are going to remove their records from LR.
If there could be some among them which have another source, for which you can be sure that they do not overlap with any of the ToBeFound, swap their keyword for TooRecent... and mark them with e.g. violet, because if some of them should overlap, and you would get the "already associated error" again, you know where to cull more - from the violet ones.
Do a plausibility check in numbers: number of ToBeFound = number of SuspectedDuplicate ? If <, you should find candidates for violet. If > you know that you will not be able to get rid of all "?".
Best you take a break at this point and return with a refreshed mind to look again at all thumbnails keyworded as SuspectedDuplicate.
Would it improve your current mess if everything else would be ok, but these would be missing?
Then with All Photographs filtered for keyword SuspectedDuplicate, hit delete. In the dialog box, which asks for "Delete the selected photos from disk, or just remove it from Lightroom?" be sure to choose REMOVE.
We need the image files on disk, because now you are going to associate them with the "?".
So just for paranoid safety, check your trash can now in Finder - it should still be empty. If not, restore.
Then to re-associate the "?": to minimize workload this should be done on folder-level rather than on individual thumbnails.
So be sure to display all parent folders in folder panel. Go to the highest with a "?", right-click and point LR to the correct older on Mac, like you have done already so many times before. But now there should be no or just few exceptional "already associated" error messages (few in case your violet thumbnails still contain some overlaps. You may get a protocol for which files the reassociation was not successfull - store it, this is your work list for individual search).
Check for rate of success now:
Filter All Photographs for Keyword ToBeFound: any "?" left?
You could remove the green colour and the keyword ToBeFound for all which are without "?" now.
TooRecentforWindowsBox: should be unchanged in number. Cleanse the labels (keyword plus colour) at any convenient time when you deem the surgery over.
Now it is time to look inside your collections: hopefully next to none "?" left inside them.
If there are still some, check your protocol and look among the violet thumbnails, if there is a duplicate for one with a "?". Delete the violet one, associate the "?" with the released image file. This might be a 1:1-work now, I am afraid.
Then backup your catalog again.
Quite generally I agree with you that error messages should not only give a correct technical statement, but some instructions in everyday language, too.
For this special case I would suggest: "Find the redundant thumbnail which points to the same image file and decide if to remove that or the thumbnail with the "?". "
Good luck, Cornelia
North America
Europe, Middle East and Africa
Asia Pacific