It does not say RAID enhanced. Of course, I do believe it is mounted to the RAID card, but not a part of the RAID it seems. I think we can just delete the OSX from the RAID somehow?
Ok, looks like you have a choice. You can do the easy thing, and just delete the RS1 RAID set, then create a new RS1 RAID set. I'm pretty sure that will format/erase everything on the old RAID set in the process. Once you have a new RS1 created, you will click on Create Volume, and make a new volume out of the drives in bays 1, 2 and 3, just like it was before, only it won't have that partition with Macintosh HD anymore, which is the goal. You don't want partitions, anyway.
Did you see my last post on page 3? What shows up in Disk Utility?
It looks like it is booting up from the Raptor (new drive) I think I can confirm this because I am now installing the Apps on this drive and when I chose where to install it, it gave me Macintosh Hd and the Macintosh Raptor as options, but the Macintosh HD had a yellow exclamation point on it and when I clicked on it, it said you can only install the applications on the drive that is running the OSX, this was a good confirmation so I clicked on the Macintosh Raptor and it is now installing the apps on it. Just for fun, I opened the Macintosh HD and dropped all of the folders that were in there in the Trash Can (I can restore them if needed) but I figured this was one way to clean it up. I still would like to know if I can just click erase in the disk utility, but I did not want to chance breaking the RAID set.
Yes...GOOD! Now in RAID Utility, delete the Macintosh HD volume. This should get rid of the partition as well. If not, I'd delete the RAID set RS1, and create a new RS1 (RAID 5) from the three drives, then create a new volume without partitions on that RAID set. Then you can copy all your data onto the new RAID volume!
Note that every three months, it will automatically condition the battery on the RAID card. When this happens, leave it alone, and don't do any editing. It takes 7.5 hours to finish, and can be a surprise when it happens, but the write cache is disabled during this process, and it would suck to lose all your data, so I use this time to do something besides editing. (I am usually editing something, so it's a nice break, actually.)
You mentioned earlier setting up drives on the new RAID for different things, such as Projects, etc. I prefer to have no partitions, one big RAID volume, and just use folders to organize my stuff. If you really want, you can create a bunch of different volumes to organize things, but I think it's better not to.
Premiere lets you choose whatever folder you want things to go in, and it's been flawless having those folders reside on my RAID volume, which I've named Video. I have each project in a unique folder, and each project automatically creates a sub-folder for the different things like Media Cache Files, Preview Files, and so on. It's easy to keep it organized on one volume, if you ask me.
i dont understand,
i have two discs 500gb x 2, the fastest should be used for the SO/pagefile and the other for media/project/cache ?
i used one for project/pagefile/exports and other for media.
what is the best config to use ?
I too am still a bit confused about this myself, but I am getting a bit closer. I think it really depends on how many drives you have at your disposal that will determine how you are going to set up Premire Pro. According to Adobe by default the scratch disk files are stored where you save your project. But as as sequences become larger, the amount of disk space increases. Adobe recommends that you dedicate a hard disk or disks strictly for your media. This disk/disks should be separate from where you keep your OS, Apps and Project Files. If you have many disks at your disposal, you could dedicate a different disk for each kind of asset like captured video, captured audio, etc. But, you could just as easily have your media disk (the one separate from the OS/Apps and Project File) have folders in them to keep you assets organized. Adobe recommends that your fastest disk be the one for the scratch files that are accessing the media.
I was advised by PaulieDC to use a fast Raptor (10,00rpm) for my OS and apps and I guess this is where I will also keep my project files now as well. But the scratch disk will be my three 7200rpm disks set up in RAID 5. Adobe advises to use the fastest drives for the scratch. In my case, a 10,00rpm drive vs three drives in RAID 5 on a RAID card probably are pretty close in speed and I prefer to have the redundancy where my media files are located in order to provide ample back up.
PaulieDC and Wonderspark
Got everything set up. It was as easy as erasing the Volume and keeping the RAID in place. No problem. Main drive for OS, Apps and project files is the WD Raptor 600GB 10,000rpm
My RAID drive is where all the scratch is going to take place with all of my media files which I will organize on the RAID when I open each project.
I have to now install the drivers and CUDA for the NVIDIA Quadro 4000 and then drop her in place. I have an edit to work on this weekend so I will hit the ground running. I also decided to return the iOmega 2TB external drive Firewire 800 in exchange for a G-Tech 1TB External RAID drive that I will run in RAID 1 through eSATA (have to mod the Mac for that). I will use this drive for Time Machine and for storage from compoleted work done on the internal RAID.
Here is a question regarding this. Am I able to designate different locations for different projects. For example, I would want to use the external RAID 1 drive to work on projects that I know I will need to work on with other editors on other computers, so having that one designated for these projects would be nice so I can easily move it back and forth. The rest of my projects (the majority) will all be done internally.
Also, what files do I need to copy over from my internal RAID to my external storage so that I can store them and open them later if I need to. I do not want to junk up my internal RAID with a bunch of old footage from old projects as I move forward.
Main drive for OS, Apps and project files is the WD Raptor 600GB 10,000rpm
My RAID drive is where all the scratch is going to take place with all of my media files which I will organize on the RAID when I open each project.
Given your hard drive arrangement, I think you've got it! If Adobe says it's OK to store Scratch and Footage on the same drive, then that works for me. It'll never hurt to have 29 separate drives, but we live in reality, not fantasy, lol. Your earlier post mentioned just having folders for organization as being the same as separate drives (maybe I read that wrong), but while organization is extremely important, you always gain the most speed having separate drives, just FYI. Imagine 6 different heads reading data and all of them streaming in concurrently at many megabytes per second. BUT, moot point, you have a good setup now, 10K OS/App/Project drive and a killer RAID for footage and Scratch. Well done. Much better than running it all off the RAID. AND, absolutely excellent move getting the external eSata RAID!
OK, your other question: yes, when you start a new project in Premiere, right there is where you'll designate where to store the project files. If you already have a folder on the ext RAID for projects, then just create your new folder for the individual projects on the fly at the Save step in Premiere when you open it. Simple, just like anything else you save. But, remember that previews and rendered video on a timeline is most likely stored in cache in a different location, so when you open the project on a different system, you may have to render again, or at least point to the footage. By the way, speaking of that, you're going to need your footage too, correct? Will you just copy the footage onto the ext RAID and then copy it onto the other computer when you get there? That seems easiest. Remember, your project and all of its files will be on that ext RAID, but the FOOTAGE won't be, being it's on your internal RAID. The timeline just points to its location. So you'll want to copy that separately either onto that ext RAID if there's room or sme other ext drive, just for transport's sake. Don't worry when you get to the second location, you can dump the footage on that system whever you want. When you start Premiere on the second PC it's not going to find the footage because the location is stored as on your Mac. But not to worry, Pr will pop up a dialog and say "Hey! Where's your footage??". Actually it'll ask for the FIRST file it doesn't find. You just navigate to the file it wants, and it will automatically find the remaining ones. NOW, if you're proficient at offline editing and you already KNOW all this stuff, please disregard! I just want to make sure you have all your bases covered.
For those projects that I will do "offline" I will be storing the media for them on the external drive as
well. The idea is to hook that external drive up to the second computer and have Premiere work from that drive alone
Will that work? I thnk it should. So all I need is the project file, and original media correct? Or is there some other files I will need as well?
I think that'll work! There will be several files that Premiere will create, but they will all get auto-stored in whatever folder you create the project in, so as long as you have the project FOLDER, you'll have all you need. Go for it! If it doesn't work the we'll figure it out.
The only potential problem I see is the external drive's file system type compatibility, going back and forth from Mac to PC. The PC will almost certainly be NTFS, and Macs are usually HFS+ (aka Mac OS Extended), and if the two computers aren't both able to read the file system type on the external drive, one will not recognize the drive.
I handle this by installing Tuxera NTFS on my Mac, and format the external drive to NTFS via Disk Utility, selecting Tuxera NTFS. One could also just use FAT32, but my video files are usually over 2GB in size, and FAT32 won't allow for a file over 2GB. It's important to note that even with Tuxera on my Mac, it's not a perfect system. For example, on a Toshiba external drive my friend uses, I have to reboot my system with the drive attached and turned on in order for it to be recognized, and when I transfer files to it, the displayed space available will not update until I reboot my system AGAIN. Annoying, but it works fine otherwise. This is using the ultra-fast SATA connection. It works normally if I use the other port on the external drive... super-slow USB 2.0. It's yet another thing to think about.
ExFAT is supposed to be the magic pill to fix all this compatibility, but I haven't had success with that yet.
You mentioned modifying the Mac for eSATA... OWC sells eSATA cards for $49. Link: http://eshop.macsales.com/item/Newer%20Technology/MXPCIE6GS2/
I have this card in my Mac Pro, and I love it. They also sell a version of this card for $70 that supports RAID and port multipliers... link: http://eshop.macsales.com/item/Newer%20Technology/MXPCIE6GRS/
I actually wish I had that second version with RAID support.
Thanks for the tip. I am going for the $49.00 one you linked to. I like this better than just the cable that would take one of my optical drives away. I think I am getting the right one. Even though I am running the G-Tech RAID mini in RAID 1, it does not have a port multiplier, so I guess I am fine with just the $49.00 one. (I hope). THe $70.00 one is for a RAID set up but with systems that use port multipliers and usually several drives. The RAID mini is two drives in RAID 1.
I know you didn't ask me, but for the record, I keep my OS and Adobe applications on the OS drive, and all remaining files / folders (including the project files and all scratch folders) on the asset drive, which in my case is a 3-disk RAID 0. I have no problems with data bottlenecks.
A few weeks ago I got my new system. I took a good look at my budget and based my HDD setup on the recommendation in the first post of this thread.
I have done the PPBM5 benchmark twice. Once with my system at stock speeds, and once with an overclock on CPU and memory. The overclocked system runs every test faster than the system at stock speeds, except for the disk intensive AVI encoding, which shows a 43 second worse performance! On my total benchmarktime it even more than cancels out the gain I get from the better scores on the other tests. Both runs were done with version 5.0.3. Bill Gehrke already let me know that 5.0.3 for some reason has worse disk io performance than 5.0.2, but considering I ran both times in the same version that should not be an explanation.
The reason I post this in this thread is that I'm wondering if performance should increase if I change my HDD setup. Which currently is as follows:
C: 120GB SSD: OS and programs
D: 1TB 7200 SATA: Adobe Media Cache and Windows Pagefile
E: 1TB 7200 SATA: Footage, other media and Adobe project files
F: 1TB 7200 SATA: Adobe Exports and Adobe Preview files
All 1TB HDD's are identical WD Caviar blacks,
This basically follows Harm's guideline for a 4 disk setup. However, other options are mentioned for a 4 disk setup. Somewhere in this thread they are named 4a and 4b, and both involve a RAID 0 setup of the Export disk (F in my case) and either the Pagefile disk (D in my case) or the project disk (E in my case).
My question is simple. Will setting up a RAID 0 in either of those two options going to (substantially) increase my performance? If so, which option would increase my performance most?
I work predominantly with AVCHD files (1080p 50fps) and some CPU intensive plugins.
Don't know if this is relevant, but my other specs are:
Core i7 950 (3.8 GHz OC)
12 GB RAM -1600 (1680MHz OC)
Gigabyte 460 GTX (815 MHz factory OC)
Other than that I'm really clueless about an explanation for the weird results that I mentioned in the first part of my post. If anyone has any ideas they're more than welcome to share it. I haven't changed anything on the multipliers for the uncore clock and QPI, so they have both gone up with the bCLK increase. So that is probably no explanation.
Slightly different, but maybe even more important question: Does it matter for my use of premiere pro? Considering I'm only working with highly compressed AVCHD files (max around 27 Mb/s).
Woops, that's already three big questions in my first post ever to this forum. Sorry about that. Didn't mean to come barging in like that... I also sent Bill Gehrke an e-mail about this, but I figured I should stop harassing him with all these questions and put em where they're supposed to go, which is here.
Excellent topic & guidelines! Thank you for posting.
Does anyone have input on a HD set up using two separate computers for editing (the same projects)?
I work on two computers (work & home office) with a single 1TB external HD (7200 SATA) that currently contains all my footage, project files and the media cache files. Both computers are set up with two internal drives each (of varying sizes). Most of my projects are DV, AVCHD or HDV. (Canon HG10/Sony HVR-5U cameras) Both computers are also set up to use the external drive with the same drive letter. I hate mentioning this - I know you'll all cringe - eSATA has been spotty on both computers (it might be the drive case - a new one is on the way), so I've been working primarily with USB2 on the external drive. When the new case gets here, I'm hoping that the eSATA will prove to work reliably.
Since the project would need to re-do the media cache files when plugged into each computer, what would be a better way to approach that dilema?
Setting everything up on one drive seemed to be the easiest way to avoid loosing the most current cache files, but after reading through all of this - it makes me think twice.
Is there anyone who has any thoughts on any of the questions I have regarding:
1. my disk setup (will raid improve my performance?)
2. and the disk io performance on the ppbm5 benchmark with and without an overclocked system?
3. the importance of disk performance for my specific use of premiere pro (mainly avchd files)
Please see my post of january 10th for a more elaborate explanation. Any input is very much appreciated!
We found out I had a little too many processes going in the background. I wasn't aware of those. Now I killed a bunch of them and my disk test runs 20 seconds faster than before. Still not as fast as it has been earlier, with the system at stock speeds, but a big improvement for sure.
Thanks for the great info - just watched Todd Kopriva's 'Ask A CS Pro' where he mentioned this thread... I read through the posts here and didn't see any mention of this, so sorry if this has already been asked...
I have a new budget i7-870/16GB Ram/GTX460 on a P7P55D-E Pro mb that supports USB 3.0 and SATA 6Gb/s. I have only installed a single WD Caviar Black 1TB 6Gb/s drive for OS/Program Files thus far and am wondering how I should proceed with setting up additional drives? I can add one additional 6Gb/s drive and multiple 3Gb/s SATA drives (as well as eSata/USB 3 external drives). I noticed that USB 3.0 external drives are still not a good choice for work drives - only back-up, what about eSATA externals?
My main question is should I add a second 6Gb/s drive D: for Media/Projects and a 3Gb/s drive E: for Media/Previews/Exports?
Is there any advanatge to using a 6Gb/s drive for either D: or E: - if so, which one?
I will be adding an external NAS for back-ups, so am not worried about data integrity - should I use a RAID 0 set-up for either/both, or is that overkill? I am typically working with AVCHD footage from a Canon HFS100 or similar.
Thanks for any advice you can provide!
eSATA and SATA deliver the same performance. For single disks it makes no difference whether you use SATA2 or SATA3. The advantage of SATA3 capable disks is the larger cache, which is used on SATA2 too. Conventional disks are restricted to their mechanical limits, not the interface they use. So you can use the newer 6 Bb/s drives on standard SATA interfaces without any negative effects.
Thanks for the fast reply. So, would you recommend I use the 6Gb/s connections configured as a RAID in any
fashion? What, if any, advantage is there in my motherboard supporting the faster interface (if set-up in a RAID configuration with dual 6Gb/s drives)?
Or, am I better off simply creating a 3+ disk set-up with additional drives - regardless of the interface (i.e. 6Gb/s vs. 3Gb/s shouldn't matter)?
Would adding 2 more independent drives seem to suit my needs?
Finally, if adding more independent drives, would you recommend SATA 7200 RPM in 500GB-750GB or would the larger capacity 1TB-2TB be fine?
OK - so after further reading/research of your other posts on RAID and such, I decided to go with 2 640GB WD Caviar drives. I'll set these up as in your 3 disk recommendation and see how things go... I see now the 1TB OS/Program disk I already have is overkill. 'C'est la vie'...
Thanks again, Harm, for all of the excellent articles!
I want to double check my setup. I am editing almost only P2 video 720P and 1080. Projects are feature film documentaries.
First, my hardware (I will update my motherboard, processor and ram, but for now this is it)
8 meg ram
Nvidia GeFroce GTX 285
260 G HD for OS and programs
Two Blue Caviar 500G in Raid (Total 1T) I put the my P2 footage and Media cache there
One Black caviar 1T where I put my Scratch disk
1T Green Caviar where I keep my music that I use for scores, Stock Items used for after effect and some storage.I also use Sonicfire pro5 and the scores are on the Green Caviar.
Should I change something? My page sys is in the C drive. I also use After Effect a lot as seaprate projects or, most often, linked to my Premiere projects for Titles and color correction with Finesse3. Where whoul I kee my After Effect projects? Black caviar? Raid?
260 G disks do not exist AFAIK. Have you partitioned your disk? If so, that is a bad idea.
Blue, green, or whatever other color are usually bad choices. For video editing nothing has changes since the days of the T-Ford. You could buy it in any color you wanted, as long as it was BLACK. Same with WD drives. All colors are OK as long as that is limited to BLACK. Blue and green are ok for backup.
With the disks you currently have, you have made sound allocations, and the raid0 nicely compensates the fact you use Blues. but for the next system change them for Blacks of F3's.
HI, I have been reading through the information on this thread and others for the past couple of weeks trying to work out the best configuration for my hard drive set up. I mainly use Adobe Production Premium CS5 and in particular Premiere and After Effects. I mostly work with HD footage.
My PC is 64bit, quad core with 12gigs of ram.
I have just ordered some new drives to set up with my current ones to create the following hard drive configuaration:
1 X OCZ 120GB Vertex SSD for OS/Programs/Pagefile
4 X Samsung F3 1TB 7200rpm in RAID 5 for Media/Projects/Cache etc
1 X 1.5TB WD for stock footage/resource material
I also have an external 1TB drive that i was thinking could be utilised somewhere for maybe back up purposes.
Do you think the above set up will be OK, i don't know a great deal about hard drive configuratiuons so any help will be greatly appreciated. Thanks
Thanks Harm. So using 2 RAID 0 arrays, how would you arrange the different tasks such as scratch disks, page files, media etc etc. The OS and programs will be on the SSD and i guess the WD 1.5TB will be OK for a stock footage drive. Or would you utilise that drive in a better way?
I'm gonna request a litte bit of help.
I have a pretty limited system, and not much work time to change it around.
2 X 1TB RAID 0 with my OS on it.
1 X 1 TB External USB Drive
1 X 500 GB External Firewire Drive.
I unfortunately have no budget to purchase additional drives at all. This is a Dell that I purchased as is. It is a Core i7 2.67ghz with 6gb of RAM, although it has an ATI card. Fortunately, I am building a new rig that will get me back on the right foot (GTX 470, 4 hard drives, 12gb RAM, etc).
Can you recommend a setup (pagefile, cache, media files) for this amount of drives?
Let me explain a little better:
My OS is on a 2 x 1TB Raid 0. I do not have the work time to change this.
I then have two external hard drives: one is a 1 TB USB, the other is a 640 GB that has e-sata (i just learned).
What would be the best for me to do?
I'm thinking: 2 TB RAID 0: OS, Programs, Pagefile, Media Cache
640 GB Esata Drive: Media, Projects
1 TB External USB 2.0: Exports
Would this be the best setup with my configuration?
When considering a 4 disk setup, what is a safe and easy way to satisfy "proper backups" when considering your 4 disk Raid-0 comment "With proper backups, D: or E: and F: can be run in Raid 0"? Do you have an ideal method for backups in this scenario?
I've noticed no suggested 2 disk Raid-0 for drive C: OS/Programs setup for those that would like a faster boot drive and trying to avoid the costs of a single SSD. If anything I think you would rather see a Raid-1 setup for C: OS/Program. Do I understand you correctly? If true, could you please elaborate. Isn't the only downside to a disk failure only to have to reinstall your OS and Programs and your time to do so?