BEEHIVE RAID Mac OS
Setting up a software RAID (or random array of independent disks) is a great way to inexpensively provide a huge boost to read/write speeds, or add an internal back up solution (or do both!).
All you need is a Mac with the ability to install more than one SSD or HDD (such as a Mac Pro 5,1) and some HDDs or SSDs, we recommend using matched drives in most cases, however, simply matching capacity (2TB etc.) and type (HDD or SSD) is usually fine.
A RAID is basically a collection of physical drives, linked together, that are seen by your system as a single drive. You can set up a RAID in a number of different ways. A striped RAID will boost read and write speeds by splitting your data between all 4 drives and reading/writing to them all at the same time. A mirrored RAID will write the same data to a number of drives, meaning you have real time back-ups that are fully bootable and can repair themselves. You can even set up 2 striped RAIDs in a mirrored RAID. This may sound confusing, but we’ll explain which configuration is best for what soon enough.
Learn advanced techniques for managing RAID volumes in macOS Sierra. The Terminal commands include creating nested RAID arrays, adding hot spares, and checking the status of rebuilt volumes.
- RAID 1 uses two hard drives and doesn’t come with the speed advantage of RAID 0. This is similar to RAID 0 in that all you need is a couple hard drives and the RAID function in Disk Utility. RAID 10: This is a combination of RAID 1 and RAID 0. It requires four hard drives to use, and is essentially two RAID 0 sets mirroring each other.
- Perkin Haywood, Verutti Rozas Sal’s Krogh Pingree, O/Z Culbertson, Mac’s Wimbledon, A.E.O. McCarty Olde Cellar Rager Latham, Eckart Bullard Bruening Kerstner Oakville, Banker Russell, Gen Mdse Swenson G.W. Schaefer Whitesville, Wagner’s Blake’s Cigar Pendleton, John.
- The Macintosh (mainly Mac since 1998) is a family of personal computers designed, manufactured, and sold by Apple Inc. Since January 1984. The original Macintosh is the first successful mass-market personal computer to have featured a graphical user interface, built-in screen, and mouse. Apple sold the Macintosh alongside its popular Apple II, Apple III, and Apple Lisa families of computers.
- We would like to show you a description here but the site won’t allow us.
Setting up a Striped RAID to Maximise Disk Read & Write Speeds
Setting up a striped RAID is a great option when you need to maximise read & write speeds, regardless of your budget. Theoretically you could set up a striped RAID using 4 PCI-E flash storage blades in an external PCI-E expander, you would hit around 4GB/s read & write speeds with a set up like this, but it wouldn’t be cheap. Alternatively, you could use 4 HDDs in a Mac Pro’s internal HDD bays and hit speeds of around 600MB/s, about 20% faster than the best consumer 2.5″ SSDs, but the cost would be much less. There are also a myriad of options in-between for every budget, you don’t have to use 4 drives, a 2 drive RAID is still extremely effective.
A striped RAID will have disk read & write speeds that are around the sum total of your drives separately. So if you use two 500MB/s SSDs then your RAID will read & write at around 1GB/s.
How to:
- Open Disk Utitlity (Finder > User > Applications > Utilities).
- Format each disk you want to use in your RAID set to ‘Mac OS X Extended (Journaled)’. Do this by selecting each disk in the left hand menu and heading over to the ‘Erase’ tab.
- Select one of the disks you want to use in your RAID.
- Select ‘RAID’ tab in the main portion of the window.
- Name your RAID in the ‘RAID Set Name’ text box.
- Select ‘Mac OS X Extended (Journaled)’ as your format in the ‘Format’ drop down (unless you specifically want another format and know what you are doing).
- Select ‘Striped RAID Set’ in the ‘RAID Type’ drop down.
- Drag the drives you want to use in the RAID from the drive overview section on the left of the window into the RAID Set.
- Hit ‘Create”.
- Once created, your RAID set will appear as below and can now be used to store files.
With a bootable USB installer, you can even install OS X on your new RAID set. You can also use Disk Utility when booting from the USB installer to create a RAID set without having to have another OS X drive for Disk Utility, extremely useful when creating a 4 drive RAID in a Mac Pro.
With a striped RAID set it is essential that you keep a back-up. Should one of the drives in your RAID fail, the whole RAID will fail.
Setting up a Mirrored RAID for real-time, auto-repairing Back Ups
Setting up a mirrored RAID set is a great internal back-up solution, providing a real-time back-up that can even automatically repair itself should a drive fail, this is achieved by writing your data to both disks rather than just one. Again we would recommend using matched drives, but you don’t have to.
You can use SSDs, HDDs and even PCI-E flash storage, it all depends on your needs and budget. You can also use as many disks as you like, you shouldn’t need more than 2, but using 3 or 4 will give you even more security should a drive fail.
How to:
- Open Disk Utitlity (Finder > User > Applications > Utilities).
- Format each disk you want to use in your RAID set to ‘Mac OS X Extended (Journaled)’. Do this by selecting each disk in the left hand menu and heading over to the ‘Erase’ tab.
- Select one of the disks you want to use in your RAID.
- Select ‘RAID’ tab in the main portion of the window.
- Name your RAID in the ‘RAID Set Name’ text box.
- Select ‘Mac OS X Extended (Journaled)’ as your format in the ‘Format’ drop down (unless you specifically want another format and know what you are doing).
- Select ‘Mirrored RAID Set’ in the ‘RAID Type’ drop down.
- Drag the drives you want to use in the RAID from the drive overview section on the left of the window into the RAID Set.
- Hit ‘Options’ and tick ‘Automatically rebuild RAID mirror sets’.
- Hit ‘Create”.
- Once created, your RAID set will appear as below and can now be used to store files.
You’re now all set to install OS X on your mirrored RAID set, or to just use it as a data drive. Again use a bootable USB installer if you have no other drives to install from.
RAID 10: Striped Mirrors and Mirrored Stripes, the best of both worlds
Want the speed of a striped RAID set as well as the security of a mirrored RAID? If so, RAID 10 might be the one for you. A RAID 10 set comprises of two mirrored RAID sets in a striped RAID formation. Should a drive fail, it will auto repair, and you will still get the speed boost of striping (4 drives in a RAID 10 formation will read/write at double the speed of a single drive as opposed to 4 times the speed with a pure striped RAID).
For example, using 4 HDDs in a RAID 10 set will achieve read & write speeds of around 300MB/s as well as having real time back-up and auto repair functionality.
Technically this isn’t actually a RAID 10 set, as a RAID 10 set is a hardware RAID. But it is a software clone and does exactly the same thing. You can call it a mirrored-striped-software-RAID-set if you like.
How to:
- Open Disk Utitlity (Finder > User > Applications > Utilities).
- Format each disk you want to use in your RAID set to ‘Mac OS X Extended (Journaled). Do this by selecting each disk in the left hand menu and heading over to the ‘Erase’ tab.
- Select one of the disks you want to use in your RAID.
- Select ‘RAID’ tab in the main portion of the window.
- Name your RAID in the ‘RAID Set Name’ text box.
- Click the ‘+’ button just below the main section of the window 3 times in order to add 3 partitions.
- Set two of the partitions to ‘Striped RAID Set’ and the final partition to ‘Mirrored RAID Set’.
- Drag two of your drives into the first ‘Striped RAID Set’ and the other two into the second.
- Drag your two ‘Striped RAID Set’s into your ‘Mirrored RAID Set’. (Your RAID configuration should appear the same as the image above).
- Hit ‘Create”.
- Once created, your RAID set will appear as below and can now be used to store files.
Again, you can now install OS X on your mirrored striped RAID set, or simply use it as a data drive.
You can also set up a striped mirrored RAID set (as opposed to mirrored striped), just set up two mirrors and stripe those together instead. Functionality and performance will be the same.
Some Notes on Software RAID Sets
As with any storage drive, you should always keep a physical or online back-up of your RAID set, regardless of the type. In most cases software RAID sets are very reliable, but they can be susceptible to things such as power cuts, again unlikely, but the possibility is always there even with a mirrored RAID.
And remember, it’s not really a back-up unless you have two.
We do also provide hardware RAID controllers for the Mac Pro 5,1 at Create Pro. Complete with on board battery and controller for extra security.
Setup Hive on Mac
This tutorial will provide step by step instruction to setup Hive on Mac OS.
Download Apache HiveYou can click here to download apache Hive 3.0.0 version or go to Apache site http://www-eu.apache.org/dist/hive/ to download directly from there.Move the downloaded Hive binary to below path & extract it.
Beehive Raid Mac Os Pro
There are 7 steps to complete in order run Hive
- HDFS (Hadoop) setup should be present, if not present then please complete hadoop setup first. Steps available on Hadoop Setup
- Setup environment variables in .profile file
- Hive need external database to store Hive Metadata called Metastore. Setup either mysql or Derby database for Hive Metastore.
- Download MySql connector jar and place it in Hive library.
- Setup configuration files for local Hive
- Setup HDFS for storing Hive data
- Starting Hive
- Validating hadoop: Hadoop version can be checked using below command.
- Set below Hive & mysql variables in the .profile file in $HOME directory
- Setup Hive Metastore: Mysql, oracle or Derby databases can be used for Hive metastore. Generally it is suggested to use Mysql over Derby. Derby is inbuilt with Hive but with this, you can create only single Hive session.
- Mysql Setup: Mysql can be downloaded from this mysql site link. After downloading & installing mysql server, please follow below steps to start mysql server.
- Go to system preference and click on Dolphin like MySql icon as shown in figure below.
- Next window will have button 'Start MySql Server' to start server. Also ensure that checkbox 'Start MySql when your computer starts up'. Move to next step if it is already started.
- Add the below command in .profile file in home directory
- By default, there is no password for root user of mysql. We need to login root user & create new hive user to be used by Hive & spark.Login to MySql root user and execute below commands
- Go to system preference and click on Dolphin like MySql icon as shown in figure below.
- Derby Setup: Derby is inbuilt and can be setup by running below commands.
If you get below error after running above script
Then search NUCLEUS_ASCII & NUCLEUS_MATCH function in below metadata load file and comment them using double hyphen(--).
- Mysql Setup: Mysql can be downloaded from this mysql site link. After downloading & installing mysql server, please follow below steps to start mysql server.
- MySql Connector: Click here Download MySql connector or directly download from MySql site and extract it.Place the jar file at the following location.
- Setting up configuration files for Hive binary.
- hive-config.sh: Add below command in $HIVE_HOME/bin/hive-config.sh file.
- hive-site.xml (Mysql as Metastore) : Please create hive-site.xml file with below properties under $HOME/hadoop/apache-hive-3.0.0-bin/conf/ directory
- hive-site.xml (Derby as Metastore) : Please replace below property with MySql properties in the above hive-site.xml site.
- hive-config.sh: Add below command in $HIVE_HOME/bin/hive-config.sh file.
- Setup HDFS (creating directory) for storing Hive data & temporary data
- Starting Hive: Hive can be started with 'hive' command and hive shell will open
If hive is able to connect to MySql metastore then above command will work else it will fail with below error
Start hive console again with below command & again run show database commandNote: Hive console in above mode will show exact error why Hive is failing.
If you are seeing timezone error like belowThen change the below value in hive-site.xml