• This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn more.

Raid config

Max

Well-known member
#1
Recently we bought a Bi Xeon E5 server with the config
256GB RAM
HardRAID : LSI MegaRAID 9271 6 Gbps FastPath
Hard drive : 2 x 300GB SSD
DirectAdmin

1. Can anyone suggest me good partition structure.. like how much for temp, root, home etc.. I want to have this in RAID

We are planning to run few large Xenforo's on this. Not for VM or web hosting purposes.

2. When i check with df-h

Code:
Filesystem            Size  Used Avail Use% Mounted on
rootfs                9.8G  605M  8.7G   7% /
/dev/root             9.8G  605M  8.7G   7% /
devtmpfs              126G  348K  126G   1% /dev
/dev/sda2             265G   60M  251G   1% /home
tmpfs                 126G     0  126G   0% /dev/shm
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/var/named
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.conf
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.rfc1912.zones
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/rndc.key
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/usr/lib64/bind
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.iscdlv.key
/dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.root.key
Is it RAID or not?
Why so much /dev/root s?
 

Max

Well-known member
#5
What is the output of:
# fdisk -cul
Code:
Disk /dev/sda: 299.5 GB, 299506860032 bytes
255 heads, 63 sectors/track, 36412 cylinders, total 584974336 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x000703d3

  Device Boot      Start        End      Blocks  Id  System
/dev/sda1  *        4096    20975615    10485760  83  Linux
/dev/sda2        20975616  583917567  281470976  83  Linux
/dev/sda3      583917568  584968191      525312  82  Linux swap / Solaris
 

Floren

Well-known member
#7
Code:
Disk /dev/sda: 299.5 GB, 299506860032 bytes
255 heads, 63 sectors/track, 36412 cylinders, total 584974336 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x000703d3

  Device Boot      Start        End      Blocks  Id  System
/dev/sda1  *        4096    20975615    10485760  83  Linux
/dev/sda2        20975616  583917567  281470976  83  Linux
/dev/sda3      583917568  584968191      525312  82  Linux swap / Solaris
You only have one disk installed/connected, not 2. Can't use RAID.
2 disks installed:
Code:
# fdisk -cul | grep 'Disk /dev/sd'
Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
Edit: To answer your original question, this is what I use on all builds:
Code:
# pvs
  PV         VG    Fmt  Attr PSize   PFree
  /dev/md1   vg_os lvm2 a--  930.88g 807.88g
# vgs
  VG    #PV #LV #SN Attr   VSize   VFree
  vg_os   1   6   0 wz--n- 930.88g 807.88g
# lvs
  LV      VG    Attr      LSize  Pool Origin Data%  Move Log Cpy%Sync Convert
  lv_home vg_os -wi-ao--- 10.00g
  lv_opt  vg_os -wi-ao--- 10.00g
  lv_root vg_os -wi-ao--- 10.00g
  lv_swap vg_os -wi-ao---  8.00g
  lv_tmp  vg_os -wi-ao---  5.00g
  lv_var  vg_os -wi-ao--- 80.00g
This will allow you to grow the LV's based on your needs and also be able to add new disks to increase the VG size.
 
Last edited:

digitalpoint

Well-known member
#8
You only have one disk installed/connected, not 2. Can't use RAID.
2 disks installed:
Code:
# fdisk -cul | grep 'Disk /dev/sd'
Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
Not always... if they are using a hardware RAID (which it looks like in the original post), the operating system doesn't know about the individual drives since the RAID controller is presenting them to the server as a single drive.

For example, this is my fdisk output on one of my servers (pretty much fdisk doesn't know WTF is going on... haha):
Code:
WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.

Disk /dev/sda: 3596.0 GB, 3595999117312 bytes
255 heads, 63 sectors/track, 437188 cylinders, total 7023435776 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00000000

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1            2048     4208639     2103296   82  Linux swap / Solaris
/dev/sda2   *     4208640     4417535      104448   83  Linux
/dev/sda4               1           1           0+  ee  GPT

Partition table entries are not in disk order
Since you have a MegaRAID adapter, I would suggest installing their MegaCli tools, which lets you pretty much do anything with the adapter without needing to reboot and get into it's BIOS.

Some pretty good info about stuff you can do with it here: http://artipc10.vub.ac.be/wordpress/2011/09/12/megacli-useful-commands/

For example if you want to see basic info about your partitioning (you can see that the "state" is "Optimal"... not rebuilding or degraded, you can see I have 6 drives in a RAID-6 setup, etc.):
Code:
twin1:~ # /opt/MegaRAID/MegaCli/MegaCli64 -LDInfo -Lall -aALL
                                    

Adapter 0 -- Virtual Drive Information:
Virtual Drive: 0 (Target Id: 0)
Name                :
RAID Level          : Primary-6, Secondary-0, RAID Level Qualifier-3
Size                : 3.270 TB
Parity Size         : 1.634 TB
State               : Optimal
Strip Size          : 64 KB
Number Of Drives    : 6
Span Depth          : 1
Default Cache Policy: WriteBack, ReadAhead, Cached, No Write Cache if Bad BBU
Current Cache Policy: WriteThrough, ReadAhead, Cached, No Write Cache if Bad BBU
Default Access Policy: Read/Write
Current Access Policy: Read/Write
Disk Cache Policy   : Disk's Default
Encryption Type     : None
Bad Blocks Exist: No
Is VD Cached: Yes
Cache Cade Type : Read Only



Exit Code: 0x00
If you want to get info about individual physical drives right down to drive models and serial numbers:

Code:
twin1:/home/bin # /opt/MegaRAID/MegaCli/MegaCli64 -PDList -aALL
                                    
Adapter #0

Enclosure Device ID: 252
Slot Number: 0
Drive's postion: DiskGroup: 0, Span: 0, Arm: 0
Enclosure position: N/A
Device Id: 12
WWN: 5000C5005FB719B4
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 838.362 GB [0x68cb9e30 Sectors]
Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
Coerced Size: 837.258 GB [0x68a84800 Sectors]
Firmware state: Online, Spun Up
Commissioned Spare : No
Emergency Spare : No
Device Firmware Level: 0001
Shield Counter: 0
Successful diagnostics completion on :  N/A
SAS Address(0): 0x5000c5005fb719b5
SAS Address(1): 0x0
Connected Port Number: 0(path0)
Inquiry Data: SEAGATE ST900MM0036     0001S0N04XDG           
FDE Capable: Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: 6.0Gb/s
Link Speed: 6.0Gb/s
Media Type: Hard Disk Device
Drive Temperature :31C (87.80 F)
PI Eligibility:  No
Drive is formatted for PI information:  No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: 6.0Gb/s
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 252
Slot Number: 1
Drive's postion: DiskGroup: 0, Span: 0, Arm: 1
Enclosure position: N/A
Device Id: 13
WWN: 5000C5005FB71570
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 838.362 GB [0x68cb9e30 Sectors]
Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
Coerced Size: 837.258 GB [0x68a84800 Sectors]
Firmware state: Online, Spun Up
Commissioned Spare : No
Emergency Spare : No
Device Firmware Level: 0001
Shield Counter: 0
Successful diagnostics completion on :  N/A
SAS Address(0): 0x5000c5005fb71571
SAS Address(1): 0x0
Connected Port Number: 1(path0)
Inquiry Data: SEAGATE ST900MM0036     0001S0N04XE2           
FDE Capable: Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: 6.0Gb/s
Link Speed: 6.0Gb/s
Media Type: Hard Disk Device
Drive Temperature :31C (87.80 F)
PI Eligibility:  No
Drive is formatted for PI information:  No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: 6.0Gb/s
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 252
Slot Number: 2
Drive's postion: DiskGroup: 0, Span: 0, Arm: 2
Enclosure position: N/A
Device Id: 18
WWN: 5000C5006803676C
Sequence Number: 4
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 838.362 GB [0x68cb9e30 Sectors]
Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
Coerced Size: 837.258 GB [0x68a84800 Sectors]
Firmware state: Online, Spun Up
Commissioned Spare : No
Emergency Spare : No
Device Firmware Level: 0001
Shield Counter: 0
Successful diagnostics completion on :  N/A
SAS Address(0): 0x5000c5006803676d
SAS Address(1): 0x0
Connected Port Number: 2(path0)
Inquiry Data: SEAGATE ST900MM0036     0001S0N0731G           
FDE Capable: Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: 6.0Gb/s
Link Speed: 6.0Gb/s
Media Type: Hard Disk Device
Drive Temperature :31C (87.80 F)
PI Eligibility:  No
Drive is formatted for PI information:  No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: 6.0Gb/s
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 252
Slot Number: 3
Drive's postion: DiskGroup: 0, Span: 0, Arm: 3
Enclosure position: N/A
Device Id: 15
WWN: 5000C5005FB7149C
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 838.362 GB [0x68cb9e30 Sectors]
Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
Coerced Size: 837.258 GB [0x68a84800 Sectors]
Firmware state: Online, Spun Up
Commissioned Spare : No
Emergency Spare : No
Device Firmware Level: 0001
Shield Counter: 0
Successful diagnostics completion on :  N/A
SAS Address(0): 0x5000c5005fb7149d
SAS Address(1): 0x0
Connected Port Number: 3(path0)
Inquiry Data: SEAGATE ST900MM0036     0001S0N04XED           
FDE Capable: Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: 6.0Gb/s
Link Speed: 6.0Gb/s
Media Type: Hard Disk Device
Drive Temperature :30C (86.00 F)
PI Eligibility:  No
Drive is formatted for PI information:  No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: 6.0Gb/s
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



Enclosure Device ID: 252
Slot Number: 4
Drive's postion: DiskGroup: 0, Span: 0, Arm: 4
Enclosure position: N/A
Device Id: 16
WWN: 5000C5005F74F33C
Sequence Number: 2
Media Error Count: 0
Other Error Count: 0
Predictive Failure Count: 0
Last Predictive Failure Event Seq Number: 0
PD Type: SAS

Raw Size: 838.362 GB [0x68cb9e30 Sectors]
Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
Coerced Size: 837.258 GB [0x68a84800 Sectors]
Firmware state: Online, Spun Up
Commissioned Spare : No
Emergency Spare : No
Device Firmware Level: 0001
Shield Counter: 0
Successful diagnostics completion on :  N/A
SAS Address(0): 0x5000c5005f74f33d
SAS Address(1): 0x0
Connected Port Number: 4(path0)
Inquiry Data: SEAGATE ST900MM0036     0001S0N041RD           
FDE Capable: Capable
FDE Enable: Disable
Secured: Unsecured
Locked: Unlocked
Needs EKM Attention: No
Foreign State: None
Device Speed: 6.0Gb/s
Link Speed: 6.0Gb/s
Media Type: Hard Disk Device
Drive Temperature :30C (86.00 F)
PI Eligibility:  No
Drive is formatted for PI information:  No
PI: No PI
Port-0 :
Port status: Active
Port's Linkspeed: 6.0Gb/s
Port-1 :
Port status: Active
Port's Linkspeed: Unknown
Drive has flagged a S.M.A.R.T alert : No



...clipped 6th drive so it's under 10,000 characters...




Exit Code: 0x00
 

Tracy Perry

Well-known member
#9
Not always... if they are using a hardware RAID (which it looks like in the original post), the operating system doesn't know about the individual drives since the RAID controller is presenting them to the server as a single drive.
This!
I know that on both of the Dell's I have at the house that have hardware RAID, as far as Linux (and centOS on the other one) are concerned they only see 1 (actually 2 on one of the Dell's since I have 3 73GB's set into one unit and the 5 other 320GB's into another). As far as the OS is concerned there is only one (or 2) and not 6 (or 8) drives. On the server I run my forum on it uses software RAID and it does detect it.