1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Raid config

Discussion in 'Server Configuration and Hosting' started by Max, Sep 25, 2013.

  1. Max

    Max Active Member

    Recently we bought a Bi Xeon E5 server with the config
    256GB RAM
    HardRAID : LSI MegaRAID 9271 6 Gbps FastPath
    Hard drive : 2 x 300GB SSD
    DirectAdmin

    1. Can anyone suggest me good partition structure.. like how much for temp, root, home etc.. I want to have this in RAID

    We are planning to run few large Xenforo's on this. Not for VM or web hosting purposes.

    2. When i check with df-h

    Code:
    
    Filesystem            Size  Used Avail Use% Mounted on
    rootfs                9.8G  605M  8.7G   7% /
    /dev/root             9.8G  605M  8.7G   7% /
    devtmpfs              126G  348K  126G   1% /dev
    /dev/sda2             265G   60M  251G   1% /home
    tmpfs                 126G     0  126G   0% /dev/shm
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/var/named
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.conf
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.rfc1912.zones
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/rndc.key
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/usr/lib64/bind
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.iscdlv.key
    /dev/root             9.8G  605M  8.7G   7% /var/named/chroot/etc/named.root.key
    
    
    Is it RAID or not?
    Why so much /dev/root s?
     
    Nathan Baker likes this.
  2. Digital Doctor

    Digital Doctor Well-Known Member

    256GB RAM
    - that's alotta RAM.
     
  3. Floren

    Floren Well-Known Member

    What is the output of:
    # fdisk -cul
     
  4. RoldanLT

    RoldanLT Well-Known Member

  5. Max

    Max Active Member

    Code:
    Disk /dev/sda: 299.5 GB, 299506860032 bytes
    255 heads, 63 sectors/track, 36412 cylinders, total 584974336 sectors
    Units = sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 4096 bytes
    I/O size (minimum/optimal): 4096 bytes / 4096 bytes
    Disk identifier: 0x000703d3
    
      Device Boot      Start        End      Blocks  Id  System
    /dev/sda1  *        4096    20975615    10485760  83  Linux
    /dev/sda2        20975616  583917567  281470976  83  Linux
    /dev/sda3      583917568  584968191      525312  82  Linux swap / Solaris
    
     
  6. Max

    Max Active Member

    Nathan Baker and RoldanLT like this.
  7. Floren

    Floren Well-Known Member

    You only have one disk installed/connected, not 2. Can't use RAID.
    2 disks installed:
    Code:
    # fdisk -cul | grep 'Disk /dev/sd'
    Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
    Disk /dev/sda: 1000.2 GB, 1000204886016 bytes
    Edit: To answer your original question, this is what I use on all builds:
    Code:
    # pvs
      PV         VG    Fmt  Attr PSize   PFree
      /dev/md1   vg_os lvm2 a--  930.88g 807.88g
    # vgs
      VG    #PV #LV #SN Attr   VSize   VFree
      vg_os   1   6   0 wz--n- 930.88g 807.88g
    # lvs
      LV      VG    Attr      LSize  Pool Origin Data%  Move Log Cpy%Sync Convert
      lv_home vg_os -wi-ao--- 10.00g
      lv_opt  vg_os -wi-ao--- 10.00g
      lv_root vg_os -wi-ao--- 10.00g
      lv_swap vg_os -wi-ao---  8.00g
      lv_tmp  vg_os -wi-ao---  5.00g
      lv_var  vg_os -wi-ao--- 80.00g
    This will allow you to grow the LV's based on your needs and also be able to add new disks to increase the VG size.
     
    Last edited: Sep 27, 2013
  8. digitalpoint

    digitalpoint Well-Known Member

    Not always... if they are using a hardware RAID (which it looks like in the original post), the operating system doesn't know about the individual drives since the RAID controller is presenting them to the server as a single drive.

    For example, this is my fdisk output on one of my servers (pretty much fdisk doesn't know WTF is going on... haha):
    Code:
    WARNING: GPT (GUID Partition Table) detected on '/dev/sda'! The util fdisk doesn't support GPT. Use GNU Parted.
    
    Disk /dev/sda: 3596.0 GB, 3595999117312 bytes
    255 heads, 63 sectors/track, 437188 cylinders, total 7023435776 sectors
    Units = sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk identifier: 0x00000000
    
       Device Boot      Start         End      Blocks   Id  System
    /dev/sda1            2048     4208639     2103296   82  Linux swap / Solaris
    /dev/sda2   *     4208640     4417535      104448   83  Linux
    /dev/sda4               1           1           0+  ee  GPT
    
    Partition table entries are not in disk order
    Since you have a MegaRAID adapter, I would suggest installing their MegaCli tools, which lets you pretty much do anything with the adapter without needing to reboot and get into it's BIOS.

    Some pretty good info about stuff you can do with it here: http://artipc10.vub.ac.be/wordpress/2011/09/12/megacli-useful-commands/

    For example if you want to see basic info about your partitioning (you can see that the "state" is "Optimal"... not rebuilding or degraded, you can see I have 6 drives in a RAID-6 setup, etc.):
    Code:
    twin1:~ # /opt/MegaRAID/MegaCli/MegaCli64 -LDInfo -Lall -aALL
                                        
    
    Adapter 0 -- Virtual Drive Information:
    Virtual Drive: 0 (Target Id: 0)
    Name                :
    RAID Level          : Primary-6, Secondary-0, RAID Level Qualifier-3
    Size                : 3.270 TB
    Parity Size         : 1.634 TB
    State               : Optimal
    Strip Size          : 64 KB
    Number Of Drives    : 6
    Span Depth          : 1
    Default Cache Policy: WriteBack, ReadAhead, Cached, No Write Cache if Bad BBU
    Current Cache Policy: WriteThrough, ReadAhead, Cached, No Write Cache if Bad BBU
    Default Access Policy: Read/Write
    Current Access Policy: Read/Write
    Disk Cache Policy   : Disk's Default
    Encryption Type     : None
    Bad Blocks Exist: No
    Is VD Cached: Yes
    Cache Cade Type : Read Only
    
    
    
    Exit Code: 0x00
    If you want to get info about individual physical drives right down to drive models and serial numbers:

    Code:
    twin1:/home/bin # /opt/MegaRAID/MegaCli/MegaCli64 -PDList -aALL
                                        
    Adapter #0
    
    Enclosure Device ID: 252
    Slot Number: 0
    Drive's postion: DiskGroup: 0, Span: 0, Arm: 0
    Enclosure position: N/A
    Device Id: 12
    WWN: 5000C5005FB719B4
    Sequence Number: 2
    Media Error Count: 0
    Other Error Count: 0
    Predictive Failure Count: 0
    Last Predictive Failure Event Seq Number: 0
    PD Type: SAS
    
    Raw Size: 838.362 GB [0x68cb9e30 Sectors]
    Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
    Coerced Size: 837.258 GB [0x68a84800 Sectors]
    Firmware state: Online, Spun Up
    Commissioned Spare : No
    Emergency Spare : No
    Device Firmware Level: 0001
    Shield Counter: 0
    Successful diagnostics completion on :  N/A
    SAS Address(0): 0x5000c5005fb719b5
    SAS Address(1): 0x0
    Connected Port Number: 0(path0)
    Inquiry Data: SEAGATE ST900MM0036     0001S0N04XDG           
    FDE Capable: Capable
    FDE Enable: Disable
    Secured: Unsecured
    Locked: Unlocked
    Needs EKM Attention: No
    Foreign State: None
    Device Speed: 6.0Gb/s
    Link Speed: 6.0Gb/s
    Media Type: Hard Disk Device
    Drive Temperature :31C (87.80 F)
    PI Eligibility:  No
    Drive is formatted for PI information:  No
    PI: No PI
    Port-0 :
    Port status: Active
    Port's Linkspeed: 6.0Gb/s
    Port-1 :
    Port status: Active
    Port's Linkspeed: Unknown
    Drive has flagged a S.M.A.R.T alert : No
    
    
    
    Enclosure Device ID: 252
    Slot Number: 1
    Drive's postion: DiskGroup: 0, Span: 0, Arm: 1
    Enclosure position: N/A
    Device Id: 13
    WWN: 5000C5005FB71570
    Sequence Number: 2
    Media Error Count: 0
    Other Error Count: 0
    Predictive Failure Count: 0
    Last Predictive Failure Event Seq Number: 0
    PD Type: SAS
    
    Raw Size: 838.362 GB [0x68cb9e30 Sectors]
    Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
    Coerced Size: 837.258 GB [0x68a84800 Sectors]
    Firmware state: Online, Spun Up
    Commissioned Spare : No
    Emergency Spare : No
    Device Firmware Level: 0001
    Shield Counter: 0
    Successful diagnostics completion on :  N/A
    SAS Address(0): 0x5000c5005fb71571
    SAS Address(1): 0x0
    Connected Port Number: 1(path0)
    Inquiry Data: SEAGATE ST900MM0036     0001S0N04XE2           
    FDE Capable: Capable
    FDE Enable: Disable
    Secured: Unsecured
    Locked: Unlocked
    Needs EKM Attention: No
    Foreign State: None
    Device Speed: 6.0Gb/s
    Link Speed: 6.0Gb/s
    Media Type: Hard Disk Device
    Drive Temperature :31C (87.80 F)
    PI Eligibility:  No
    Drive is formatted for PI information:  No
    PI: No PI
    Port-0 :
    Port status: Active
    Port's Linkspeed: 6.0Gb/s
    Port-1 :
    Port status: Active
    Port's Linkspeed: Unknown
    Drive has flagged a S.M.A.R.T alert : No
    
    
    
    Enclosure Device ID: 252
    Slot Number: 2
    Drive's postion: DiskGroup: 0, Span: 0, Arm: 2
    Enclosure position: N/A
    Device Id: 18
    WWN: 5000C5006803676C
    Sequence Number: 4
    Media Error Count: 0
    Other Error Count: 0
    Predictive Failure Count: 0
    Last Predictive Failure Event Seq Number: 0
    PD Type: SAS
    
    Raw Size: 838.362 GB [0x68cb9e30 Sectors]
    Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
    Coerced Size: 837.258 GB [0x68a84800 Sectors]
    Firmware state: Online, Spun Up
    Commissioned Spare : No
    Emergency Spare : No
    Device Firmware Level: 0001
    Shield Counter: 0
    Successful diagnostics completion on :  N/A
    SAS Address(0): 0x5000c5006803676d
    SAS Address(1): 0x0
    Connected Port Number: 2(path0)
    Inquiry Data: SEAGATE ST900MM0036     0001S0N0731G           
    FDE Capable: Capable
    FDE Enable: Disable
    Secured: Unsecured
    Locked: Unlocked
    Needs EKM Attention: No
    Foreign State: None
    Device Speed: 6.0Gb/s
    Link Speed: 6.0Gb/s
    Media Type: Hard Disk Device
    Drive Temperature :31C (87.80 F)
    PI Eligibility:  No
    Drive is formatted for PI information:  No
    PI: No PI
    Port-0 :
    Port status: Active
    Port's Linkspeed: 6.0Gb/s
    Port-1 :
    Port status: Active
    Port's Linkspeed: Unknown
    Drive has flagged a S.M.A.R.T alert : No
    
    
    
    Enclosure Device ID: 252
    Slot Number: 3
    Drive's postion: DiskGroup: 0, Span: 0, Arm: 3
    Enclosure position: N/A
    Device Id: 15
    WWN: 5000C5005FB7149C
    Sequence Number: 2
    Media Error Count: 0
    Other Error Count: 0
    Predictive Failure Count: 0
    Last Predictive Failure Event Seq Number: 0
    PD Type: SAS
    
    Raw Size: 838.362 GB [0x68cb9e30 Sectors]
    Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
    Coerced Size: 837.258 GB [0x68a84800 Sectors]
    Firmware state: Online, Spun Up
    Commissioned Spare : No
    Emergency Spare : No
    Device Firmware Level: 0001
    Shield Counter: 0
    Successful diagnostics completion on :  N/A
    SAS Address(0): 0x5000c5005fb7149d
    SAS Address(1): 0x0
    Connected Port Number: 3(path0)
    Inquiry Data: SEAGATE ST900MM0036     0001S0N04XED           
    FDE Capable: Capable
    FDE Enable: Disable
    Secured: Unsecured
    Locked: Unlocked
    Needs EKM Attention: No
    Foreign State: None
    Device Speed: 6.0Gb/s
    Link Speed: 6.0Gb/s
    Media Type: Hard Disk Device
    Drive Temperature :30C (86.00 F)
    PI Eligibility:  No
    Drive is formatted for PI information:  No
    PI: No PI
    Port-0 :
    Port status: Active
    Port's Linkspeed: 6.0Gb/s
    Port-1 :
    Port status: Active
    Port's Linkspeed: Unknown
    Drive has flagged a S.M.A.R.T alert : No
    
    
    
    Enclosure Device ID: 252
    Slot Number: 4
    Drive's postion: DiskGroup: 0, Span: 0, Arm: 4
    Enclosure position: N/A
    Device Id: 16
    WWN: 5000C5005F74F33C
    Sequence Number: 2
    Media Error Count: 0
    Other Error Count: 0
    Predictive Failure Count: 0
    Last Predictive Failure Event Seq Number: 0
    PD Type: SAS
    
    Raw Size: 838.362 GB [0x68cb9e30 Sectors]
    Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors]
    Coerced Size: 837.258 GB [0x68a84800 Sectors]
    Firmware state: Online, Spun Up
    Commissioned Spare : No
    Emergency Spare : No
    Device Firmware Level: 0001
    Shield Counter: 0
    Successful diagnostics completion on :  N/A
    SAS Address(0): 0x5000c5005f74f33d
    SAS Address(1): 0x0
    Connected Port Number: 4(path0)
    Inquiry Data: SEAGATE ST900MM0036     0001S0N041RD           
    FDE Capable: Capable
    FDE Enable: Disable
    Secured: Unsecured
    Locked: Unlocked
    Needs EKM Attention: No
    Foreign State: None
    Device Speed: 6.0Gb/s
    Link Speed: 6.0Gb/s
    Media Type: Hard Disk Device
    Drive Temperature :30C (86.00 F)
    PI Eligibility:  No
    Drive is formatted for PI information:  No
    PI: No PI
    Port-0 :
    Port status: Active
    Port's Linkspeed: 6.0Gb/s
    Port-1 :
    Port status: Active
    Port's Linkspeed: Unknown
    Drive has flagged a S.M.A.R.T alert : No
    
    
    
    ...clipped 6th drive so it's under 10,000 characters...
    
    
    
    
    Exit Code: 0x00
     
    p4guru likes this.
  9. Tracy Perry

    Tracy Perry Well-Known Member

    This!
    I know that on both of the Dell's I have at the house that have hardware RAID, as far as Linux (and centOS on the other one) are concerned they only see 1 (actually 2 on one of the Dell's since I have 3 73GB's set into one unit and the 5 other 320GB's into another). As far as the OS is concerned there is only one (or 2) and not 6 (or 8) drives. On the server I run my forum on it uses software RAID and it does detect it.
     
  10. Floren

    Floren Well-Known Member

    Ya you are right, I did not noticed the hardware RAID. Is this part that got me confused:
    Disk identifier: 0x00000000
     

Share This Page