3510 Disk Array
Overview
Here is an example of how to mount a SE3510-FC Disk Array using the SAN Foundation Kit 4.2
File System GB /ora/oradata1 75 /ora/oradata2 75 /ora/oradata3 55.5
3510s generally have 2 logical drives configured, (for example with 4 x 73gb HDD each, 209gb total presented space). One is allocated to controller connection 0. The other is allocated to controller connection 4, which represents the HDA (PCI fiber controller) that is physically connected to a UNNIX box.
Set up your 3510 with a RAID5 configuration.
Create a static IP address for the 3510. This can be used for telnet access, or you can access the 3510 disk array using the serial cable attached to the back of the unit (38400, 8-N-1, no flow control, VT100 emulation).
Installation Steps on a 280R w/Solaris 8
- Equipment Inventory
- Array and disks
- HBA's
- FC cable length and connnector check (LC-LC)
- Rack kit
- Power cords
- DB9 serial cable
- CDROM
- Prerequisite patches and packages
- Install most recent Solaris Rec Patch Cluster (from single-user mode)
- Install latest revision of 280R platform patches
- 111293 devlinks
- 111292 obp
- 110723 eri (done)
- 109882 eri (done)
- 110800 rsc (only if rsc pkg is installed)
- Install SAN Foundation Kit 4.2
- Install SFK patch
- 111847 sfk
- Install fibre channel patches
- 111095 fctl/fp/fcp/usoc driver
- 111096 fcip driver and adb macros
- 111097 qlc driver
- 111412 mpxio driver (traffic mgr)
- Reboot
- Download 113723-03 3510-FC Array FW patch
- Storage Planning
- Hosts
- plan mount points
- Choose lun slicing method. Disksuite
- Storage
- choose raid levels
- plan logical drives (back-end raid group)
- optional logical drives partitioning
- plan luns
- plan lun masking
- plan hot spares
- Multi-pathing software (if hosts will have multiple HBA's)
- SDS DMP
- Hosts
- Rack-Up
- Bolt into existing rack
- Dual AC power on separte circuits (110 or 208)
- Cabling to hosts
- Power up
- Server
- Install HBA's
- Solaris Storage Config (Initial)
- Verify SAN Foundation Kit 4.2 and 111847 are installed
- Configure HBA driver for 'loop' mode (automatic?)
- Reboot
- Get HBA's WWPN with 'luxadm probe'
- Array Config (Initial)
- Connect to serial console (DB9) with cross-over cable (included) (38400,8,none,1)
- Assign IP address & netmask
- Check & update array firmware (patch 113723-03 firmware 3.27M)
- Array Config (Final)
- Verify physical disks
- Select 'loop' mode (for direct connect hosts)
- Add host id's to host channels
- Create logical drives
- Assign each logical drive to a controller
- Optional partitioning of logical drives (128 part/lg)
- Assign hosts to host channels
- Map logical drive 'partition' to host
or
- Apply lun masking to logical drive
- Assign hot spare
- Reset controller
- Save array config to hard disk
- Solaris Storage Config (Final)
- Import lun's
- Label lun's
- Install, patch and configure multi-pathing software (if using dual HBA servers)
- Slice LUNs with Disksuite
- Create/mount filesystems
- Optional Solaris Software (for 3510 management)
- Configuration Service 1.2 (management gui - from cdrom)
- Diagnostic Reporter 1.2 (monitor and notification - from cdrom)
280R Patches
Here are patches required to install on Solaris 8:
PatchID # SunFire-280R Descr Group/reason 111228-01 YES cpu fru updater skip, don't fruid 111293-03 YES devlinks <<< 280_platform group 110383-01 YES old kernel obsolete 108528-09 YES kernel sol 8 rec cluster 109888-05 YES,note1 platform not needed S8 2/02 111292-03 YES obp obp group 110723-02 YES eri general group 109882-04 YES eri general group 110800-01 YES rsc 2.0 general group (rsc 2.2)
3510 Install Status
- SAN Foundation Kit 4.2 and the SFK Patch
- all fiber channel patches
- Openboot diagnostics to make sure the card is visible to the system (and it looks good):
{0} ok show-devs /pci@8,600000 /pci@8,700000 /memory-controller@1,400000 /SUNW,UltraSPARC-III+@1,0 /memory-controller@0,400000 /SUNW,UltraSPARC-III+@0,0 /virtual-memory /memory@m0,0 /aliases /options /openprom /chosen /packages /pci@8,600000/SUNW,qlc@4 /pci@8,600000/SUNW,qlc@4/fp@0,0 /pci@8,600000/SUNW,qlc@4/fp@0,0/disk /pci@8,700000/SUNW,qlc@3 /pci@8,700000/SUNW,hme@2,1 /pci@8,700000/pci108e,1000@2 /pci@8,700000/scsi@6,1 /pci@8,700000/scsi@6 /pci@8,700000/usb@5,3 /pci@8,700000/network@5,1 /pci@8,700000/ebus@5 /pci@8,700000/SUNW,qlc@3/fp@0,0 /pci@8,700000/SUNW,qlc@3/fp@0,0/disk /pci@8,700000/scsi@6,1/tape /pci@8,700000/scsi@6,1/disk /pci@8,700000/scsi@6/tape /pci@8,700000/scsi@6/disk /pci@8,700000/ebus@5/serial@1,400000 /pci@8,700000/ebus@5/rsc-console@1,3083f8 /pci@8,700000/ebus@5/rsc-control@1,3062f8 /pci@8,700000/ebus@5/parallel@1,300278 /pci@8,700000/ebus@5/pmc@1,300700 /pci@8,700000/ebus@5/gpio@1,300600 /pci@8,700000/ebus@5/rtc@1,300070 /pci@8,700000/ebus@5/beep@1,32 /pci@8,700000/ebus@5/i2c@1,30 /pci@8,700000/ebus@5/i2c@1,2e /pci@8,700000/ebus@5/power@1,30002e /pci@8,700000/ebus@5/bbc@1,0 /pci@8,700000/ebus@5/flashprom@0,0 /pci@8,700000/ebus@5/i2c@1,30/rscrtc@0,d0 /pci@8,700000/ebus@5/i2c@1,30/power-supply@0,ae /pci@8,700000/ebus@5/i2c@1,30/power-supply@0,ac /pci@8,700000/ebus@5/i2c@1,30/power-distribution-board@0,aa /pci@8,700000/ebus@5/i2c@1,30/remote-system-console@0,a6 /pci@8,700000/ebus@5/i2c@1,30/fcal-backplane@0,a4 /pci@8,700000/ebus@5/i2c@1,30/ioexp@0,7c /pci@8,700000/ebus@5/i2c@1,30/ioexp@0,7a /pci@8,700000/ebus@5/i2c@1,30/ioexp@0,72 /pci@8,700000/ebus@5/i2c@1,30/motherboard-fru@0,a8 /pci@8,700000/ebus@5/i2c@1,30/fan-control@0,48 /pci@8,700000/ebus@5/i2c@1,30/temperature@0,98 /pci@8,700000/ebus@5/i2c@1,30/cpu-fru@0,a2 /pci@8,700000/ebus@5/i2c@1,30/temperature@0,30 /pci@8,700000/ebus@5/i2c@1,30/cpu-fru@0,a0 /pci@8,700000/ebus@5/i2c@1,2e/idprom@0,a0 /pci@8,700000/ebus@5/i2c@1,2e/nvram@0,a0 /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,ae /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,ac /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,aa /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,a8 /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,a6 /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,a4 /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,a2 /pci@8,700000/ebus@5/i2c@1,2e/dimm-fru@1,a0 /openprom/client-services /packages/kbd-translator /packages/dropins /packages/SUNW,debug /packages/obp-tftp /packages/terminal-emulator /packages/disk-label /packages/deblocker /packages/SUNW,builtin-drivers {0} ok apply show-children /pci@8,700000/SUNW,qlc@3 LiD HA LUN --- Port WWN --- ----- Disk description ----- 2c 9f 0 256000c0ffc01586 SUN StorEdge 3510 327K {0} ok apply show-children /pci@8,600000/SUNW,qlc@4 LiD HA LUN --- Port WWN --- ----- Disk description ----- 0 0 0 21000004cf785b12 SEAGATE ST336605FSUN36G 0438 1 1 0 21000004cf78664d SEAGATE ST336605FSUN36G 0438 {0} ok - mars [3:36pm] # format
Searching for disks...done c3t44d0: configured with capacity of 204.34GB AVAILABLE DISK SELECTIONS: 0. c1t0d0/pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf785b12,0 1. c1t1d0 /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf78664d,0 2. c3t44d0 /pci@8,700000/SUNW,qlc@3/fp@0,0/ssd@w256000c0ffc01586,0 Specify disk (enter its number): 2 selecting c3t44d0 [disk formatted] Disk not labeled. Label it now? y FORMAT MENU: disk - select a disk type - select (define) a disk type partition - select (define) a partition table current - describe the current disk format - format and analyze the disk repair - repair a defective sector label - write label to the disk analyze - surface analysis defect - defect list management backup - search for backup labels verify - read and display labels save - save new disk/partition definitions inquiry - show vendor, product and revision volname - set 8-character volume name ! - execute , then return quit format> part PARTITION MENU: 0 - change `0' partition 1 - change `1' partition 2 - change `2' partition 3 - change `3' partition 4 - change `4' partition 5 - change `5' partition 6 - change `6' partition 7 - change `7' partition select - select a predefined table modify - modify a predefined partition table name - name the current table print - display the current table label - write partition map and label to the disk ! - execute , then return quit partition> print Current partition table (default): Total disk cylinders available: 52723 + 2 (reserved cylinders) Part Tag Flag Cylinders Size Blocks 0 root wm 0 - 32 130.97MB (33/0/0) 268224 1 swap wu 33 - 65 130.97MB (33/0/0) 268224 2 backup wu 0 - 52722 204.34GB (52723/0/0) 428532544 3 unassigned wm 0 0 (0/0/0) 0 4 unassigned wm 0 0 (0/0/0) 0 5 unassigned wm 0 0 (0/0/0) 0 6 usr wm 66 - 52722 204.08GB (52657/0/0) 427996096 7 unassigned wm 0 0 (0/0/0) 0 partition> quit FORMAT MENU: disk - select a disk type - select (define) a disk type partition - select (define) a partition table current - describe the current disk format - format and analyze the disk repair - repair a defective sector label - write label to the disk analyze - surface analysis defect - defect list management backup - search for backup labels verify - read and display labels save - save new disk/partition definitions inquiry - show vendor, product and revision volname - set 8-character volume name ! - execute , then return quit format> quit Anytime you call Sun with 3510 problems, they are going to ask you to run an Explorer diagnostic on the Sun server and a se3kxtr diagnostic on the 3510 disk array:
- cd /opt/SUNWexplo/bin
- ./explorer
Output will be saved to: /opt/SUNWexplo/output in the form of 'explorer.UNIQUEID.machinename-YYYY.MM.DD.XX.XX.tar.gz'
To run the se3kxtr Tool:
./se3kxtr
Output will be saved to: ~mkern/ in the form of 'se3kxtr.UNIQUEID.machinename-YYYY.MM.DD.XX.XX.tar.gz'
See also:
