IBM System Storage™ DS4000 Storage Manager version 9.19 for Novell NetWare 6.5 with Service Pack 5 or higher IMPORTANT: Starting with the DS4000 Storage Manager version 9.16 release, there is not any IBM System Storage™ DS4000 Storage Manager host software packages (i.e.. SMclient, SMutil) for the Novell Netware™ operating system environments. To manage the DS4000 storage subsystems that are IO attached to the Novell Netware server hosts, you must install the DS4000 Storage Manager client software (SMclient) on a Microsoft Windows or Linux management workstation and manage the DS4000 storage subsystem via out-of- band management method. The SMclient program is included in the IBM System Storage™ DS4000 Storage Manager version 9.19 for the 32bit (x86) version of Linux operating systems or the IBM System Storage™ DS4000 Storage Manager version 9.19 for Microsoft Windows operating systems host software packages. These packages are available included in the CD-ROM and are also available for download from the IBM System Storage™ DS4000 Support web site - http://www.ibm.com/servers/storage/support/disk/. NOTE TO SERVICE – Reference RETAIN # N/A (C) Copyright International Business Machines Corporation 1999, 2006. All rights reserved. US Government Users Restricted Rights - Use, duplication, or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Note: Before using this information and the product it supports, read the general information in section 6 "Trademarks and Notices” in this document. Note: Novell NetWare host attachment to the IBM 1722-all models (DS4300), the IBM 1724-all models (DS4100), the IBM 1814-all models (DS4200 and DS4700) and the 1815-all models (DS4800) requires the additional purchase of an IBM DS4100/DS4200/DS4300/DS4700/DS4800 Novell NetWare Host Kit Option. The IBM DS4000 Novell NetWare Host Kit options contain the required IBM licensing to attach a Novell NetWare Host System to the DS4100, DS4200, DS4300, DS4700 or DS4800 storage subsystems. Please contact your IBM service representative or IBM resellers for purchasing information. Refer to the IBM System Storage™ Support Web Site or IBM System Storage™ DS4000 Storage Manager host software package for the Novell Netware CD for the IBM DS4000 Storage Manager version 9 Installation and Support Guides for Windows 2000/Server 2003, Netware, ESX Server, and Linux. This guide along with the DS4000 Storage Manager program Online Help provide the installation and support information. Last Update: 10/26/2006 Please refer to corresponding Change History document for more information on new features and modifications. Products Supported ---------------------------------------------------------------- | New Model | Old Model | Machine Type | Model | |------------|-----------|--------------|------------------------| | DS4800 | N/A | 1815 | 82A, 82H, 84A, 84H, | | | | | 88A, 88H, 80A, 80H | |------------|-----------|--------------|------------------------| | DS4700 | N/A | 1814 | 70A, 70H, 72A, 72H, | | | | | 70T, 70S, 72T, 72S, | |------------|-----------|--------------|------------------------| | DS4500 | FAStT 900 | 1742 | 90X, 90U | |------------|-----------|--------------|------------------------| | DS4400 | FAStT 700 | 1742 | 1RX, 1RU | |------------|-----------|--------------|------------------------| | DS4300 | FAStT 600 | 1722 | 6LX, 6LU, 6LJ, 60X | | | | | 60U, 60J, 60K, 60L | |------------|-----------|--------------|------------------------| | DS4200 | N/A | 1814 | 7VA, 7VH | |----------- |-----------|--------------|------------------------| | DS4100 | FAStT 100 | 1724 | 100, 1SC | |----------- |-----------|--------------|------------------------| | N/A | FAStT 500 | 3552 | 1RX, 1RU | |------------|-----------|--------------|------------------------| | N/A | FAStT 200 | 3542 | 1RX, 1RU, 2RX and 2RU | ------------ --------------------------------------------------- ATTENTION: - The DS4000 storage subsystem controller firmware version 05.40.xx.xx and earlier along with its associated NVSRAM files should not be loaded into DS4000 storage subsystems connected to DS4000 EXP100 drive expansion enclosures. - For the DS4300 with Standard(base) or Turbo options, the DS4400 and the DS4500 storage subsystems connected to the DS4000 EXP100 drive expansion enclosures, the latest controller firmware version 06.12.xx.xx and its associated NVSRAM file must be used. In addition, the DS4100 storage server - all models (Standard/dual controller and Single Controller) are now supporting the controller firmware version 06.12.xx.xx. - For the DS4300 storage subsystems with Single Controller option, the controller firmware version 05.34.xx.xx and its associated NVSRAM file must be used. Do not attempt to download the controller firmware version 06.1x.xx.xx into these DS4300 storage subsystem models with single controller option. - For the FAStT200 (M/T 3542-all models) and FAStT500 (M/T 3552-all models) storage subsystems, the controller firmware version 05.30.xx.xx and its associated NVSRAM file must be used. Do not attempt to download the controller firmware version 06.1x.xx.xx into these DS4000 storage subsystems. - For the DS4300 with Standard(dual controller) or Turbo options and the DS4500 storage subsystems connected to the DS4000 EXP810 drive expansion enclosures, the latest controller firmware version 06.19.xx.xx and its associated NVSRAM file must be used. CONTENTS ----------------- 1.0 Overview 2.0 Installation and Setup Instructions 3.0 Configuration Information 4.0 Unattended Mode 5.0 Web Sites and Support Phone Number 6.0 Trademarks and Notices 7.0 Disclaimer ======================================================================= 1.0 Overview ------------------- This IBM Storage Manager package includes the IBM DS4000 Storage Manager host software version 9.19 for Novell NetWare. This version 9.19 of the DS4000 Storage Manager host software is required for managing the DS4300- standard (dual controller) or Turbo models and the DS4500-all models, with controller firmware version 06.19.xx.xx. Also, the DS4000 Storage Manager version 9.19 is recommended for managing the DS4700-all models, DS4200-all models and DS4800-models 80A/80H with controller firmware version 6.16.8x.xx or higher and the DS4800-models 82x, 84x, and 88x (x is either A or H) with controller firmware version 06.15.xx.xx and 06.16.xx.xx. In addition, it is recommended for managing the following DS4000 storage subsystems - the DS4100-all models, the DS4300- standard (dual controller) or Turbo models, the DS4400-all models and the DS4500-all models - with controller firmware version 06.12.1x.xx or higher installed. NOTE: The controller firmware version 06.16.xx.xx and 6.16.88.xx or higher supports EXP810 and EXP420 drive expansion enclosures, respectively. In addition to the EXP710. But it does not support the attachment of EXP100 SATA drive expansion enclosures. Whereas the controller firmware version 6.12.xx.xx or 06.15.20.xx supports attaching the EXP710 and the EXP100 SATA drive expansion enclosures, but not the attachment of the EXP810. The controller firmware version 06.19.xx.xx is required to support attaching the EXP710, the EXP810, and the EXP100 SATA drive expansion enclosure Starting with the DS4000 Storage Manager version 9.16 release, there are not any IBM System Storage™ DS4000 Storage Manager host software packages for the Novell Netware server operating system environments. To manage the DS4000 storage subsystems that are IO attached to your Novell Netware server hosts, you must install the DS4000 Storage Manager client software (SMclient) on a Windows or Linux management workstation and manage the DS4000 storage subsystem via out-of-band management method. The SMclient program is included in the IBM System Storage™ DS4000 Storage Manager version 9.19 for the 32 and 64 bit version of Linux operating systems or the IBM System Storage™ DS4000 Storage Manager version 9.19 for Microsoft Windows operating systems host software packages. The usage permission of the SMclient program in the IBM System Storage™ DS4000 Storage Manager version 9.19 host software packages for Windows and Linux does not give the user the entitlement to the Windows or Linux host IO privileges. In those DS4000 storage subsystems that require the Windows and Linux host entitlement kits/ options, these kits/options must be purchased before these servers can be IO attached to the DS4000 storage subsystems. The IBM Storage Manager host software version 9.19 new features and changes are described in the corresponding Change History document. Please refer to this document for more information on new features and modifications. These IBM System Storage™ DS4000 Storage Manager version 9.19 host software packages for Windows and Linux and DS4000 storage subsystem firmware files are available in the CD-ROM and are also available for download from the IBM System Storage™ DS4000 Support web site - http://www.ibm.com/servers/storage/support/disk/. Please Refer to the IBM System Storage™ Support Web Site or the DS4000 Storage Manager Version 9.19 Support for Novell Netware CD for the IBM DS4000 Storage Manager version 9 Installation and Support Guides for Windows 2000/Server 2003, Netware, ESX Server, and Linux. This guide along with the DS4000 Storage Manager program Online Help provide the installation and support information. In addition, the Docs directory in the DS4000 Storage Manager Version 9.19 Support for Novell Netware CD- ROM also contains others DS4000 publications that provide helpful information. The latest versions of these files are available on IBM System Storage™ DS4000 Support web site as PDF files. Also, please refer to the readme file(s) that are included in the IBM System Storage™ DS4000 Storage Manager version 9.19 host software package(s) for Windows and Linux for the latest information on usage and installation. IMPORTANT: This release of IBM DS4000 Storage Manager host software supports all DS4000 storage subsystems with general released firmware versions from 05.00.xx.xx up to 06.19.xx.xx. Refer to the IBM DS4000 Support Web Site for latest DS4000 controller firmware and NVSRAM files for IBM machine types 1722, 1724, 1742, 1814, 1815, 3542 and 3552. The following table shows the first four digits of the latest controller firmware versions that are currently available for various models of the DS4000 storage subsystems. --------------------------------------------------- | DS4000 Storage | Controller firmware version | | Subsystem Model | | |------------------|--------------------------------| | | | |------------------|--------------------------------| | DS4800 (1815) | 06.15.xx.xx and 6.16.xx.xx | | | (See note below) | |------------------|--------------------------------| | DS4700 (1814) | 06.16.9x.xx (See note below) | |------------------|--------------------------------| | DS4500 (1742) | 06.19.xx.xx | |------------------|--------------------------------| | DS4400 (1742) | 06.12.2x.xx | |------------------|--------------------------------| | DS4300 Turbo | 06.19.xx.xx | | Option (1722) | | |------------------|--------------------------------| | DS4300 | 06.19.xx.xx | | Standard Option | | | (1722) | | |------------------|--------------------------------| | DS4300 Single | 05.34.xx.xx | | Controller Opt. | (for DS4300 SCU | | (1722) | only) | |------------------|--------------------------------| | DS4200 (1814) | 06.16.9x.xx (See note below) | |------------------|--------------------------------| | DS4100 (1724) | 06.12.2x.xx | | (standard dual | | | controller Opt.)| | | | | |------------------|--------------------------------| | FAStT500 (3552) | 05.30.xx.xx | |------------------|--------------------------------| | FAStT200 (3542) | 05.30.xx.xx | --------------------------------------------------- Note: 1. Controller firmware 06.16.xx.xx does not support EXP100 storage expansion enclosures. Do not download it into DS4000 storage subsystems that have EXP100 enclosures attached. For the DS4800 storage subsystems with EXP100 enclosures attached, use the controller firmware version 6.15.xx.xx instead. 2. Controller firmware 06.16.4x.xx and higher is required for the DS4700-all models and the DS4800-model 80A/80H. These models do not support older 06.16.xx.xx versions of controller firmware. 3. Controller firmware 06.16.88.xx and higher is required for the DS4200-all models. These models do not support older 06.16.xx.xx versions of controller firmware. 4. Controller firmware 06.19.xx.xx is required for the DS4300- standard-dual controller or Turbo models and the DS4500-all models, for attaching the EXP810 storage expansion enclosures. New features that are introduced with the controller firmware version 06.19.xx.xx or later will not be available for any DS4000 storage subsystem controllers without the controller firmware version 06.19.xx.xx installed. Similarly, new features that are introduced with the controller firmware version 06.12.xx.xx or later will not be available for any DS4000 storage subsystem controllers without the controller firmware version 06.12.xx.xx installed. The following table shows the controller firmware versions required for attaching the various models of the DS4000 Storage Expansion Enclosures. --------------------------------------------------------------------- | Controller | EXP Storage Expansion Enclosures | | FW Version |------------------------------------------------------| | | EXP100 | EXP420 | EXP500 | EXP700 | EXP710 | EXP810 | |------------|---------|--------|--------|--------|--------|--------| |5.3x.xx.xx | No | No | Yes | Yes | No | No | |------------|---------|--------|--------|--------|--------|--------| |5.40.xx.xx | No | No | Yes | Yes | No | No | |------------|---------|--------|--------|--------|--------|--------| |5.41.xx.xx | Yes | No | No | No | No | No | |------------|---------|--------|--------|--------|--------|--------| |5.42.xx.xx | Yes | No | No | No | No | No | |------------|---------|--------|--------|--------|--------|--------| |6.00.xx.xx | No | No | No | Yes | Yes | No | |------------|---------|--------|--------|--------|--------|--------| |6.10.xx.xx | No | No | No | Yes | No | No | |------------|---------|--------|--------|--------|--------|--------| |6.12.xx.xx | Yes | No | No | Yes | Yes | No | |------------|---------|--------|--------|--------|--------|--------| |6.14.xx.xx | Yes | No | No | No | Yes | No | |------------|---------|--------|--------|--------|--------|--------| |6.15.xx.xx | Yes | No | No | No | Yes | No | |------------|---------|--------|--------|--------|--------|--------| |6.16.2x.xx | No | No | No | No | Yes | Yes | |------------|---------|--------|--------|--------|--------|--------| |6.16.8x.xx | No | Yes | No | No | Yes | Yes | |------------|---------|--------|--------|--------|--------|--------| |6.16.9x.xx | No | Yes | No | No | Yes | Yes | |------------|---------|--------|--------|--------|--------|--------| |6.19.xx.xx | Yes | No | No | No | Yes | Yes | --------------------------------------------------------------------- ======================================================================= 1.1 Known Issues/Limitations ----------------------------------------- IMPORTANT: The listed limitations are cumulative. However, they are listed by the DS4000 storage subsystem controller firmware and Storage Manager host software releases to indicate which controller firmware and Storage Manager host software release that they were first seen and documented. New limitations with Storage Manager Installer (SMIA) package version 06.19.xx.xx release. 1. Can not increase the capacity of RAID arrays. RAID arrays with certain combinations of selected segment size and number of drives that made up the arrays will exceed the available working space in controller dacstore, causing a reconfiguration request (like expanding the capacity of the array) to be denied. These combinations are generally the largest segment size (512KB) with the number of drives in the array is 15 drives or more. There is no work-around. C324144 105008 2. Interoperability problem between the Tachyon DX2 chip in the DS4500 and the DS4300 storage subsystem controllers and the Emulex SOC 422 chip in the EXP810 expansion enclosure ESMs causing up to 5 Fibre Channel loop type errors to be posted in the DS4000 storage subsystem Major Event Log during a 24 hour period. There is a small window in the SOC 422 chip that multiple devices can be opened at one time. This ultimately leads to Fibre Channel loop errors of Fibre Channel link up/down, Drive returned CHECK CONDITION, and Timeout on drive side of controller. IBM recommends the use of the Read-Link-Status function to monitor drive loop for any problems in the drive loop/channel. There is no work-around. 3. The single digit of the Enclosure IDs for all enclosures (including the DS4000 storage subsystem with internal drive slots) in a given redundant drive loop/channel pair must be unique. For example, with four enclosures attached to the DS4300, the correct enclosure ID settings should be x1, x2, x3, and x4 (where x can be any digit that can be set). Examples of incorrect settings would be 11, 21, 31, and 41 or 12, 22, 32, and 62. These examples are incorrect because the x1 digits are the same in all enclosure IDs (either 1 or 2). If you do not set the single digit of the enclosure IDs to be unique among enclosures in a redundant drive loop/channel pair, then drive loop/channel errors might be randomly posted in the DS4000 subsystem Major Event Log (MEL), especially in the cases where the DS4300 storage substems are connected to EXP810s and EXP100s. In additon, enclosure IDs with same single digits in a redundant drive loop/channel pair will cause the DS4000 subsystem controller to assign a soft AL_PA address to devices in the redundant drive loop/channel pair. The problem with soft AL_PA addressing is that AL_PA address assignment can change between LIPs. This possibility increases the difficulty of troubleshooting drive loop problems because it is difficult to ascertain whether the same device with a different address or a different device might be causing a problem. 4. If a DS4000 subsystem undergoes any operation that causes the controller to reset and go through the start-of-day boot process while you are attempting to add hardware, drives, or logical drives associated with the controller, the controller will send alert event notifications to the DS4000 subsystem Major Event Log (MEL) Log. The events indicate that the drives or the logical drives are offline or failed. The event notifications in the MEL Log are expected during the time that the controller is going through a boot process. The workaround is to wait at least 10 minutes after the controller reset is complete before moving logical drives or adding hardware. Use the DS4000 subsystem MEL to verify the time of the last controller reset event. 5. In the DS4300 and DS4500 Installation, User's and Maintenance guides, there are references that might mislead the user into thinking that IBM does not support partially-filled storage expansion enclosures or storage subsystems. IBM does support partially-filled storage expansion enclosures or storage subsystems as long as at least two drives are installed in the storage expansion or subsystem enclosures. However, IBM does not support partially-filled storage expansion enclosures or storage subsystems where the empty slots are required to keep the number of hard drives in the redundant drive loop/channel pair not exceeding the maximum of 112 drives per drive loop/channel. This is to prevent inadvertently inserting drives in those slots causing the controller of getting into the state that might result in lost of access to the storage subsystem. 6. In DS4000 storage subsystem configurations with controller firmware 6.15.2x.xx and higher installed, the performance of write intense workloads such as sequential Tape restores to DS4000 Logical drives with large I/O request sizes (e.g. 256kB) is degraded if the DS4000 logical drives are created with small segment sizes such as 8KB or 16KB. The work around is to create the DS4000 logical drives with segment size of 64KB or higher. Limitations with DS4200/DS4700/DS4800 controller firmware version 6.16.88.xx release None Limitations with DS4800 controller firmware version 6.15.24.xx release (This is the maintenance release of controller firmware version 6.15.xx.xx code thread) None Limitations with DS4000 controller firmware version 6.16.8x.xx release 1. There is not any DS4000 storage subsystems NVSRAM files to disable automatic logical drives transfer (ADT/AVT) as stated in the IBM DS4000 Storage Manager version 9 Installation and Support Guides for Windows 2000/Server 2003, Netware, ESX Server, and Linux publication. One must run the "DisableAVT_Netware.script" SMcli script file. This file is placed in the script folder of the CD-ROM or in the DS4000 storage manager host software package for Novell NetWare. Limitations with DS4000 controller firmware version 6.16.xx.xx release 1. Controller firmware 06.16.xx.xx does not support EXP100 storage expansion enclosures. Do not download it into DS4000 storage subsystems that have EXP100 enclosures attached. After the 06.16.xx.xx controller firmware is activated, the DS4000 storage subsystem will not recognize the drives in EXP100 enclosures, causing loss of data availability to the RAID arrays and logical drives that are defined in those drives. 2. The storage subsystem might not recognize the drives or drive expansion enclosure correctly which results in the displaying of error messages or the inability to perform storage subsystem management operations, such as creating logical drives or arrays or initializing arrays from the storage management software. This behavior could be caused by powering up a DS4000 storage subsystem without any drive expansion enclosures attached and then connecting one or more drive expansion enclosures to the storage subsystem after it completes boot process. The workaround is to make sure that the drive expansion enclosure(s) with at least two drives are connected to the DS4000 storage subsystem before you turn on the storage subsystem power. 3. Remove the drive(s) while the storage subsystem is online and then wait until the storage subsystem is going the boot process following a storage subsystem reboot event to reinsert the (new) drive(s) might cause the drives to be marked as failed after the storage subsystem completes the boot process. The workaround is to wait until the storage subsystem is back online before reinserting the drives. If the storage subsystem still does not recognize the drives, reconstruct the drives by using the Advanced -> Recovery -> Reconstruct menu function in the storage subsystem management window. 4. Uninstalling the storage manager host software package might leave the JAVA JRE directory behind. This problem might occur if you uninstall a copy of the SANtricity Storage Manager software that has been upgraded from a previous release. The newer installation package could not delete the JRE directory created with an older installation package. The workaround is to manually delete any directories left behind after uninstalling the software. 5. When creating remote logical drive mirrors through the SMCli script engine in the DS4000 Storage Manager client program, the following error might display during execution, stopping the remote logical drive mirror creation process: Error 173 - The operation cannot complete because the configuration number on the remote storage array is invalid. Some remote logical drive mirrors might have already been created. Rerun only the portion of the script that should be run to finish creating the rest of the remote logical drive mirrors. 6. A JavaScript error might cause the Glossary pop-up window to stay open when the help contents on the storage management software GUI are closed and reopened. Workaround None. This is a SUN JAVA defect. Limitations with SMIA package version 09.15.xx.06 release for DS4000 controller firmware version 06.12.xx.xx and 06.15.xx.xx release 1. The following error message may be encountered under certain conditions when attempting to create a 2 TB LUN using the Create Logical drive wizard in the Subsystem Management window: "Error 4 - The operation cannot complete because of an incorrect parameter in the command sent to the controller." To avoid this error message, you must take certain steps while using the Create Logical Drive wizard to create a 2 TB LUN. Within the Specify Capacity/Name window within the create logical drive wizard, you must not manually specify the numeric value '2' in the New logical drive capacity field in tandem with the "TB" Units designator. If you do this, the Error 4 message will be issued and you will be unable to create the 2 TB LUN. Click on the up or down arrows next to the input field to select the desire capacity instead. When using the arrows, the program will display the correct maximum logical drive capacity value that can be specified for a given capacity unit (TB, GB, or MB). Limitations with SMIA package version 9.15.xx.xx and DS4000 controller firmware version 06.15.xx.xx release None Limitations with SMIA package version 9.14.xx.05 and DS4000 controller firmware version 06.14.xx.xx release 1. Storage Manager Agent for Netware reported with version 8.00.15.00 instead of 09.14.15.00. 2. The IBM DS4000 Storage Manager Version 9.14 host software for Novell NetWare will be installed in the default directory of SYS:\IBM_DS4000 instead of the SYS:\StorageManager directory as stated in the IBM DS4000 Storage Manager version 9 Installation and Support Guides for Windows 2000/Server 2003, Netware, ESX Server, and Linux publication. Limitations with SMIA package version 9.12.xx.08 and DS4000 controller firmware version 06.12.03.xx release 1. Do not cut and paste the information in the DS4000 Storage Manager online help into the DS4000 Storage Manager script command window or into the text file that will be used as input for the SMcli script engine. Extra space may be inserted in the required parameter names which will cause error(s) during the script command execution. (267873) 2. In the configuration that have both SATA-technology drives (EXP100) and Fibre-Channel technology drives (EXP700/EXP710/DS4100) behind the same DS4000 storage subsystem, do not download drives firmware to both SATA-technology drives and Fibre-Channel(FC) technology drives at the same time. Download the drive firmware to drives of a single drive technology (either SATA or FC) at a time. 3. Currently, IBM does not support Gold key Premium Feature as a chargeable upgrade. The Gold key Premium Feature is enable or disable depending on the DS4000 storage subsystem models. 4. The Asynchronous Remote Mirroring utility, asyncRVMUtil, is not supported. This utility is used to automatically synchronize the logical drives in the Remote Mirroring pairs. Please contact IBM representatives or resellers for the support of this utility in the future. 5. Do not add drive expansion enclosure(s) to the DS4000 storage subsystem drive loops/channels during the ESM firmware download. The ESM firmware download process might fail due to a disconnected FC loop. Either add the drive expansion enclosure(s) before initiating the ESM firmware download or wait until the ESM firmware download is completed before adding additional drive expansion enclosures to the drive loop/channel. (added 2/10/2006) 6. Small Form-factor Pluggable (SFP) hardware that is removed and then reinserted within 10 seconds might not be recognized by the controller. Device polling is done at 10-second intervals. Any device that is removed and replaced within the 10-second window will not be recognized. After removing SFP hardware, ALWAYS wait at least 20 seconds before replacing or reinserting it. (added 2/10/2006) 7. When connected through the DS4000 Storage Manager Agent and mapped logical drives using Storage Partitioning on an in-band managed storage subsystem, the following error message might appear after a successful volume-to-LUN mapping operation: Error 62 - The operation cannot complete because the logical unit number (LUN) is already in use. Please enter another LUN. Verify that the volume-to-LUN mapping was created correctly. If it was, this error is erroneous and can be ignored. (added 2/10/2006) 8. After you disable a premium feature, the Disable Premium Feature dialog might go blank and no longer show any other enabled premium features to select. The workaround is to close and then re-open the dialog. (added 2/10/2006) Limitations with Storage Manager version 9.10.xx.05 and DS4000 controller firmware version 06.10.11.xx release 1. Do not update the DS4000 storage subsystem controller firmware to version 06.1x.xx.xx from versions 05.4x.xx.xx or earlier if the EXP700 esm firmware of the attached exp700 was not at 9326 or higher. If the EXP700 ESM firmware is earlier than the 9326 versions, the EXP700 enclosure and the installed drives may not be displayed in the DS4000 subsystem management window after the controller firmware is upgraded to 06.1x.xx.xx version. The workaround is to update the EXP700 ESM firmware to the version 9326 or higher first before upgrading the controller firmware to version 06.1x.xx.xx. (260160 - 82841) 2. When connecting the EXP100 drive expansion enclosures, one must set the single digit (X1) of the enclosure ID to unique values. This is to prevent the possibility that one of the drives in the EXP100 enclosures be assigned the same ALPA as the DS4000 controller blade under certain DS4000 storage subsystem reboot scenarios. (261188) Limitations with Storage Manager version 9.10.xx.02 and DS4000 controller firmware version 06.10.06.xx release 1. Certain Storage Manager Command Line Interface (SMcli) commands require double-quotes as part of the syntax. The NetWare operating system removes the double-quotes causing the scripts to fail. The workaround is to pass the command through to SMcli using a text file if the double quotes are required as part of the command. The quotes will be preserved and the script will execute correctly. 2. On newly installed versions of NetWare, hot_add will not run if it is not in the search path in the autoexec.ncf file. Edit the autoexec.ncf file and add the following to the search path: search add sys:\ After adding the information to the search path, be sure to save the file and restart the computer. 3. The DS4000 Copy Service RVM is not supported at this time for the DS4100 and the DS4300 storage subsystem with Standard or Single Controller options. (Note: With the release of the controller firmware version 06.12.16.00 or higher, the DS4100 with standard option is now supported Copy Service Remote Mirroring and VolumeCopy premium features.) 4. An NSS volume mapped to a Windows client is rendered inaccessible after a "cluster leave" command on one cluster node caused the NSS Pool to be migrated to the other cluster node. 5. In the Storage Manager version 9 client Subsystem Management window, the preferred owner of a defined logical drive can not be changed if the logical drive is managed by the preferred owner/controller. There is no work-around. If the drive is currently managed by a non- preferred owner/controller, one can change the currently managed non- preferred owner/controller into currently managed preferred owner/controller. 6. Concurrent firmware download (downloading firmware/NVSRAM to the DS4000 storage subsystem controllers with IOs to the host servers) is not supported when upgrading the controller firmware from a 05.xx.xx.xx version to a 06.1x.xx.xx version. ALL IOs must be stopped during the version 06.1x.xx.xx controller firmware upgrade from a 05.xx.xx.xx version. 7. Do not pull or insert drives during the drive firmware download. In addition, ALL IOs must also be stopped during the drive firmware download. Otherwise, drives may be shown as missing, unavailable or failed. 8. Controller diagnostics will not run in a DS4000 storage subsystem with single controller. 9. When instructed to remove and reinsert or to replace a hard drive, wait at least 70 seconds before inserting either the removed existing drive or the new drive into the drive slot. Then, wait up to 3 minutes for the drive to be spun up, recognized by the DS4000 storage subsystem and displayed in the Subsystem Management window before repeating the process for another hard drive. There is no work-around. Similarly, wait at least 70 seconds before reinserting either the removed existing ESM module or the new ESM module into the empty ESM slot in the EXP drive expansion enclosure. Then, wait up to 3 minutes for the ESM CRU to be recognized by the DS4000 storage subsystem and displayed in the Subsystem Management window before repeating the process for another ESM. There is no work-around. 10. Staged firmware and NVSRAM download function is not available on the DS4400 (machine type 1742) models with firmware 06.1x.00.00 in conjunction with IBM Storage Manager 09.1x.xx.xx. Limitations with Storage Manager version 8.4x.xx.xx (and earlier) and DS4000 controller firmware version 05.4x.xx.xx (and earlier) releases 1. When trying to unload the Storage Manager Agent it will not completely unload. After running the "Java -killxxx" command you must then type "unload Java" at the server console. You may then restart the Novell GUI console by typing "startx" at the server console. 2. When trying to configure disks in Console One you will first need to allow the disks to finish synchronizing in Storage Manager prior to trying to create your disks in Console One. 3. When creating a Remote Mirror of a base logical drive, in the case where a FlashCopy of the base logical drive has already been created, the following restriction applies. If the Remote Mirror relationship is created while the base logical drive is receiving I/O, the FlashCopy logical drive will be failed. The work around is to quiesce I/O to the base logical drive while you are creating the remote mirror relationship. Alternatively, if the Remote Mirror relationship is created before creating the FlashCopy logical drive, the FlashCopy logical drive will not be failed. 4. When managing the DS4000 storage subsystems with firmware version 05.3x.xx.xx, the Help window of the Subsystem Management window may not be displayed correctly the topics that are listed as result of executing a full text search. 5. When migrating array(s) from a dual controller DS4000 storage subsystem to a single controller DS4000 storage subsystem, you must first set the preferred owner of the to-be-migrated array(s) to be controller A before inserting it into the drive slots of a single controller DS4000 storage subsystem. Otherwise, the array(s) will not be added to the single controller DS4000 storage subsystem correctly which might cause problems. 6. When managing a single controller DS4000 storage subsystem model, do not use the menu option - Configuration->Automatic... - in the Subsystem Management window to create LUNs. You might not be able to access or manage LUNs that are created this way. 7. You must suspend all I/O while ESM firmware downloads if you select multiple enclosures for downloading ESM firmware. If you select only one enclosure for download at a time, you can download ESM firmware with I/Os. However, IBM recommends that you suspend all I/O activity to perform firmware upgrades. 8. If the EXP100 ESM firmware version is 953x or earlier, no IOs are allowed during the duration that the EXP100 ESMs are being updated with new firmware, including clustering reservation checking IOs. 9. After you replace a controller with a new controller in the single controller models of DS4000 storage subsystems, the premium features become unauthorized and are out of compliance. Any premium features not supported by the firmware of the new controller are unavailable. The work-around is to upgrade the firmware in the new controller to the same level as the removed controller and re-enable the premium features using the key files that you were provided when the premium feature was originally enabled. 10. When you migrating drive Customer Replaceable Units (CRUs) from multiple DS4000 storage subsystems into a single destination DS4000 storage servers, all of the drive CRUs from the same DS4000 storage subsystem should be moved as a ‘set’ into the new destination DS4000 storage server. Before moving the next ‘set’ of drive CRUs, ensure that all of the drive CRUs for a single ‘set’ have been moved to the destination DS4000 storage subsystem. If drive CRUs are not moved as a ‘set’ to the destination DS4000 storage subsystems, the newly relocated array may not appear in the Subsystem Management window. 11. Enclosure IDs may be listed incorrectly in the Subsystem Management window, even if the Enclosure ID switch settings appear to be correct. This is because of the physical design and movement of the Enclosure ID switch, it is possible to leave the switch in a “dead zone” between ID numbers, which will return an incorrect Enclosure ID (this value is 0 in most cases) to the storage management software. When setting the Enclosure ID, ensure that the switch has actuated completely and has settled where the value is clearly visible in the viewing window. 12. To download controller firmware, you must select the drive where the firmware is located. If the drive you select does not respond, the File Selection dialog box will revert to the A: drive and display an error message that drive A: is not ready if there are no media in drive A:. 13. The DS4000 storage subsystem when configured with the DS4000 EXP100 SATA Drive Expansion Unit is currently reporting a higher frequency of informational events such as Destination Driver Events (DDEs) and FibreChannel link up/down events ... in the DS4000 Controller event log compared to the DS4000 storage subsystem configured with Fibre Channel drives. Slower response times of SATA disk drives compared to Fibre Channel disk drives cause higher I/O retries from the DS4000 storage subsystem controllers, resulting in a greater number of informational events logged. In addition, the number of information events reported in the DS4000 storage subsystem event log will also grow in proportion to the increase in I/Os to the Logical Drives. In all cases, the DS4000 storage subsystem controller will always successfully service the timeout I/O on the subsequent retries. 14. When saving the DS4000 storage subsystem event log entries, it may take up to several minutes to save all entries in the event log depending on the DS4000 management workstation resources. However, the DS4000 Storage Manager client GUI will show the completion of the event log saving almost instantly. The work around is to check the file size of the file that the event log entries are saved periodically; if the file size does not change, the event log saving is completed. 15. Do not perform other storage management tasks, such as creating or deleting logical drives, reconstructing arrays, and so on, while downloading the DS4000 storage subsystem controller firmware and DS4000 EXP ESM firmware. It is recommended that you close all storage management sessions (other than the session that you use to upgrade the firmware) to the DS4000 storage subsystem that you plan to update. 16. Inter-operability with tape devices is supported on separate HBA and switch zones. ======================================================================= 1.3 Enhancements --------------------------- The DS4000 Storage Manager version 9.19 host software for Novell Netware 6.5 with SP5 or higher operating systems in conjunction with the DS4000 storage subsystem controller firmware 06.19.18.xx provides support for - Support for attaching the DS4000 EXP810 to the DS4300 Standard-Dual Controller models or Turbo models and the DS4500-All Models. Please refer to the New Features section of the IBM DS4000 Storage Manager version 9 Installation and Support Guide for Windows 2000/Server 2003, Netware, ESX Server, and Linux for additional information about the IBM DS4000 Storage Manager version 9.19 enhancements. ======================================================================= 1.4 Level Recommendation and Prerequisites for the update ----------------------------------------------------------- Note: The IBM Storage Manager host software version 9.19 for Novell Netware OS new features and changes are described in the corresponding Change History document. Please refer to this document for more information on new features and modifications. 1. Netware 6.5 with support pack 5 (SP5) or higher. This release of DS4000 storage manager version 9.19 for Netware does not support Novell Netware 5.x and 6.0 operating systems. Please contact IBM resellers or representatives if there is a requirement for such support. 2. "Direct connection of the DS4300 to a host system running Microsoft Windows, Novell NetWare or x86 Linux is only supported using the IBM DS4000 FC2-133 Host Bus Adapter (HBA), IBM option part number 24P0960 or feature code 2104 with the last 6 digits of the 13 digit serial number of the HBA is H21160 or higher. For example, if the serial number is FFC0308H21161, the last 6 digits will be H21161, which indicates that this HBA meets the DS4300 direct connect prerequisite. In addition, direct connect to the NAS 300G (Machine Type 5196) Model G27 or Model G02 containing Feature Code 3706 is only supported if the last 6 digits of the 13 digit serial number of the HBA is above H21160. 3. Novell server with at least 2G of memory. Code levels at the time of release are as follows ------------------------------------------------------------------ IMPORTANT: Starting with the DS4000 Storage Manager version 9.16 release, there are not any IBM System Storage™ DS4000 Storage Manager host software packages for the Novell Netware server operating system environment. To manage the DS4000 storage subsystems that are IO attached to your Novell Netware server hosts, you must install the DS4000 Storage Manager client software (SMclient) on a Windows or Linux management workstation and manage the DS4000 storage subsystem via out- of-band management method. The SMclient program is included in the IBM System Storage™ DS4000 Storage Manager version 9.19 for the 32 and 64 bit version of Linux operating systems or the IBM System Storage™ DS4000 Storage Manager version 9.19 for Microsoft Windows operating systems host software packages. These IBM System Storage™ DS4000 Storage Manager version 9.16 host software packages for Windows and Linux and DS4000 storage subsystem firmware files are available for download from the IBM System Storage™ DS4000 Support web site - http://www.ibm.com/servers/storage/support/disk/. 1. For Microsoft Windows, the IBM DS4000 Storage Manager Installer wizard version is 09.19.35.06. SMIA-WS32-09.19.35.06.exe 2. For Linux, the DS4000 Storage Manager Installer wizard version is 09.19.A5.06. The storage Manager client and runtime programs are also available as individual host software packages. Their versions are 9.19.G5.06 and 9.16.A5.00, respectively. SMclient-LINUX-09.19.G5.06-1.noarch.rpm SMruntime-LINUX-09.16.A5.00-1.i586.rpm Refer to the http://www.ibm.com/servers/storage/support/disk IBM System Storage™ Disk Storage Systems Technical Support web site for the latest supported host adapters, device drivers, and updated readme. Please also review section 2.2 in this README file. ======================================================================= 1.5 Dependencies -------------------------- IMPORTANT: 1. DS4000 storage subsystem CONTROLLER FIRMWARE VERSION 06.1X.XX.XX REQUIRES THAT THE FIRMWARE VERSION OF AN ATTACHED EXP700 ENVIRONMENTAL SERVICE MODULE (ESM) BE AT VERSION 9326 OR HIGHER. IF THE EXP700 ESM FIRMWARE IS EARLIER THAN THE 9326 VERSIONS, THE EXP700 ENCLOSURE AND THE INSTALLED DRIVES MAY NOT BE DISPLAYED IN THE DS4000 SUBSYSTEM MANAGEMENT WINDOW AFTER THE CONTROLLER FIRMWARE IS UPGRADED. THE CURRENT RELEASE ESM FIRMWARE VERSION FOR THE EXP700 ESM IS 9330. 2. DS4000 STORAGE SUBSYSTEM CONTROLLER FIRMWARE VERSION 06.1X.XX.XX REQUIRES THAT THE FIRMWARE VERSION OF AN ATTACHED EXP100 ENVIRONMENTAL SERVICE MODULE (ESM) BE AT VERSION 955X OR HIGHER. IT IS NOT POSSIBLE TO UPGRADE EXP100 ESM FIRMWARE VERSIONS THROUGH 953X TO VERSION 955X WHEN THE CONTROLLER FIRMWARE IS AT 06.1X.XX.XX. TO DETERMINE THE FIRMWARE LEVEL OF AN EXP100 ESM, IDENTIFY THE PRODUCT LABEL LOCATED AT THE REAR OF THE EXP100 ENCLOSURE. ONLY LABELS ON WHICH THE FIELD REPLACEABLE UNIT (FRU) PART NUMBER READS 25R0156 POSITIVELY INDICATE THAT AN ESM MODULE IS RUNNING FIRMWARE VERSION 955X OR HIGHER. IF THERE IS NO LABEL OR THE PART NUMBER ON THE LABEL DOES NOT READ 25R0156, THE ESM MAY STILL HAVE THE FIRMWARE VERSION 955X OR HIGHER IF IT HAD BEEN PREVIOUSLY UPGRADED. IF NECESSARY, CONTACT YOUR IBM REPRESENTATIVE, SUPPORT, OR RESELLERS FOR ASSISTANCE. IN ADDITION, IT IS NOT POSSIBLE TO UPGRADE THE ESM FIRMWARE FROM VERSION 953X TO VERSION 956X OR LATER DIRECTLY. THE 953X ESM MUST BE UPGRADED TO VERSION 9554 FIRST BEFORE IT CAN BE UPGRADED TO VERSION 956X. 3. CURRENTLY, THE ONLY DS4000 STORAGE SUBSYSTEMS THAT ARE SUPPORTED BY THE 06.12.XX.XX CONTROLLER FIRMWARE VERSION ARE THE DS4100 - ALL MODELS, THE DS4300 WITH STANDARD (BASE) OR TURBO OPTIONS, THE DS4400 AND THE DS4500. DO NOT DOWNLOAD THIS CONTROLLER FIRMWARE ON ANY OTHER DS4000 STORAGE SUBSYSTEM. THERE IS NOT ANY CHECKING FOR THIS RESTRICTION INSIDE THE STORAGE MANAGER CLIENT PROGRAM. 4. The only DS4000 storage subsystems that are supported by the 06.14.xx.xx or higher (06.14.xx.xx, 06.15.xx.xx, 06.16.xx.xx, or 06.19.xx.xx) controller firmware version are the DS4200 (06.16.88.xx or higher), DS4300 Standard-dual controller or Turbo models (06.19.xx.xx or higher), and the DS4500 (06.19.xx.xx or higher), DS4700 (06.16.4x.xx or higher) and DS4800 (06.14.xx.xx or higher) storage subsystems. Currently, there are not any controller firmware packages version 06.14.xx.xx and higher for other DS4000 storage subsystems. Do not download this controller firmware on any other DS4000 storage subsystems. 5. Always check the README files (especially the Dependencies section) that are packaged together with the firmware files for any required minimum firmware level requirements and the firmware download sequence for the DS4000 drive expansion enclosure ESM, the DS4000 storage subsystem controller and the hard drive firmware. 6. If the managed DS4000 storage subsystem had the FC/SATA intermix premium feature enable, do not upgrade the controller firmware from version 06.10.xx.xx to version 06.12.xx.xx until a FC/SATA intermix premium feature key file is generated and available. Once the controller firmware is upgraded to version 06.12.xx.xx, the FC/SATA intermix premium feature will be shown as out-of-compliance and the FC/SATA intermix premium feature key file is required to re-enable the feature. When the FC/SATA intermix premium feature is in out-of- compliance state, LUNs management functions like creations, deletions and modifications will not be operational. Please refer to the FC/SATA intermix premium feature activation card that was shipped with the FC/SATA intermix premium feature kit for instructions to generate the required premium key file. 7. The DS4800 storage subsystems do not support the attachment of the DS4000 EXP700 drive expansion enclosures. The EXP700 enclosure must be upgraded into DS4000 EXP710 enclosure using the DS4000 EXP700 Models 1RU/1RX Switched-ESM Option Upgrade Kit before it can be attached to the DS4800 storage subsystems. 8. THE DS4000 STORAGE SERVER WITH CONTROLLER FIRMWARE VERSION 05.41.1X.XX MUST BE UPGRADED TO CONTROLLER FIRMWARE VERSION 05.41.5X.XX FIRST BEFORE IT CAN BE UPGRADED TO CONTROLLER FIRMWARE VERSION 06.1X.XX.XX OR LATER. OTHERWISE, THE ERROR 231-FIRMWARE INCOMPATIBLE WILL BE DISPLAYED. 9. DS4000 storage subsystem controller firmware versions 6.12.16.xx or higher and EXP100 storage expansion enclosure ESM firmware version 9563 or higher are required to provide support for the new 400G SATA drive options and CRUs (P/Ns 39M4570 and 39M4575, respectively) in addition to the new 250G SATA drive CRUs (P/N 40K6837.) This new 250G SATA drive CRU is functionally equivalent to the previously-released CRUs (P/N 90P1349). 10. The version 06.16.xx.xx of the DS4800 controller firmware is not compatible with the EXP100 SATA drive expansion enclosures. DO NOT download it into the DS4800 storage subsystems that have EXP100 drive expansion enclosures attached. After the 06.16.xx.xx controller firmware is activated, the DS4800 storage subsystem will not recognize the drives in EXP100 enclosures, causing loss of data availability to the raid arrays and logical drives that are defined in those drives. The controller firmware version 6.15.xx.xx and earlier must be installed in the DS4000 storage subsystems that have EXP100 SATA drive expansion enclosure attached instead. 11. Controller firmware 06.16.xx.xx is required to support EXP810 storage expansion enclosures. 12. Controller firmware 06.16.4x.xx and higher is required for the DS4700-all models and the DS4800-model 80A/80H. These models do not support older 06.16.xx.xx versions of controller firmware. The attachment of EXP100 enclosures is not supported for these models. 13. Automatic Logical Drive Transfer (ADT/AVT) must be disable for the new Novell Netware 6.5 native multipath driver. The version and release dates of the new driver modules are as followed (or later): a. MM.NLM - NetWare 6.5 Media Manager Version 3.22 April 4, 2006 b. NWPA.NLM - NetWare 6.5 NetWare Peripheral Architecture NLM Version 3.21 March 27, 2006 c. SCSIHD.CDM - Novell NetWare SCSI Fixed Disk Custom Device Module Version 3.03.06 March 29, 2006 d. LSIMPE.CDM - LSI Multipath Enhancer (also required to support the newly released DS4700/DS4800 storage subsystems) Version 1.02.01 March 13, 2006 14. Controller firmware 06.16.88.xx and higher is required for the DS4200-all models. These models do not support older 06.16.xx.xx versions of controller firmware. The attachment of EXP100, EXP710 and EXP810 enclosures is not supported for these DS4200 models. 15. Controller firmware 06.19.xx.xx is required for the DS4300- standard-dual controller or Turbo models and the DS4500-all models, for attaching the EXP810 storage expansion enclosures. IBM DS4000 Storage Manager host software version 09.1x.xx.xx provides full management support for IBM machine types 3552 and 3542 storage controllers that have at least firmware version 04.01.xx.xx, IBM Machine type 1742-900 and 1742 storage controllers that have at least firmware version 05.00.04.xx, IBM Machine type 1722 storage controllers that have at least firmware version 05.3x.xx.xx, IBM Machine type 1724 storage controllers that have at least firmware version 05.42.xx.xx, IBM Machine type 1814 storage controllers that have at least firmware version 06.16.4x.xx or IBM Machine type 1815 storage controllers that have at least firmware version 06.14.xx.xx. The only IBM DS4000 Storage Manager version 09.1x.xx.xx management function supported on DS4000 storage subsystems with controller firmware version 04.xx.xx.xx up to 04.00.02.xx is controller firmware and NVSRAM download. ======================================================================= 2.0 Installation and Setup Instructions ---------------------------------------------------- Note: The web-download Storage Manager version 9.19 host software package must be first unzipped or unpacked (tar -xvz) into a user-defined directory. Then, go to this directory, locate the appropriate directory to access the Storage Manager version 9.19 host software installation file(s). 2.1 Step-by-step instructions for this code update are as follows -------------------------------------------------------------------------- 1. Install and update the driver for the IBM DS4000 Fibre Channel host bus adapter in the Novell NetWare servers. a. Install the hardware by using the instructions that come with the adapter. b. Install the IBM DS4000 Host Adapter driver by using the instructions provided in the readme.txt file located in the Host_Adapter directory on this installation CD. c. Install the Novell NetWare native fail-over device driver. Note: IBMSAN fail-over device drive is not supported for NW 6 with SP3 or higher and NW 6.5. 2. Install the new Storage Manager version 9.19 software on the DS4000 storage subsystem management station. If there is previous version (7.x, 8.x or 9.10) of the IBM DS4000 Storage Manager host software (ie. SMClient, SMUtil and SMAgent packages) installed in the system, uninstall it before installing the new version of the storage manager host software. Review the README files that are included in the DS4000 Storage Manager version 9.19 host software pacakages for Linux or Microsoft Windows OSes for the up-to-date information on installation. For more detailed on DS4000 Storage Manager software uninstalled and installed instructions, refer to the IBM System Storage DS4000 Storage Manager Version 9 Installation and Support Guide for Windows 2000/Server 2003, Netware, ESX Server, and Linux 3. If the managed DS4000 storage subsystem had the FC/SATA intermix premium feature enable, do not continue with the next step until a FC/SATA intermix premium feature key file is generated and available. Once the controller firmware is upgraded to version 06.12.xx.xx from version 06.10.xx.xx, the FC/SATA intermix premium feature will be shown as out-of-compliance and the FC/SATA intermix premium feature key file is required to re-enable the feature. When the FC/SATA intermix premium feature is in out-of-compliance state, LUNs management functions like creations, deletions and modifications will not be operational. Please refer to the FC/SATA intermix premium feature activation card that was shipped with the FC/SATA intermix premium feature kit for instructions to generate the required premium key file. 4. Upgrade the DS4000 storage subsystem firmware in the following order - the DS4000 drive expansion enclosure ESM code, the DS4000 storage server controller firmware and NVSRAM and then the hard drive firmware code. Refer to the IBM DS4000 Storage Manager version 9 Installation and Support Guide for Windows 2000/Server 2003, Netware, ESX Server, and Linux or the online help in the Subsystem Management window for detailed instructions. ATTENTION: Always check the README files (especially the Dependencies section) that are packaged together with the firmware files for any required minimum firmware level requirements and the firmware download sequence for the DS4000 drive expansion enclosure ESM, the DS4000 storage subsystem controller and the hard drive firmware. 5. (if applicable) Re-enable the FC/SATA intermix premium feature using the premium key file. Refer to the http://www.ibm.com/servers/storage/support/disk IBM System Storage™ Disk Storage Systems Technical Support web site for the the latest DS4000 Storage Manager host software, the DS4000 controllers firmware, the drive expansion enclosure ESM firmware and the hard disk drive code. ======================================================================= 2.2 Refer to the Host_Adapter directory on this installation CD for the applicable drivers or refer to the IBM Support Web Site for the latest supported host adapters, device drivers, and updated readme. At this time, the supported drivers are as follows: 1. IBM DS4000 Host Adapter device driver for NetWare version 6.51d for IBM DS4000/FAStT FC HBAs 2. IBM DS4000 Host Adapter device driver for NetWare version 6.90H for IBM DS4000/FAStT FC2, FC2-133 single and dual port and FC 4Gbps single and dual port FC HBAs 3. Novell NetWare native multipath/failover driver DO NOT USE THE NOVELL MULTIPATH DRIVER MODULES THAT ARE AVAILABLE WITH NetWare 6.5 SUPPORT PACK 5 OR EARLIER. There is a fix to the "LUN bouncing between controllers" problem in NetWare 6.5 SP5 and earlier with the IBM DS4000 storage subsystems. The problem was observed in large (>6 nodes) NetWare 6.5 cluster with cluster nodes sharing the same IBM DS4000 storage subsystem LUNs and being configured with the NetWare native multipath driver. When the nodes in the clusters scan all available Fibre Channel paths to discover LUNs as part of a server boot up process or as the result of executing "scan all LUNs", "scan for new devices" or "list failover devices" commands, the DS4000 storage subsystem LUNs will moved between controller A and B momentary. In certain cases, this "LUN bouncing between controllers" behavior could cause the server to mark all paths to a LUN as failed and deactivate it. The fix required new version of the following Novell NetWare 6.5 CDM and NLM modules. a. MM.NLM - NetWare 6.5 Media Manager Version 3.22 April 4, 2006 b. NWPA.NLM - NetWare 6.5 NetWare Peripheral Architecture NLM Version 3.21 March 27, 2006 c. SCSIHD.CDM - Novell NetWare SCSI Fixed Disk Custom Device Module Version 3.03.06 March 29, 2006 d. LSIMPE.CDM - LSI Multipath Enhancer (also required to support the newly released DS4700/DS4800 storage subsystems) Version 1.02.01 March 13, 2006 These files can be downloaded from the Novell support web site - http://support.novell.com/cgi-bin/search/searchtid.cgi?/2973674.htm. Do not use any of the above modules whose release dates and versions are earlier than as stated above. In addition, the new Novell NetWare 6.5 native multipath driver requires the Automatic Logical Drive Transfer (ADT, aka. Automatic Volume Transfer (AVT)) mode/function to be disable. The ADT/AVT mode/function must be enable for previous version of LSIMPE.CDM, SCSIHD.CDM, MM.NLM and NWPA.NLM. It must be disabled for the stated above release dates and versions of LSIMPE.CDM, SCSIHD.CDM, MM.NLM and NWPA.NLM modules. To disable the AVT/ADT function so that the new Novell native multipath driver can be used, you must run the DS4000 "DisableAVT_Netware.script" SMcli script file. This file is placed in the script folder of the CD-ROM or the DS4000 storage manager host software package for Novell NetWare. Attention: If you do not install NetWare 6.5, or if you use an older version of the Novell native multipath driver in NetWare 6.5, do not load the new DS4000 NVRAM file that disable AVT/ADT. NetWare hosts with the new Novell native multipath driver (NetWare 6.5) and the previous Novell native multipath driver (NetWare 6.0, or NetWare 6.5 without the new native multipath driver installed) cannot share the same DS4000 storage subsystem using the same NetWare failover host type. This is because the different ADT/AVT enable/disable settings of the different Novell native multipath driver versions conflict with each other. Recommendation: If your system has NetWare version 6.0 (or earlier) installed, it is recommended that you upgrade to NetWare 6.5 to take advantage of this new Novell multipath driver. Always check the Novell support web site for the latest version of the LSIMPE.CDM. In some cases, the IBM Support web site for DS4000 product will have the LSIMPE.CDM that one should use until Novell releases the new maintenance pack that incorporates changes between Novell NetWare schedule maintenance releases. Check the README that is included in the DS4000 Storage Manager version 9 host software package for Novell NetWare OS for more info. IMPORTANT: The IBMSAN.CDM version 106e dated November 4th, 2002 is not supported for NW6 SP3 or later and for NW6.5. In addition, this driver will not recognize LUNs from the DS4100, DS4700 and DS4800 storage subsystems. This driver is for NW 6 SP2 and earlier and NW 5.1 SP6 only. ======================================================================= 2.3 Helpful Hints ------------------ 1. The DS4500 and DS4300 storage subsystem have new recommended drive-side cabling instructions. The DS4500 instructions are documented in the IBM System Storage DS4500 Installation, Users. and Maintenance Guide (GC27-2051-00 or IBM P/N 42D3302). The DS4300 instructions are documented in the IBM System Storage DS4300 Installation, Users. and Maintenance Guide (GC26-7722-02 or IBM P/N 42D3300). Please follow the cabling instructions in these publication to cable the new DS4500 and DS4300 setup. If you have an existing DS4500 setup with four drive side minuhub installed that was cabled according to the previously recommended cabling instructions, please schedule down time as soon as possible to make changes to the drive side FC cabling. Refer to the IBM System Storage DS4500 and DS4300 Installation, Users. and Maintenance Guide for more information. 2. The DS4000 Storage Management dialog windows may be displayed cropped without the vertical and horizontal scroll bars. Just move the mouse pointer over the edge of the window until the mouse pointer change to window resize pointer, left click and hold to grip the window edge to resize it. 3. If you are unable to see the maximum number of drives during Automatic Configuration, you should be able to use Manual Configuration to select individual drives and select the maximum number of drives allowed. 4. Depending on the storage subsystem that you have purchased, you may have to purchase the DS4000 storage partitioning premium feature option or an option to upgrade the number of supported partitions in a storage subsystem. Please see IBM Marketing representatives or IBM resellers for more information. - IBM DS4100 storage subsystem (machine type 1724): The standard configuration does not have the DS4000 storage partitioning premium enabled. Four partition, eight partition, sixteen and an upgrade from four to eight partition storage partitioning premium feature options can be purchased. - IBM DS4200 storage subsystem (machine type 1814): Depending on the ordering channels, the DS420 storage subsystem is either shipped with 2 storage partitions or with a user selected 2, 4, 8, 16 or 64 storage partitions. If the DS4200 storage subsystem is ordered with less than 64 partitions, various storage partition feature upgrade options can be purchased to increase the maximum number of supported storage partitions. - IBM DS4300 storage subsystem (machine type 1722): The standard configuration does not have the DS4300 storage partitioning premium enabled. Four partition, eight partition, sixteen and an upgrade from four to eight partition storage partitioning premium feature options can be purchased. The IBM DS4300 Turbo option comes with 8 partition storage partitioning premium option installed. An upgrade to 64 partitions can be purchased for the IBM DS4300 Turbo option. - IBM FAStT200 (machine type 3542): The standard configuration has 16 partition storage partitioning premium option installed. No additional storage partitioning premium feature options can be purchased for these storage subsystems. - IBM FAStT500 and DS4400 storage subsystems (machine type 3552 and 1742 - models 1RU and 1RX, respectively): The standard configuration has 64 partition storage partitioning premium option installed. No additional storage partitioning premium feature options can be purchased for these storage subsystems. - IBM DS4500 storage subsystem (machine type 1742 - models 90X and 90U): The standard configuration has 16 partition storage partitioning premium option installed. An upgrade from 16 to 64 partition storage partitioning premium feature option can be purchased. - IBM DS4700 storage subsystem (machine type 1814): Depending on the ordering channels, the DS4700-model 70 storage subsystem is either shipped with 2 storage partitions or with a user selected 2, 4, 8, 16 or 64 storage partitions. Similarly, the DS4700-model 72 storage subsystem is either shipped with 8 storage partitions or with a user selected 8, 16 or 64 storage partitions. If the DS4700 storage subsystem is ordered with less than 64 partitions, various storage partition feature upgrade options can be purchased to increase the maximum number of supported storage partitions. - IBM DS4800 storage subsystem (machine type 1815): Depending on the ordering channels, the DS4800 storage subsystem is either shipped with 8 storage partitions or with a user selected 8, 16 or 64 storage partitions. If the subsystem is ordered with less than 64 partitions, an upgrade from 8 to 16, 8 to 64 or 16 to 64 partition storage partitioning premium feature option can be purchased. 5. Fabric topology zoning requirement. To avoid possible problem at the host level, it is best practice that all Fibre Channel (FC) Switches must be zoned such that a single FC host bus adapter can only access one controller per storage array. In addition, this zoning requirement also ensures the maximum number of host connections can be seen and log into the controller FC host port. This is because if a FC HBA port is seen by both controller A and B host ports, it will be counted as two host connections to the storage subsystem - one for controller A port and one for controller B port. Note: The DS4000 storage subsystems DS4500, DS4400 and FAStT500 (IBM machine type 1742 and 3552) have two ports per controller - one per minihub slot. The DS4000 storage subsystems DS4300 (IBM machine type 1722) and DS4100 (IBM machine type 1724) have two ports per controller. The DS4000 storage subsystem FAStT200 (IBM machine type 3542) has only one port per controller. The DS4000 storage subsystem DS4800 (IBM machine type 1815) has four ports per controller. 6. The DS4000 controller host ports or the Fibre Channel HBA ports can not be connected to a Cisco FC switch ports with "trunking" enable. You might encounter failover and failback problems if you do not change the Cisco FC switch port to "non-trunking" using the following procedure: a. Launch the Cicso FC switch Device Manager GUI. b. Select one or more ports by a single click. c. Right click the port(s) and select Configure, a new window pops up d. Select the "Trunk Config" tab from this window, a new window opens e. In this window under Admin, select the "non-trunk" radio button, it is set to auto by default. f. Refresh the entire fabric. 7. When making serial connections to the DS4000 storage controller, the baud rate is recommended to be set at either 38200 or 57600. Note: Do not make any connections to the DS4000 storage subsystem serial ports unless it is instructed by IBM Support. Incorrect use of the serial port might result in lost of configuration, and possibly, data. 8. All enclosures (including DS4000 storage subsystem with internal drive slots) on any given drive loop/channel should have complete unique ID's, especially the single digit (x1) portion of the ID, assigned to them. For example, in a maximum configured DS4500 storage subsystem, enclosures on one redundant drive loop should be assigned with id's 10-17 and enclosures on the second drive loop should be assigned with id's 20-27. Enclosure id's with the same single digit such as 11, 21 and 31 should not be used on the same drive loop/channel. In addition, for enclosures with mechanical enclosure ID switch like DS4300 storage subsystems, EXP100 or EXP710 storage expansion enclosures, do not use enclosure ID value of 0. The reason is with the physical design and movement of the mechanical enclosure ID switch, it is possible to leave the switch in a “dead zone” between ID numbers, which return an incorrect enclosure ID to the storage management software. The most commonly returned enclosure ID is 0 (zero). In addition to causing the subsystem management software to report incorrect enclosure ID, this behavior also result in enclosure ID conflict error with the storage expansion enclosure or DS4000 storage subsystem intentionally set the ID to 0. The DS4200 and DS4700 storage subsystems and the EXP420 and EXP810 storage expansion enclosures did not have mechanical ID switches. Thus, they are not susceptible to this problem. In addition, these storage subsystems and storage expansion enclosures automatically set the Enclosure IDs. IBM recommendation is not make any changes to these settings unless the automatic enclosure ID settings resulting in non- unique single digit settings for enclosures (including the storage subsystems with internal drive slots) in a given drive loop/channel. 9. The ideal configuration for SATA drives is one drive in each EXP per array, one logical drive per array and one OS disk partition per logical drive. This configuration minimizes the random head movements that increase stress on the SATA drives. As the number of drive locations to which the heads have to move increases, application performance and drive reliability may be impacted. If more logical drives are configured, but not all of them used simultaneously, some of the randomness can be avoided. SATA drives are best used for long sequential reads and writes. 10. IBM recommends at least one hot spare per EXP100 drive expansion enclosure. A total of 15 hot-spares can be defined per DS4000 storage subsystem configuration. 11. Starting with the DS4000 Storage Manager (SM) host software version 9.12 or later, the Storage Manager client script window looks for the files with the file type of ".script" as the possible script command files. In the previous versions of the DS4000 Storage Manager host software, the script window looks for the file type ".scr" instead. (i.e. enableAVT.script for SM 9.12 or later vs. enableAVT.scr for pre-SM 9.12) ======================================================================= 3.0 Configuration Information ---------------------------------------- 3.1 Configuration Settings ------------------------------------ 1. By default, the IBM DS4000 Storage Manager 9.1x client program does not automatically map logical drives when the IBM DS4000 storage partitioning premium feature is enabled. This means that the logical drives after being created are not automatically presented to the host systems. a. For a new installation, after creating new arrays and logical drives, create a storage partition with the host type of Netware-failover (when using the Novell native fail-over driver) or Netware-IBMSAN (when using the IBMSAN fail-over driver) and map the logical drives to this partition. b. If you are upgrading the NVSRAM with Storage Partitions, you may have to change the default host type to match the host system OS. After upgrading the NVSRAM, the default host type is reset to Windows 2000/Server 2003 non-clustered for DS4000 storage server with controller firmware version 06.14.xx.xx or later. For DS4000 storage server with controller firmware version 06.12.xx.xx or earlier, it is reset to Windows non-clustered (SP5 or higher), instead. Refer to the IBM DS4000 Storage Manager online help to learn more about creating storage partitions and changing host types. 2. When you are configuring IBM machine type 1722, 1724, 1742, 1814, 1815, 3542, or 3552 storage controllers as boot devices, contact IBM support for supported configurations and instructions for configuring IBM storage controllers as boot devices. 3. When you are configuring IBM machine type 1722, 1724, 1742, 1814, 1815 or 3552 storage subsystems in clustered Remote Mirror configurations, contact IBM support for supported cluster configurations and instructions for configuring IBM storage controllers in clustered Remote Mirror configurations. 4. Running script files for specific configurations. Apply the appropriate scripts to your subsystem based on the instructions you have read in the publications or any instructions in the operating system readme file. A description of each script is shown below. - SameWWN.script: Setup RAID controllers to have the same World Wide Names. The World Wide Names (node) will be the same for each controller pair. The NVSRAM default sets the RAID controllers to have the same World Wide Names. - DifferentWWN.script: Setup RAID controllers to have different World Wide Names. The World Wide Names (node) will be different for each controller pair. The NVSRAM default sets the RAID controllers to have the same World Wide Names. - EnableDriveMigration.script: The Enable drive migration script scans the drives for configurations when they are added to a storage system and will also attempt to use configurations found on the newly added drives. The NVSRAM default will enable drive migration. - DisableDriveMigration.script: The disable drive migration script allows the addition of disk drives while the system is running. In addition, it identifies the drives as unused capacity regardless of past drive configuration. The NVSRAM default will enable drive migration. - EnableAVT_Netware.script: The script will enable automatic logical drive transfer (AVT) for the Netware Failover heterogenous host region. Do not use this script unless it is specifically mentioned in the applicable instructions. - DisableAVT_Netware.script: The script will disable the automatic logical drive transfer (AVT) for the Netware Failover heterogenous host region. Do not use this script unless it is specifically mentioned in the applicable instructions. ======================================================================= 3.2 Hardware status and information -------------------------------------------------- For more information, refer to the IBM System Storage™ Disk Storage Systems Technical Support web site. ======================================================================= 3.3 Unsupported configurations ------------------------------------------- The following lists configurations that are currently not being supported with IBM DS4000 Storage Manager Version 9.19. 1. The DS4100 (machine type 1724-all models) storage subsystem does not support the attachment of the DS4000 EXP710, EXP700 and EXP500 (FC) drive expansion enclosure. Please contact IBM representatives or resellers for the availability of such support in the future. 2. The DS4800 storage subsystem (machine type 1815-all models) does not support the attachment of the FAStT EXP500 and DS4000 EXP700 drive expansion enclosures. 3. The DS4800 storage subsystem (machine type 1815 - models 82x, 84x and 88x (x is either A or H)) with controller firmware 6.15.xx.xx installed does not support the attachment of the DS4000 EXP810 (FC) drive expansion enclosures. 4. The DS4700 (machine type 1814 - models 70A/H and 72A/H) and DS4800 storage subsystem (machine type 1815 - all models) with controller firmware 6.16.xx.xx installed does not support the attachment of the DS4000 EXP100 (SATA) drive expansion enclosures. 5. The DS4200 (machine type 1814 - models 7VA/H) with controller firmware 6.16.88.xx installed does not support the attachment of the DS4000 EXP100 (SATA), EXP710 (FC) and EXP810 (SATA and FC) drive expansion enclosures. In addition, it does not support Fibre Channel disk drive options. 6. The DS4800 (machine type 1815 - models 80A/88H) does not support the the attachment of the DS4000 EXP100 (SATA) drive expansion enclosure because it does not support the DS4800 controller firmware 6.15.xx.xx. 7. The IBM DS4000 EXP420 Expansion Enclosure is not supported attached to any other IBM DS4000 Storage Controllers except the DS4200. 8. The DS4100 with Single Controller option does not support the attachment of the DS4000 storage expansion enclosures. 9. The DS4300 storage subsystem with Single Controller option does not support the controller firmware version 06.1x.xx.xx. The correct firmware version for these DS4300 storage subsystem models is 05.34.xx.xx. 10. Fibre Channel loop environments with the IBM Fibre Channel Hub, machine type 3523 and 3534, in conjunction with the IBM Fibre Channel Switch, machine types 2109-S16, 2109-F16 or 2109-S8. In this configuration, the hub is connected between the switch and the IBM Fibre Channel RAID Controllers. 11. The IBM Fibre Channel hub, machine type 3523, connected to IBM machine type 1722, 1724, 1742, 1814, 1815, 3542 and 3552. 12. A configuration in which a server with only one FC host bus adapter connects directly to any DS4000 storage subsystem with dual controllers is not supported. The supported configuration is the one in which the server with only one FC host bus adapter connects to both controller ports of any DS4000 storage subsystem with dual controllers via Fibre Channel (FC) switch (SAN-attached configuration.) 13. The DS4700 and DS4800 storage subsystems with controller firmware 6.16.4x.xx or higher and the DS4200 storage subsystems with controller firmware 6.16.88.xx or higher support Novell Netware 6.5 SP5 servers only. ======================================================================= 4.0 Unattended Mode -------------------------------- None. ======================================================================= 5.0 WEB Sites and Support Phone Number -------------------------------------------------------------- 5.1 IBM System Storage™ Disk Storage Systems Technical Support web site: http://www.ibm.com/servers/storage/support/disk/ 5.2 IBM System Storage™ Marketing Web Site: http://www.ibm.com/servers/storage/disk 5.3 You can receive hardware service through IBM Services or through your IBM reseller, if your reseller is authorized by IBM to provide warranty service. See http://www.ibm.com/planetwide/ for support telephone numbers, or in the U.S. and Canada, call 1-800-IBM-SERV (1-800-426- 7378). IMPORTANT: You should download the latest version of the DS4000 Storage Manager host software, the DS4000 storage subsystem controller firmware, the DS4000 drive expansion enclosure ESM firmware and the drive firmware at the time of the initial installation and when product updates become available. To be notified of important product updates, you must first register at the IBM Support and Download Web site: www-1.ibm.com/servers/storage/disk/ Perform the following steps to register at the IBM Support and Download Web site: 1. Click on My Support in the Additional Support box in the right side of the DS4000 Support web page. 2. The Sign In window displays. Either enter your IBM ID and Password in the sign in area to sign in and proceed to step 6 or, if you are not currently registered with the site, click Register Now. 3. The My IBM Registration window Step 1 of 2 opens. Enter the appropriate information and click Continue to get to the second My IBM Registration window. 4. In the My IBM Registration window Step 2 of 2, enter the appropriate information and click Submit to register. 5. The My IBM Registration windows opens with the following message, “Thank you for registering with ibm.com. Continue to explore ibm.com as a registered user.” Click Edit Profile in the My IBM box on the right side of the window. 6. The My Support window opens. Click Add Products to add products to your profile. 7. Use the pull-down menus to choose the appropriate DS4000 storage server and expansion enclosures that you want to add to your profile. To add the product to your profile, select the appropriate box or boxes next to the product names and click Add Product. 8. Once the product or products are added to your profile, click Subscribe to Email folder tab 9. Select Storage in the pull down menu. Select Please send these documents by weekly email and select Downloads and drivers and Flashes to receive important information about product updates. Click Updates. 10. Click Sign Out to log out of My Support. ======================================================================= 6.0 Trademarks and Notices ---------------------------- The following terms are trademarks of the IBM Corporation in the United States or other countries or both: IBM FAStT System Storage™ the e-business logo xSeries HelpCenter Linux is a registered trademark of Linus Torvalds. Microsoft, Windows, and Windows NT are trademarks of Microsoft Corporation in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the United states, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Netware is a registered trademark of Novell Other company, product, and service names may be trademarks or service marks of others. ======================================================================= 7.0 Disclaimer -------------- 7.1 THIS DOCUMENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND. IBM DISCLAIMS ALL WARRANTIES, WHETHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF FITNESS FOR A PARTICULAR PURPOSE AND MERCHANTABILITY WITH RESPECT TO THE INFORMATION IN THIS DOCUMENT. BY FURNISHING THIS DOCUMENT, IBM GRANTS NO LICENSES TO ANY PATENTS OR COPYRIGHTS. 7.2 Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corporation. Notices ---------------------------- The following terms are trademarks of the IBM Corporation in the United States or other countries or both: IBM FAStT System Storage™ the e-business logo xSeries HelpCenter Linux is a registered trademark of Linus Torvalds. Microsoft, Windows, and Windows NT are trademarks of Microsoft Corporation in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Sun Microsystems, Inc. in the United states, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Netware is a registered trademark of Novell Other company, product, and service names may be trademarks or service marks of others. ======================================================================= 7.0 Disclaimer -------------- 7.1 THIS DOCUMENT IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND. IBM DISCLAIMS ALL WARRANTIES, WHETHER EXPRESS OR IMPLIED, INCLUDING WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF FITNESS FOR A PARTICULAR PURPOSE AND MERCHANTABILITY WITH RESPECT TO THE INFORMATION IN THIS DOCUMENT. BY FURNISHING THIS DOCUMENT, IBM GRANTS NO LICENSES TO ANY PATENTS OR COPYRIGHTS. 7.2 Note to U.S. Government Users -- Documentation related to restricted rights -- Use, duplication or disclosure is subject to restrictions set forth in GSA ADP Schedule Contract with IBM Corporation.