Fully Resilient FCIP Design CISCO MDS 9250i



i just have a question about VSAN configuration for fully resilient FCIP Design, because i am a little bit confuse for backup paths (Blue and Orange line), if you see the image i am going to connect VSAN 60, profile 60 and FCIP 60 on Ge2 (Site A) with VSAN 70, profile 70 and FCIP70 on Ge2 (Site B) line Blue, is it correct? i mean, can i do that? or to connect them, do i need to set the same VSAN Number (60 and 60), same case with the orange line. i understand that the Profile and FCIP can be different, but i dont know if the vsan can be different.

i found the best practice for FCIP and on that image i can see red and blue vsan are different for backups paths, take a look at that image

i will appreciate your help on this.Capture.PNG.png

Best Regards


Show tech-support details gives no FCIP information on MDS9250i switches

Article Number: 495817 Article Version: 2 Article Type: Break Fix

Connectrix – M-Series,Connectrix MDS-9250i,Connectrix MDS-Series Firmware 6.X 6.2(11c)


Missing FCIP information in show tech-support details on mds 9250i switch.


MDS 9250i show tech-support details with ‘feature fcip’ does not provide fcip information.


MDS 9250i with feature “fcip” configured.

Further Problem Description:

Known Affected Release: 6.2(13)

The “show tech-support details” on an MDS-9250i with ‘feature fcip’ does not get the below fcip outputs:

`show ips stats tcp all`

`show ips stats errors all`

‘show fcip profile`

`show fcip profile all`

The MDS-9250i switch is hit by the Cisco BUG: CSCuw48990.


Need to gather the below logs to get the fcip information :

# show tech-support fcip


The switch should be upgraded to NX-OS 6.2(15) and above.


Cisco MDS-9222i Error: Installing license failed: Number of licenses in use is more than the number being installed

Article Number: 486360 Article Version: 4 Article Type: Break Fix

Connectrix MDS-9222i

  • Applying the license needed to enable the FCIP feature (SAN_EXTN_OVER_IP_SSN16) of an SSN-16 (DS-X9316-SSNK9) module generates the following error message:
switch# install license bootflash:MDS20160000003300000.lic

Installing license failed: Number of licenses in use is more than the number being installed

  • FCIP was initially configured using the trial license
  • FCIP profiles were configured on each of the 4 port groups

It was found that the user purchased one SAN_EXTN_OVER_IP_SSN16 license but the SSN16 module requires 4 of these licenses. One for each engine.

An SSN-16 has four separate Octeons. Each Octeon handles 4 ports.

Ports 1-4, 5-8, 9-12, and 13-16 are grouped together.

A single SAN_EXTN_OVER_IP_SSN16 license supports only one port group of 4 GE ports.

The number of licenses that a customer needs to purchase is equal to the number of engines to be enabled for the feature on the Cisco MDS 9000 16-Port Storage Services Node.

Cisco MDS 9000 SAN Extension over IP Package Datasheet

Note: You cannot activate a new FCIP interface that is in a different port group and which does not have a license. If you wish to re-allocate the license(s) to a different port group, you must delete the FCIP interface which is currently using the SSN16 license and the profile relationship and create the new FCIP interface and profile.

Purchase additional SAN_EXTN_OVER_IP_SSN16 licenses.

These licenses may need to be installed at the same time, refer to KB article 337845 for steps to install multiple SAN EXT OVER IP licenses simultaneously.


  • No Related Posts

Re: Tuning FCIP performance

Hi All,

Any advice on tuning FCIP on MDS9513 (4.2.3) 18/4 modules is greatly appreciated!

We have 4x1Gb FCIP connections, and currently we are only getting a maximum of 200MB/s throughput in total – about 1/2 what i would hope to achieve.

This is our config (A only)

We have an MDS9513, with an 1×18/4 module and 2xGbE connections, connecting to a 2nd MDS9513 (Same h/w config) at a remote site.

The GbE connections traverse a 10Gb Network connection between our Primary and Secondary sites. Our FCIP bandwidth is shared with other services – but the 10Gb Network utilisation is always less then 30%..

Currently we are only achieving a max 50MB/s on each FCIP port.

The round trip time is 6ms,

Jumbo frames enabled on the network,

MTU set to 2300

Max Bandwidth = 1000

Min Bandwidth = 1000 (is this good practice or should I be using 90% of the Max perhaps?)

Compession not currently enabled

Send buffer size is 0kb

Burst size is 50Kb.

Tape Accelerate and Fast write are not enabled.

The purpose of this connectivity is to use Open Replicator to pull data from a Clariion to a DMX4. Therefore as far as I’m aware – Fast write and Tape acceleration won’t help us in this scenario? (For info – we are copying multiple luns, from multiple controllers – and so the bottleneck is not the source or target storage ports).

Other changes Im considering are to increase the send buffer size to 16384.

Could anyone suggest how to further troubleshoot or tune this environment please?

Many thanks



  • No Related Posts

Re: Cisco Storage Networking Certification

I think the biggest thing is experience with touching the switches. If you manage an environment and you are the one making the config changes outside of just creating new zones then it will be very beneficial. For instance I have setup the following so I was comfortable with this stuff: initial config, VSANs, ISLs, Port Channels, IVR, IVR-Topology, FCIP, upgrades, DPVM, Call Home, SPAN Ports, and Fabir Manager Server.The other stuff, for me at least, was on features we don’t have implemented so I was banking on my memory from the class (port security, fabric binding,QOS etc).

I was not able to find a simulator when I looked before.


Deploy Storage Services

Features and Capabilities


  • SAN consolidation and convergence with integrated multiprotocol support for Fibre Channel (FC), FC over Ethernet (FCoE), FCIP, iSCSI, and FICON
  • Optimized for performance, power, and space, with 40 line-rate 16-Gbps FC ports and 10 10-Gbps Ethernet ports
  • Remote SAN extension with high-performance FC over IP (FCIP) for remote replication and other disaster-recovery services
  • Intelligent fabric services, such as I/O Accelerator (IOA) and Data Mobility Manager (DMM)
  • Flexibility for future growth and capacity expansion


  • Hardware-based virtual fabric isolation with virtual SANs (VSANs) and FC routing with Inter-VSAN Routing (IVR)
  • Enterprise-class availability features for departmental SANs
  • Intelligent network services and advanced traffic management capabilities
  • Industry-leading SAN security to support compliance and regulatory requirements
  • Common Cisco NX-OS and management platform (Cisco Prime Data Center Network Manager) across Cisco MDS and Nexus product families

Specifications at a Glance

Minimum Software Requirements

Cisco MDS 9000 NX-OS Software Release 6.2, supporting Cisco MDS 9250i and Cisco Data Center Network Manager (DCNM) for SAN

Performance and Port Configuration

Port speed:

  • 16, 8, 4, and 2 Gbps auto-sensing with 16 Gbps of dedicated bandwidth per Fibre Channel port
  • 10 Gbps per FCoE and FCIP port

Buffer credits:

  • 64 per port (shared-mode ports) and up to 256 on an individual port (dedicated-mode ports with optional Cisco MDS 9000 enterprise package license activated)

Ports per chassis:

  • Up to 50 fixed ports, including 40 16-Gbps Fibre Channel, eight 10-Gbps FCoE, and two 10-Gbps FCIP and iSCSI ports
  • Base configuration with 30 ports; includes 20 16-Gbps Fibre Channel, eight 10-Gbps FCoE, and two 10-Gbps FCIP and iSCSI ports
  • Port activation license to upgrade license remaining 20 16-Gbps Fibre Channel ports

Intelligent Services

  • SAN extension built in
  • Cisco IOA and Cisco DMM activated by separate licenses

Advanced Functions

  • Virtual SAN (VSAN)
  • IVR
  • Port channel with multipath load balancing
  • Flow-based and zone-based QoS
  • FCIP tape read-and-write acceleration and FCIP compression
  • FICON over FCIP tape read-and-write acceleration (pipelining)