Cisco Nexus 7000 VDC Administration

This article decribes how to manage Virtual Device Context (VDC) on Cisco Nexus 7010 series. Cisco’s VDC feature helps enable virtualization of a single physical device on one or more logical devices. In this lab testing, we are going to cover several scenario like below:

  • Configuring Admin VDC
  • Configuring VDC Resource and Templates
  • Managing VDCs

Configuring Admin VDC

Admin VDC without migrate option

You can create an Admin VDC in one of the following ways:

  • After a fresh switch bootup.
  • Enter the system admin-vdc command after bootup. All the nonglobal configuration in the default VDC is lost after you enter this command.
  • Use system admin-vdc migrate new vdc name option commmand to migrate a non global configuration on non default vdc to new vdc.

In this section we are going to focus on creating vdcs after the switch bootup. On this lab environment I am using Nexus 7010 Chassis with SUP2E and NX-OS 6.2(16).

Now let’s verify our default vdc configuration.

N7K-ADMIN# show run vdc
...
version 6.2(16)
no system admin-vdc
vdc N7K-ADMIN id 1
  limit-resource module-type m1 m1xl m2xl f2e 
  cpu-share 5
  allocate interface ethernet1/1-12
  limit-resource vlan minimum 16 maximum 4094
  limit-resource monitor-session minimum 0 maximum 2
  limit-resource monitor-session-erspan-dst minimum 0 maximum 23
  limit-resource vrf minimum 2 maximum 4096
  limit-resource port-channel minimum 0 maximum 768
  limit-resource u4route-mem minimum 96 maximum 96
  limit-resource u6route-mem minimum 24 maximum 24
  limit-resource m4route-mem minimum 58 maximum 58
  limit-resource m6route-mem minimum 8 maximum 8
  limit-resource monitor-session-inband-src minimum 0 maximum 1
  limit-resource anycast_bundleid minimum 0 maximum 16
  limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
  limit-resource monitor-session-extended minimum 0 maximum 12
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                       state               mac                 type        lc      
------  --------                       -----               ----------          ---------   ------  
1       N7K-ADMIN                      active              40:55:39:0e:43:41   Ethernet    m1 f1 m1xl m2xl
N7K-ADMIN# show interface description 

-------------------------------------------------------------------------------
Interface                Description                                            
-------------------------------------------------------------------------------
mgmt0                    ***Management_Interface***

-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth1/1        eth    1000    --
Eth1/2        eth    1000    --
Eth1/3        eth    1000    --
Eth1/4        eth    1000    --
Eth1/5        eth    1000    --
Eth1/6        eth    1000    --
Eth1/7        eth    1000    --
Eth1/8        eth    1000    --
Eth1/9        eth    1000    --
Eth1/10       eth    1000    --
Eth1/11       eth    1000    --
Eth1/12       eth    1000    --

Now configure your system to use admin vdc.

N7K-ADMIN(config)# system admin-vdc 
All non-global configuration from the default vdc will be removed, Are you sure you want to continue? (yes/no) [no] yes
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None
N7K-ADMIN# show interface description 

-------------------------------------------------------------------------------
Interface                Description                                            
-------------------------------------------------------------------------------
mgmt0                    ***Management_Interface***

Do notice that right now we don’t have any interfaces from physical module interface. Only management interface is allowed on admin vdc. Now let’s try to allocate some interfaces to it and see how admin vdc respons to it.

N7K-ADMIN(config)# vdc N7K-ADMIN  
N7K-ADMIN(config-vdc)# allocate interface ethernet1/1-12M
Moving ports will cause all config associated to them in source vdc to be removed. Are you sure you want to move the ports (y/n)?  [yes] 
ERROR: 1 or more interfaces are from a module of type not supported by this vdc

According to the error message, it was clear that admin vdc only allow management interface on it. As it purpose as an admin vdc it necessary to have only one interface.

Admin VDC With Migrate Option

Another method to create admin vdc is by adding migrate option. This method allow you to keep you default vdc configuration. This option is recommended for existing deployments where the default VDC is used for production traffic whose downtime must be minimized.

Let’s verify our default vdc configuration before we do some changes.

N7K-ADMIN# sh run vdc
...
version 6.2(16)
no system admin-vdc
vdc N7K-ADMIN id 1
  limit-resource module-type m1 m1xl m2xl f2e 
  cpu-share 5
  limit-resource vlan minimum 16 maximum 4094
  limit-resource monitor-session minimum 0 maximum 2
  limit-resource monitor-session-erspan-dst minimum 0 maximum 23
  limit-resource vrf minimum 2 maximum 4096
  limit-resource port-channel minimum 0 maximum 768
  limit-resource u4route-mem minimum 96 maximum 96
  limit-resource u6route-mem minimum 24 maximum 24
  limit-resource m4route-mem minimum 58 maximum 58
  limit-resource m6route-mem minimum 8 maximum 8
  limit-resource monitor-session-inband-src minimum 0 maximum 1
  limit-resource anycast_bundleid minimum 0 maximum 16
  limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
  limit-resource monitor-session-extended minimum 0 maximum 12
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Ethernet    m1 m1xl m2xl f2e
N7K-ADMIN# show interface description 

-------------------------------------------------------------------------------
Interface                Description                                            
-------------------------------------------------------------------------------
mgmt0                    --

-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth1/1        eth    1000    --
Eth1/2        eth    1000    --
Eth1/3        eth    1000    --
Eth1/4        eth    1000    --
Eth1/5        eth    1000    --
Eth1/6        eth    1000    --
Eth1/7        eth    1000    --
Eth1/8        eth    1000    --
Eth1/9        eth    1000    --
Eth1/10       eth    1000    --
Eth1/11       eth    1000    --
Eth1/12       eth    1000    --

Now we will configure admin vdc on our system and add new vdc (N7K-DEV) that will have default vdc configuration migrated to it.

N7K-ADMIN(config)# system admin-vdc migrate N7K-DEV
All non-global configuration from the default vdc will be removed, Are you sure you want to continue? (yes/no) [no] yes
Note: Interface mgmt0 will not have its ip address migrated to the new vdc
Note: During migration some configuration may not be migrated. Example: VTP will need to be reconfigured in the new vdc if it was enabled. Please refer to configuration guide for details
Please wait, this may take a while
Note: Ctrl-C has been temporarily disabled for the duration of this command
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e
N7K-ADMIN# show run vdc
...
version 6.2(16)
system admin-vdc
vdc N7K-ADMIN id 1
  cpu-share 5
  limit-resource vlan minimum 16 maximum 4094
  limit-resource monitor-session minimum 0 maximum 2
  limit-resource monitor-session-erspan-dst minimum 0 maximum 23
  limit-resource vrf minimum 2 maximum 4096
  limit-resource port-channel minimum 0 maximum 768
  limit-resource u4route-mem minimum 96 maximum 96
  limit-resource u6route-mem minimum 24 maximum 24
  limit-resource m4route-mem minimum 58 maximum 58
  limit-resource m6route-mem minimum 8 maximum 8
  limit-resource monitor-session-inband-src minimum 0 maximum 1
  limit-resource anycast_bundleid minimum 0 maximum 16
  limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
  limit-resource monitor-session-extended minimum 0 maximum 12
vdc N7K-DEV id 2
  limit-resource module-type m1 m1xl m2xl f2e 
  cpu-share 5
  allocate interface Ethernet1/1-12
  boot-order 1
  limit-resource vlan minimum 16 maximum 4094
  limit-resource monitor-session minimum 0 maximum 2
  limit-resource monitor-session-erspan-dst minimum 0 maximum 23
  limit-resource vrf minimum 2 maximum 4096
  limit-resource port-channel minimum 0 maximum 768
  limit-resource u4route-mem minimum 96 maximum 96
  limit-resource u6route-mem minimum 24 maximum 24
  limit-resource m4route-mem minimum 58 maximum 58
  limit-resource m6route-mem minimum 8 maximum 8
  limit-resource monitor-session-inband-src minimum 0 maximum 1
  limit-resource anycast_bundleid minimum 0 maximum 16
  limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
  limit-resource monitor-session-extended minimum 0 maximum 12

vdc resource template admin-vdc-migrate-template
  limit-resource vlan minimum 16 maximum 4094
  limit-resource monitor-session minimum 0 maximum 2
  limit-resource monitor-session-erspan-dst minimum 0 maximum 23
  limit-resource vrf minimum 2 maximum 4096
  limit-resource port-channel minimum 0 maximum 768
  limit-resource u4route-mem minimum 96 maximum 96
  limit-resource u6route-mem minimum 24 maximum 24
  limit-resource m4route-mem minimum 58 maximum 58
  limit-resource m6route-mem minimum 8 maximum 8
  limit-resource monitor-session-inband-src minimum 0 maximum 1
  limit-resource anycast_bundleid minimum 0 maximum 16
  limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
  limit-resource monitor-session-extended minimum 0 maximum 12

After admin vdc created, you will also have vdc resource template create based on admin vdc. We will cover vdc resource template on next section. Now try to login to new vdc using switchto vdc vdc_name and verify that it has the same membership of the interfaces on the default vdc.

N7K-ADMIN# switchto vdc N7K-DEV 
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
N7K-ADMIN-N7K-DEV#
N7K-ADMIN-N7K-DEV# sh interface description 

-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth1/1        eth    1000    --
Eth1/2        eth    1000    --
Eth1/3        eth    1000    --
Eth1/4        eth    1000    --
Eth1/5        eth    1000    --
Eth1/6        eth    1000    --
Eth1/7        eth    1000    --
Eth1/8        eth    1000    --
Eth1/9        eth    1000    --
Eth1/10       eth    1000    --
Eth1/11       eth    1000    --
Eth1/12       eth    1000    --

Configuring VDC Resource and Templates

VDC resource templates set the minimum and maximum limits for shared physical device resources when you create the VDC. The Cisco NX-OS software reserves the minimum limit for the resource to the VDC. Any resources allocated to the VDC beyond the minimum are based on the maximum limit and availability on the device.

Below is one of the example of the vdc resource template we are using.

N7K-ADMIN(config)# vdc resource template new_vdc_template
N7K-ADMIN(config-vdc-template)# limit-resource vlan minimum 20 maximum 4094
N7K-ADMIN(config-vdc-template)#   limit-resource monitor-session minimum 0 maximum 2
N7K-ADMIN(config-vdc-template)#   limit-resource monitor-session-erspan-dst minimum 0 maximum 23
N7K-ADMIN(config-vdc-template)#   limit-resource vrf minimum 2 maximum 4096
N7K-ADMIN(config-vdc-template)#   limit-resource port-channel minimum 0 maximum 768
N7K-ADMIN(config-vdc-template)#   limit-resource u4route-mem minimum 96 maximum 96
N7K-ADMIN(config-vdc-template)#   limit-resource u6route-mem minimum 24 maximum 24
N7K-ADMIN(config-vdc-template)#   limit-resource m4route-mem minimum 58 maximum 58
N7K-ADMIN(config-vdc-template)#   limit-resource m6route-mem minimum 8 maximum 8
N7K-ADMIN(config-vdc-template)#   limit-resource monitor-session-inband-src minimum 0 maximum 1
N7K-ADMIN(config-vdc-template)#   limit-resource anycast_bundleid minimum 0 maximum 16
N7K-ADMIN(config-vdc-template)#   limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
N7K-ADMIN(config-vdc-template)#   limit-resource monitor-session-extended minimum 0 maximum 12
N7K-ADMIN# show run vdc
...
vdc resource template new_vdc_template
  limit-resource vlan minimum 20 maximum 4094
  limit-resource monitor-session minimum 0 maximum 2
  limit-resource monitor-session-erspan-dst minimum 0 maximum 23
  limit-resource vrf minimum 2 maximum 4096
  limit-resource port-channel minimum 0 maximum 768
  limit-resource u4route-mem minimum 96 maximum 96
  limit-resource u6route-mem minimum 24 maximum 24
  limit-resource m4route-mem minimum 58 maximum 58
  limit-resource m6route-mem minimum 8 maximum 8
  limit-resource monitor-session-inband-src minimum 0 maximum 1
  limit-resource anycast_bundleid minimum 0 maximum 16
  limit-resource monitor-session-mx-exception-src minimum 0 maximum 1
  limit-resource monitor-session-extended minimum 0 maximum 12

Now create new vdc based on our vdc resource template.

N7K-ADMIN(config)# vdc N7K-PROD template new_vdc_template 
Note:  Creating VDC, one moment please ...
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          active              40:55:39:0e:43:43   Ethernet    m1 m1xl m2xl f2e
N7K-ADMIN# show vdc N7K-PROD detail 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc id: 3
vdc name: N7K-PROD
vdc state: active
vdc mac address: 40:55:39:0e:43:43
vdc ha policy: RESTART
vdc dual-sup ha policy: SWITCHOVER
vdc boot Order: 1
CPU Share: 5
CPU Share Percentage: 33%
vdc create time: Fri Apr  7 09:25:56 2017
vdc reload count: 0
vdc uptime: 0 day(s), 0 hour(s), 1 minute(s), 32 second(s)
vdc restart count: 0
vdc type: Ethernet
vdc supported linecards: m1 m1xl m2xl f2e
N7K-ADMIN# show vdc N7K-PROD resource

     Resource                   Min       Max       Used      Unused    Avail    
     --------                   ---       ---       ----      ------    -----    
     vlan                       20        4094      5         15        4089     
     monitor-session            0         2         0         0         2        
     monitor-session-erspan-dst 0         23        0         0         23       
     vrf                        2         4096      2         0         4090     
     port-channel               0         768       0         0         768      
     u4route-mem                96        96        1         95        95       
     u6route-mem                24        24        1         23        23       
     m4route-mem                58        58        1         57        57       
     m6route-mem                8         8         1         7         7        
     monitor-session-inband-src 0         1         0         0         1        
     anycast_bundleid           0         16        0         0         16       
     monitor-session-mx-excepti 0         1         0         0         1        
     monitor-session-extended   0         12        0         0         12

You may see on above resource output. Our vdc was assigned correctly by our configuration template. Let’s allocate some interfaces from the line card and verify it.

N7K-ADMIN(config-vdc)# allocate interface ethernet1/13-18
Moving ports will cause all config associated to them in source vdc to be removed. Are you sure you want to move the ports (y/n)?  [yes]
N7K-ADMIN# show vdc N7K-PROD membership 
Flags : b - breakout port
---------------------------------

vdc_id: 3 vdc_name: N7K-PROD interfaces:
        Ethernet1/13          Ethernet1/14          Ethernet1/15          
        Ethernet1/16          Ethernet1/17          Ethernet1/18

Login to vdc N7K-PROD and verify if it already have its interfaces. Since this is a new vdc, it is behave like a new switch. It will ask you to set up password and another administration task just like when you are entering the switch after fresh bootup.

N7K-ADMIN# switchto vdc N7K-PROD 


         ---- System Admin Account Setup ----


Do you want to enforce secure password standard (yes/no) [y]: no

  Enter the password for "admin": 
  Confirm the password for "admin": 

         ---- Basic System Configuration Dialog VDC: 3 ----

This setup utility will guide you through the basic configuration of
the system. Setup configures only enough connectivity for management
of the system.

Please register Cisco Nexus7000 Family devices promptly with your
supplier. Failure to register may affect response times for initial
service calls. Nexus7000 devices must be registered to receive 
entitled support services.

Press Enter at anytime to skip a dialog. Use ctrl-c at anytime
to skip the remaining dialogs.

Would you like to enter the basic configuration dialog (yes/no): no
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
N7K-ADMIN-N7K-PROD#
N7K-ADMIN-N7K-PROD# show interface description 

-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth1/13       eth    1000    --
Eth1/14       eth    1000    --
Eth1/15       eth    1000    --
Eth1/16       eth    1000    --
Eth1/17       eth    1000    --
Eth1/18       eth    1000    --

Managing VDCs

Reloading VDCs

After we create VDCs, we can modify its parameter according to your network environment needs. In this subsection we are focusing on how to do some administrative task on your VDCs. Before we execute the command, let’s verify all VDCs we have on our Nexus 7000.

N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          active              40:55:39:0e:43:43   Ethernet    f2

Now we will pick vdc N7K-PROD as a target for this test.

N7K-ADMIN# reload vdc N7K-PROD 
Are you sure you want to reload this vdc (y/n)?  [no] yes
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          resume in progress  40:55:39:0e:43:43   Ethernet    f2

In order to measure how long the reload process takes, I did a continues ping to the management interface resides on N7K-PROD vdc. After 30 seconds, N7K-PROD vdc back online.

N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          active              40:55:39:0e:43:43   Ethernet    f2

Suspending VDCs

After assign a reload command to a vdc, now we are going to put a suspend action on it.

N7K-ADMIN(config)# vdc N7K-PROD suspend 
This command will suspend the VDC. (y/n)? [no] yes
Note: Suspending vdc N7K-PROD
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          suspended           40:55:39:0e:43:43   Ethernet    f2

Using the same procedure above to measure how long it back online, now let’s resume the vdc.

N7K-ADMIN(config)# no vdc N7K-PROD suspend 
Note: Resuming vdc N7K-PROD

After 30 seconds we can see vdc N7K-PROD is active

N7K-ADMIN# show vdc

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          active              40:55:39:0e:43:43   Ethernet    f2

Managing VDC Interfaces

When you create a VDC, you can allocate I/O interfaces to the VDC. One important thing regarding port allocation is, it is recommended to allocate all ports on the same port group to the same VDC. Beginning with Cisco NX-OS Release 5.2(1) for Nexus 7000 series devices, all members of a port group are automatically allocated to the VDC when you allocate an interface.

In this lab I am using two Line Cards, N7K-M148GT-11 on slot 1 and N7K-F248XP-25 on slot 2. Let’s see how we can verify port group on each line card.

Module N7K-M148GT-11

Module N7K-F248XP-25

We were omitted the rest of the output because those output is enough for us to understand how port group allocated on the line card. The interface number is listed in the FP port column, and the port ASIC number is listed in the MAC_0 column, which means that in slot 1 on the the above example, interfaces 1 through 12 share the same port ASIC (0) and on the slot 2, interfaces 1 through 4 share the same port ASIC (0).

When interfaces in different VDCs share the same port ASIC, reloading the VDC (with the reload vdc command) or provisioning interfaces to the VDC (with the allocate interface command) might cause short traffic disruptions (of 1 to 2 seconds) for these interfaces. If such behavior is undesirable, make sure to allocate all interfaces on the same port ASIC to the same VDC.

VDC Boot Order

Imagine you have a VDC connect to web servers, another VDC connect to app servers and Another VDC connec to database. In case your switch reload due to power outage or any force major incident, you expect specific VDC to go up first so the apps tier can comunicate properly. Another feature we can adjust on the VDC is boot order. Using boot order value you can manage which VDC should goes up first.

Use below command to adjust boot order value. By default it will have value of 1 on the boot order.

N7K-ADMIN(config)# vdc N7K-DEV
N7K-ADMIN(config-vdc)# boot-order 2
N7K-ADMIN# show vdc detail 
....
vdc id: 2
vdc name: N7K-DEV
vdc state: active
vdc mac address: 40:55:39:0e:43:42
vdc ha policy: BRINGDOWN
vdc dual-sup ha policy: SWITCHOVER
vdc boot Order: 2
CPU Share: 5
CPU Share Percentage: 33%
vdc create time: Tue Apr 11 11:53:32 2017
vdc reload count: 0
vdc uptime: 0 day(s), 0 hour(s), 52 minute(s), 25 second(s)
vdc restart count: 0
vdc type: Ethernet
vdc supported linecards: m1 m1xl m2xl f2e 
...

you cannot modify boot order on admin/default VDC. An Error will occurs when you try to modify it.

N7K-ADMIN(config)# vdc N7K-ADMIN 
N7K-ADMIN(config-vdc)# boot-order 1
ERROR: Default vdc boot order cannot be changed

Now let’s do some test by reloading the box and see the progress from each VDC.

N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                type        lc      
------  --------                          -----               ----------         ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41  Admin       None    
2       N7K-DEV                           create pending      40:55:39:0e:43:42  Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          create pending      40:55:39:0e:43:43  Ethernet    f2
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           create in progress  40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          create pending      40:55:39:0e:43:43   Ethernet    f2
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          create in progress  40:55:39:0e:43:43   Ethernet    f2
N7K-ADMIN# show vdc 

Switchwide mode is m1 f1 m1xl f2 m2xl f2e f3 

vdc_id  vdc_name                          state               mac                 type        lc      
------  --------                          -----               ----------          ---------   ------  
1       N7K-ADMIN                         active              40:55:39:0e:43:41   Admin       None    
2       N7K-DEV                           active              40:55:39:0e:43:42   Ethernet    m1 m1xl m2xl f2e 
3       N7K-PROD                          active              40:55:39:0e:43:43   Ethernet    f2

As you can see from above output, each VDC will start to active after another. Without boot order configured, each VDC will start to active at the same time.

VDC Hostname

You can change the format of the CLI prompt for nondefault VDCs. By default, the prompt format is a combination of the default VDC name and the nondefault VDC name. You can change the prompt to only contain the nondefault VDC name using no vdc combined-hostname. You can use this command only on spesific non default VDC or for the entire VDCs. Let’s verify non default VDC hostname before we change it.

N7K-ADMIN# switchto vdc N7K-PROD 
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
N7K-ADMIN-N7K-PROD#

Apply the config and see the change.

N7K-ADMIN(config)# no vdc combined-hostname
N7K-ADMIN# switchto vdc N7K-PROD 
Cisco Nexus Operating System (NX-OS) Software
TAC support: http://www.cisco.com/tac
Copyright (c) 2002-2016, Cisco Systems, Inc. All rights reserved.
The copyrights to certain works contained in this software are
owned by other third parties and used and distributed under
license. Certain components of this software are licensed under
the GNU General Public License (GPL) version 2.0 or the GNU
Lesser General Public License (LGPL) Version 2.1. A copy of each
such license is available at
http://www.opensource.org/licenses/gpl-2.0.php and
http://www.opensource.org/licenses/lgpl-2.1.php
N7K-PROD#

Now we have non default VDC hostname without additional name from the admin/default VDC.

VDC Management Interface

Nexus SUP2E module has one physical port for management. As Infromed earlier, this management interface is belong to admin/default VDC.

N7K-ADMIN# show interface description 

-------------------------------------------------------------------------------
Interface                Description                                            
-------------------------------------------------------------------------------
mgmt0                    --

-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth1/1        eth    1000    --
Eth1/2        eth    1000    --
Eth1/3        eth    1000    --
Eth1/4        eth    1000    --
Eth1/5        eth    1000    --
Eth1/6        eth    1000    --
Eth1/7        eth    1000    --
Eth1/8        eth    1000    --
Eth1/9        eth    1000    --
Eth1/10       eth    1000    --
Eth1/11       eth    1000    --
Eth1/12       eth    1000    --

When we create more VDCs other than default VDC, Management interface is distributed through the VDCs. You can configure each VDC with an IP address with same segment with other IP addresses on the other VDCs. For example I was configured N7K-ADMIN VDC with 10.10.10.1/24, N7K-DEV 10.10.10.2/24, N7K-PROD 10.10.10.3/24 and management PC using 10.10.10.100/24. Do notice that on non default VDC, management interface is not shown when you execute show interface description.

N7K-PROD# show interface description 


-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth2/1        eth    10G     --
Eth2/2        eth    10G     --
Eth2/3        eth    10G     --
Eth2/4        eth    10G     --

You can configure management interface just like you configure it on the admin/default VDC.

N7K-PROD(config)# interface mgmt 0
N7K-PROD(config-if)# vrf member management 
N7K-PROD(config-if)# ip address 10.10.10.3/24
N7K-PROD(config-if)# Description ***Management_Link***
N7K-PROD(config-if)# no shut
N7K-PROD# show interface description 

-------------------------------------------------------------------------------
Interface                Description                                            
-------------------------------------------------------------------------------
mgmt0             ***Management_Link***

-------------------------------------------------------------------------------
Port          Type   Speed   Description
-------------------------------------------------------------------------------
Eth2/1        eth    10G     --
Eth2/2        eth    10G     --
Eth2/3        eth    10G     --
Eth2/4        eth    10G     --

sources:

Contributor:

Ananto Yudi Hendrawan
Network Engineer - CCIE Service Provider #38962, RHCE, VCP6-DCV
nantoyudi@gmail.com
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s