ASE Troubleshooting Guide
FAULT TRACING DIRECT

Contents

1Overview

2

Installing and Activating the ASE Card
2.1Verify ASE Card Status
2.2Check Available Power
2.3View System Hardware Summary
2.4View Card Status Details
2.5View Card Status by Slot Number

3

Software and Firmware Upgrade
3.1Upgrade Software and Firmware Manually
3.1.1Accessing the Open Firmware Mode
3.1.2Setting the Required Environment Download Parameters
3.1.3Loading the Required Minikernel Version
3.1.4Verifying Nautilus/Aquanaut CPLD Image Version

4

Advanced Services Processor Provisioning
4.1ASP Traffic Information and Statistics
4.2Collective show Command Output for ASE Cards

5

ASE Card Failure, Debugging, and Recovery
5.1Debugging Stuck ASPs After an ASE Card Failure
5.2Recovering After an XC or L4L7d Restart
5.3Recovering from ASP Soft Reset Errors

6

Deep Packet Inspection Information and Statistics
6.1View Active Subscriber DPI Information
6.2View Subscriber-to-ASP Mapping
6.3View Subscriber-to-DPI Engine Mapping
6.4View DPI Subscriber Information
6.5View DPI Protocol Matching Information
6.6DPI Application Problems
6.6.1XCRP – ASE Control Plane Issues
6.6.1.1Check for Applied DPI Policies
6.6.1.2Check for ASP Assigned Subscribers
6.6.1.3Check if a Subscriber is Known to the DPI Engine
6.6.2PPA and DPI Troubleshooting
6.6.2.1Check if the Line Card is Dropping Packets
6.6.3ASE and ASP Troubleshooting
6.6.3.1Dallas Register State
6.6.3.2ASP Octeon-Security Parameter Index Counters
6.6.3.3DP Shim Layer
6.6.3.4Control Plane IPC Statistics
6.6.4ASE and DPI Troubleshooting
6.6.4.1Capacity and Scaling Issues

7

Appendix A Sample Output dpmonitor –d <core-ID>

Glossary

1   Overview

This guide contains troubleshooting information and solutions for Advanced Services Engine (ASE) cards for SmartEdge 400, 800, and 1200 routers. Use this guide to find information about and recommended actions for ASE card deployment and initialization issues.

2   Installing and Activating the ASE Card

To install and activate an ASE card:

  1. Insert the ASE card into an open slot in the SmartEdge router. You cannot use the slot reserved for Cross-Connect Route Processor (XCRP) Controller cards.
  2. Enter configuration mode, and activate the card by using the card command; for example:

      [local]Redback# configure
      Enter configuration commands, one per line, 'end' to exit
      [local]Redback(config)# card ase 5
      [local]Redback(config-card)# no shutdown
      [local]Redback(config-card)# commit
      Transaction committed.
      [local]Redback(config-card)#
    

  3. Verify the ASE card status and ensure that the system recognizes the card by using the following commands to view detailed hardware information:

2.1   Verify ASE Card Status

Use the show chassis command to verify the ASE card status and ensure recognition by the system.

Table 1 describes the Initialized flags in the show chassis command output .

Table 1    Initialized Flags for ASE

Initialized Flag

Comments

Yes

ASE card is configured with the card ase slot command and is booting up.

Yes R

ASE card is inserted in slot slot in a ready state.

Yes P1UR

ASP1 Data Plane (DP) cores are ready and processes started.

Yes P1P2UR

ASP1 and ASP2 DP cores are ready and processes started. P1 corresponds to the first ASP andP2 to the second. U corresponds to the ASE card (meaning it is up), and R signifies the ASE card is traffic ready.

No

  • No card is loaded.

  • If the Installed-type output field displays the output field none, it is possible that a card is loaded, but unsupported versions of the software or firmware are installed. See Upgrade Software and Firmware Manually.

Example 1   show chassis

 [local]Redback# show chassis
Current platform is SE800e
 (Flags:
  A-Active Crossconnect      B-Standby Crossconnect      C-SARC Ready
  D-Default Traffic Card     E-EPPA Ready                G-Upgrading FPGA
  H-Card Admin State SHUT    I-IPPA Ready                M-FPGA Upgrade Required
  N-SONET EU Enabled         O-Card Admin State ODD      P-Coprocessor Ready
  P1-ASP1 Ready              P2-ASP2 Ready               R-Traffic Card Ready
  S-SPPA Ready               U-Card PPAs/ASP UP          W-Warm Reboot
  X-XCRP mismatch)

Slot: Configured-type       Slot: Installed-type     Initialized Flags
------------------------------------------------------------------------------------------------
 1 : atm-oc3-4-port          1 : none                 No
 2 : none                    2 : ase                  No
 3 : oc12-4-port             3 : none                 No
 4 : ge-10-port              4 : ge-10-port           Yes IEUDR
 5 : ase                     5 : ase                  Yes P1P2UR 
 6 : none                    6 : none                 No
 7 : xcrp4-base              7 : xcrp4-base           Yes A
 8 : xcrp4-base              8 : xcrp4-base           Yes B
 9 : ge-10-port              9 : ge-10-port           Yes IEUR
10 : ge-10-port             10 : ge-10-port           Yes IEUR
11 : ase                    11 : ase                  Yes P1P2UR
12 : none                   12 : none                 No
13 : none                   13 : none                 No
14 : none                   14 : none                 No

2.2   Check Available Power

Use the show chassis power command to check the power available and the ASE card status fulfillment.

The following example shows ASE cards in slots 5 and 9 in an SE 800 chassis, and the Power Available output as 546.24 Watts (11.38 A@-48V):

Example 2   show chassis power

[local]bittor#sh chassis power

Power Capacity:  1920.00 Watts (40.00 A@-48V) + 10% Tolerance
Power Allocated: 1565.76 Watts (32.62 A@-48V)
Power Available:  546.24 Watts (11.38 A@-48V)

                  Required     Allocated     Power
Slot: Configured-type   Watts   A@-48V   Watts   A@-48V   Status
------------------------------------------------------------------
 N/A  fan_and_alarm    142.56   2.97    142.56   2.97    full
 1 : ether-12-port     69.12    1.44    69.12    1.44    full
 2 : none              n/a      n/a     96.00    2.00    low
 3 : ge-10-port        141.60   2.95    141.60   2.95    full
 4 : none              n/a      n/a     96.00    2.00    low
 5 : ase               175.20   3.65    175.20   3.65    full
 6 : none              n/a      n/a     96.00    2.00    low
 7 : xcrp3             41.28    0.86    41.28    0.86    full
 8 : xcrp3             41.28    0.86    41.28    0.86    full
 9 : ase               175.20   3.65    175.20   3.65    full
 10 : none             n/a      n/a     96.00    2.00    low
 11 : none             n/a      n/a     96.00    2.00    low
 12 : ge3-4-port       107.52   2.24    107.52   2.24    full
 13 : none             n/a      n/a     96.00    2.00    low
 14 : none             n/a      n/a     96.00    2.00    low

2.3   View System Hardware Summary

Use the show hardware command to display a summary of all system hardware. An uninitialized card results in a Temp output of N/A; an initialized card shows NORMAL.

To view details of a specific card, see Section 2.4.

The following example shows ASE cards in slots 2, 5 and 11:

Example 3   show hardware

[local]Redback# show hardware

Fan Tray Status        Present
Fan(s) Status          Normal
Power Supply A Status  Normal
Power Supply B Status  No Power
Active Alarms          Chassis power failure - side B

Slot   Type      Serial No        Rev  Ver  Mfg Date Voltage Temp
----- ----------------- ---------------- ----- ------ ------------ --
N/A    backplane   8Y014070500574  1    4  29-AUG-2005 N/A  N/A
N/A    fan tray    9W024070500550  2    4  29-AUG-2005 N/A  N/A
2      ase         E10S5030800070  19   4  04-FEB-2008 N/A  N/A 
4      ge-10-port  A922D290721752  22   4  17-JUL-2007 OK  NORMAL
5      ase         E101D5208D05TX  1    4  26-DEC-2008 OK  NORMAL 
7      xcrp4-base  D201D350821261  0    4  31-AUG-2008 OK  NORMAL
8      xcrp4-base  D202G360840549  0    4  11-SEP-2008 OK  NORMAL
9      ge-10-port  A962G340740073  62   4  01-SEP-2007 OK  NORMAL
10     ge-10-port  A9215080604302  21   4  26-AUG-2006 OK  NORMAL
11     ase         E102D1609D0AJP  2    4  29-APR-2009 OK  NORMAL 

2.4   View Card Status Details

Use the show hardware card slot detail command to verify the status of the card specified by the slot variable and ensure its recognition by the system.

Table 2 describes output fields for the show hardware card slot detail command that determine if the ASE card has been initialized.

Table 2    show hardware card <slot> detail Outputs

Output Field

Uninitialized

Initialized

Card Status

HW detected

HW initialized

Standby LED

Invalid

Off

Active LED

Invalid

On

Example 4   show hardware card slot detail (Unitialized)

[local]Redback# show hardware card 2 detail

Slot              : 2                   Type             : ase
Serial No         : E10S5030800070      Hardware Rev     : 00S
EEPROM id/ver     : 0x5a/4              Mfg Date         : 04-FEB-2008
Voltage           : N/A                 Temperature      : N/A
Card Status       : HW detected         POD Status       : Success
ODD Status        : Not Available
Fail LED          : Invalid             Active LED       : Invalid
Standby LED       : Invalid 
Chass Entitlement : All (0x0)
Ports Entitled    : All
Active Alarms     : N/A

Example 5   show hardware card slot detail (Initialized)

[local]Redback# show hardware card 5 detail
Slot               : 5                  Type               : ase
Serial No          : E101D5208D05TX     Hardware Rev       : 01
EEPROM id/ver      : 0x5a/4             Mfg Date           : 26-DEC-2008
Voltage 1.200V     : 1.201 (+0%)        Voltage 1.800V     : 1.797 (-0%)
Voltage 2.500V     : 2.505 (+0%)        Voltage 3.300V     : 3.262 (-1%)
Voltage nanV       : 0.000 (+0%)        Temperature        : NORMAL (45 C)
Card Status        : HW initialized     POD Status         : Success
ODD Status         : Not Available
Fail LED           : Off                Active LED         : On
Standby LED        : Off
Chass Entitlement  : All (0x0)
Ports Entitled     : All
Active Alarms      : NONE

2.5   View Card Status by Slot Number

Use the show card slot command to verify the ASE card status and ensure its recognition by the system.

Table 3 provides output fields for the show card slot command that determine whether the ASE card is configured.

Table 3    show card slot Configuration Outputs

Output Fields

Not Configured

Configured

Configured-type

none

ase

Installed-type

ase

ase

Initialized

No

Yes

Card PPAs Up

No

Yes

Example 6   show card slot (Not Configured)

[local]Redback# show card 2
-----------------------------
Slot number          : 2
Configured-type      : none
Installed-type       : ase
Initialized          : No  
Card Admin State     : No Shut
IPPA running         : No
EPPA running         : No
Card PPAs Up         : No  
Default Line Card    : No
Chassis Entitlement  : All (0x0)
Ports Entitled       : All

Example 7   show card slot (Configured)

[local]Redback# show card 5
------------------------------
Slot number          : 5
Configured-type      : ase
Installed-type       : ase
Initialized          : Yes
Card Admin State     : No Shut
IPPA running         : No
EPPA running         : No
Card PPAs Up         : Yes
Default Line Card    : No
Chassis Entitlement	 : All (0x0)
Ports Entitled       : All

3   Software and Firmware Upgrade

To view information about the software version, enter the show version command. To view different levels of detailed hardware information, enter the show chassis, or show hardware commands, in any mode.

If the SmartEdge OS, Open Firmware, or minikernel software are not supported, the SmartEdge OS will not recognize the ASE card. For compatible software versions for recent releases, see Software Versions in Data Collection Guideline .

The following examples shows the output of the show version and show chassis commands for supported software and firmware versions. ASE cards are located in slots 5 and 11:

Example 8   XCRP4 and ASE Cards with Correct Software and Firmware Version

[local]Router#sh ver

Redback Networks SmartEdge OS Version SEOS-6.1.5.3-Release
Built by sysbuild@SWB-node14 Fri Dec 4 14:05:46 PST 2009
Copyright (C) 1998-2009, Redback Networks Inc. All rights reserved.
System Bootstrap version is Mips,rev2.0.2.42
Installed minikernel version is 11.7
Router Up Time -   5 days, 23 hours 59 minutes 44 secs

[local]motegi#show chassis
Current platform is SE800s
 (Flags:
  A-Active Crossconnect     B-Standby Crossconnect      C-SARC Ready
  D-Default Traffic Card    E-EPPA Ready                G-Upgrading FPGA
  H-Card Admin State SHUT   I-IPPA Ready                M-FPGA Upgrade Required
  N-SONET EU Enabled        O-Card Admin State ODD      P-Coprocessor Ready
  P1-ASP1 Ready             P2-ASP2 Ready               R-Traffic Card Ready
  S-SPPA Ready              U-Card PPAs/ASP UP          W-Warm Reboot
  X-XCRP mismatch)

Slot: Configured-type      Slot: Installed-type	   Initialized Flags
-------------------------------------------------------------------------------
 1 : none                       1 : none 	               No
 2 : none                       2 : none 	               No
 3 : none                       3 : oc48-1-port          No
 4 : ge-4-port                  4 : ge-4-port	           Yes IEUDR
 5 : ase                        5 : ase                  Yes P1P2UR
 6 : none                       6 : none                 No
 7 : xcrp                       7 : xcrp                 Yes A
 8 : xcrp                       8 : xcrp                 Yes B
 9 : ge-4-port                  9 : ge-4-port	           Yes IEUR
10 : ge-4-port                 10 : ge-4-port	           Yes IEUR
11 : ase                       11 : ase                  Yes P1P2UR
12 : none                      12 : none                 No
13 : none                      13 : none	               No
14 : none                      14 : none	               No

Example 9   XCRP3 and ASE Cards with Correct Software and Firmware Version

[local]motegi#show version

Redback Networks SmartEdge OS Version SEOS-6.1.5.1.13-Release
Built by sysbuild@SWB-node07 Thu Jun 11 10:38:59 PDT 2009
Copyright (C) 1998-2009, Redback Networks Inc. All rights reserved.
System Bootstrap version is PowerPC,1.0b1272
Installed minikernel version is 23
Router Up Time -  1 day, 7 hours 47 minutes 30 secs

[local]motegi#show chassis
Current platform is SE800s
 (Flags:
  A-Active Crossconnect     B-Standby Crossconnect      C-SARC Ready
  D-Default Traffic Card    E-EPPA Ready                G-Upgrading FPGA
  H-Card Admin State SHUT   I-IPPA Ready                M-FPGA Upgrade Required
  N-SONET EU Enabled        O-Card Admin State ODD      P-Coprocessor Ready
  P1-ASP1 Ready             P2-ASP2 Ready               R-Traffic Card Ready
  S-SPPA Ready              U-Card PPAs/ASP UP          W-Warm Reboot
  X-XCRP mismatch)

Slot: Configured-type     Slot: Installed-type    Initialized Flags
-------------------------------------------------------------------------------
 1 : none                 1 : none                   No
 2 : none                 2 : none                   No
 3 : none                 3 : oc48-1-port            No
 4 : ge-4-port            4 : ge-4-port              Yes IEUDR
 5 : ase                  5 : ase                    Yes P1P2UR
 6 : none                 6 : none                   No
 7 : xcrp                 7 : xcrp                   Yes A
 8 : xcrp                 8 : xcrp                   Yes B
 9 : ge-4-port            9 : ge-4-port              Yes IEUR
 10 : ge-4-port          10 : ge-4-port              Yes IEUR
 11 : ase                11 : ase                    Yes P1P2UR
 12 : none               12 : none                   No
 13 : none               13 : none                   No
 14 : none               14 : none                   No[local]motegi#
Note:  
Unsupported software or firmware versions result in the ASE card initialized flags showing no loaded card.

The following example shows a sample output for the show version, show chassis, or show hardware commands where unsupported software or firmware is in use:

Example 10   ASE Card Output With Unsupported Software or Firmware Versions

Slot: Configured-type       Slot: Installed-type      Initialized Flags
-------------------------------------------------------------------------------
      5 : none		            5 : none			          No 

3.1   Upgrade Software and Firmware Manually

XCRP or ASE card problems may require a manual software or firmware upgrade. You must perform the following procedures before upgrading the software or firmware.

3.1.1   Accessing the Open Firmware Mode

To manually upgrade software and firmware, you access the Open Firmware mode (also known as the BootROM or OK mode) CLI.

To access the Open Firmware mode CLI through the controller card console port on the front of each controller card:

  1. Enter the reload command (in exec mode) from the console port.
  2. Watch the reload progress messages carefully. When the following message appears, type se* within five seconds:

    Auto-boot in 5 seconds - press se* to abort, ENTER to boot:

    If you type se* within 5 seconds, the OpenBoot ok prompt appears. The system sets the autoboot time limit to 5 seconds; however, during some operations, such as a release upgrade, the system sets the time limit to 1 second to speed up the process, then returns it to 5 seconds when the system reboots. If you missed the time limit, the reload continues; start again with Step 1.

The following example shows the output of the reload command on the console port:

Example 11   Accessing Open Firmware Mode

Welcome to SmartFirmware(tm) for Redback PowerPC Copyright (c) 1999-2005 by Redback Networks, Inc. 
version 1.0b1272
SmartFirmware(tm) Copyright 1996-2000 by CodeGen, Inc.
All Rights Reserved.
Executing POST
              PPC0 L2 Cache Test : PASSED
             Sandisk Screen Test : PASSED
                 Bridge Test : PASSED
                PPC SDRAM Test : PASSED
                SCC SDRAM Test : PASSED
              Serial(16552) Test : PASSED
                Ethernet Test : PASSED
               ISA Bridge Test : PASSED
                  Forte Test : PASSED
                  Opus Test : PASSED
                   Max Test : PASSED
                  Bits Test : PASSED
                   SCC Test : PASSED
              Compact Flash Test : PASSED
                 PC Card Test : PASSED
PASSED Loop 1 of 1, 2009/06/14 00:44:06
POST PASSED
Auto-boot in 3 seconds - press se* to abort, CR-CR to boot: aborted
ok
ok 

3.1.2   Setting the Required Environment Download Parameters

The following information must be correct to set required environment download parameters:

Example 12   Setting the Required Environment Download Parameters

ok setenv ip-addr 10.18.19.18:255.255.255.0	      [setting the IP address and subnet mask]
ip-addr = 10.18.19.18:255.255.255.0
ok
ok setenv gateway-ip-addr 10.18.19.254		        [setting the Gateway]
gateway-ip-addr = 10.18.19.254
ok
ok setenv server-ip-addr 155.53.12.7		          [Setting the FTP/TFTP server address]
server-ip-addr = 155.53.12.7
ok
ok printenv					                            [Displays the configured parameters]

Variable           Value                     (Default Value)
------------------------------------------------------------------------------
vx-config-flags	   0x0                         (0x0)
vx-other            0x7a                        (0x7a)
vx-startup-script 	                            ()
vx-target-name 	                               ()
vx-host-name 	                                  ()
verbose-output?	   true                        (true)
ignore-cfgfile?	   false                       (false)
update-ofw?	         false                       (false)
user-auth?	         true                        (true)
gateway-ip-addr	   10.18.19.254                ()
server-ip-addr	      155.53.12.7                 ()
ip-addr             10.18.19.18:255.255.255.0   ()
mac_addr	            00:30:88:00:00:50          (00:30:88:00:00:50)

3.1.3   Loading the Required Minikernel Version

To load the required minikernel version, enter the following commands:

Example 13   Loading Minikernel

ok load net <minikernel_dir_location>/netbsd.min.v23.bz2.bin
sending tftp request for file '<minikernel_dir_location>/ netbsd.min.v23.bz2.bin’
###########
Checksum verification succeeded.

ok write-kernel
Checksum verification succeeded.
Erasing Primary minikernel...
Writing Primary minikernel [1461702 bytes]...done
Minikernel Version: 23

You can also upgrade the minikernel at the Command-Line Interface (CLI) by typing Router# upgrade minikernel url.

3.1.4   Verifying Nautilus/Aquanaut CPLD Image Version

You cannot change the Nautilus/Aquanaut Complex Programmable Logic Device (CPLD) image in the field. If you do not have the correct version installed, return the card through the regular Return Merchandise Authorization (RMA) process.

To verify if the board has the latest Nautilus/Aquanaut CPLD image, issue the following command from the vxworks prompt:

Example 14  

-> ase_info 12
ASE device information

Board:
      Revision 0x02
      Type   0x04
Nautilus:
      Major   0x0a (Aquanaut) or 0x02 (Nautilus)
      Minor   0x00
Seawolf:
      Major   0x04
      Minor   0x04
value = 0 = 0x0 

4   Advanced Services Processor Provisioning

Table 4 describes the potential statuses of the Advanced Services Processor (ASP) after completed provisioning and shows the associated output.

Table 4    Advanced Services Processor Status

ASP Provision Status

Message Received in Output

Provisioned but not assigned on an ASP group.

The Operating State is up


The Group is (none)


The Active or Backup is unassigned

Not ready. (1)

The Operating State is perm-failure

Ready and working.

The Configured ASPs are:


        1. 5/1 (up/unassigned)
        2. 5/2 (up/unassigned)

Provisioned and assigned on an ASP group

The Operating State is up


The Active or Backup is active


The Assigned ASPs and Configured ASPs are:

          1. 5/1 (up/active)
          2. 5/2 (up/active)

Provisioned and assigned on an Active/Standby ASP group setup

For the ASP ID : 5/1 group:


  • The Operating State is up

  • Active or Backup is shared backup


For the ASP ID : 11/1 group:


  • The Operating State is up

  • The Active or Backup is shared backup

(1)  This status results if the ASP is still booting or has a problem.


4.1   ASP Traffic Information and Statistics

You can display ASP statistics and system information using the show security asp slot/asp-id statistics [packet slot | system] command.

Example 15   ASP Statistics Information

[local]Redback# show security asp 4/1 statistics packet 4
 Slot 4 :

  Ingress:
    Packets: 74441621
    Error Packets: 0
    Packets QOS Dropped: 4251034	(This implies ingress congestion, so low priority packets are dropped)
    Bytes Processed: 10098440687
    QOS Bytes Dropped: 569781196

  Packet Distribution:
    Packet-Length(Bytes)       Number-of-Packets
       64				           29169485
       65-127			           14577145
      128-255			           22462175
      256-511			           0
      512-1023			           3981782
      1024-1518			        0
     Greater than 1518		     0

   Egress:
     Packets: 20626403
     Bytes:  3185917175

[local]Redback# show security asp 5/2 statistics packet 4
 Slot 4 :

  Ingress:
    Packets: 74812298
    Error Packets: 0
    Packets QOS Dropped: 4252393
    Bytes Processed: 10147312712
    QOS Bytes Dropped: 570237889

  Packet Distribution:
    Packet-Length(Bytes)       Number-of-Packets
      64				              29331613
      65-127			           14649760
      128-255			           22578819
      256-511			           0
      512-1023			           3999713
      1024-1518			        0
     Greater than 1518		     0

   Egress:
     Packets: 20479581
     Bytes:  3165843587
[local]Redback#

4.2   Collective show Command Output for ASE Cards

To view the collective output of show commands available for an ASE card, issue the show tech-support ase command from the Cross Connect Controller Card (XC). This command consolidates the output of the various show commands.

Table 5 describes the commands associated with the show tech-support ase command. Information is shown for each ASP.

For a sample output of the show tech-support ase command, see the Command List.

For a complete list of show tech-support commands, see Collect Comprehensive System Information in the Data Collection Guideline.

Table 5    show commands for ASE

Command

Comments

show version

SmartEdge OS version for ASE cards.

show chassis

Chassis line card summary.

show dpmon all

Summary status of DPs.

show disk

Summary of CompactFlash (CF) card on the ASE card.

show disk internal

CF card details.

show memory

Summary of the CP memory.

show sharedmemory detail

Shared memory details.

show process

Summary of processes running on CP.

show process hidden_all

Hidden processes information.

show process hidden_all detail

Detailed hidden process information.

show process detail

Details of all processes running on CP.

show process crash-info

Crash information for ASE processes, if any.

show ipc process

Summary of Interprocess Communication (IPC) usage by SmartEdge OS processes.

show log

Summary log since bootup.

5   ASE Card Failure, Debugging, and Recovery

The following sections describe debugging and recovery processes you can use when an ASE card fails.

5.1   Debugging Stuck ASPs After an ASE Card Failure

After an ASE card failure, one or both ASPs may become stuck in OFW or may not come up, for the following reasons:

To determine the reason for this problem:

  1. Run the show chassis command.

    To view the sample output of the show chassis, command and the meaning of the initialized flags, see Verify ASE Card Status.

    If the card is stuck in the OK prompt, the initialized flagYesappears, in this case signifying that the ASPs are not up. If only one ASP is up, a P? flag will be set in the position of the down ASP. If the ASP is continuously reloading, these flags will toggle.

  2. If the Initialized flag is Yes R, connect to the ASP using the connect slot ASP-index command.

    If you do not receive the ASP prompt, then the card is stuck in the OK prompt, or network communication between the controller card and ASP has been lost.

    If you do receive the ASP prompt, continue to step 5.

  3. Document the situation that caused the ASE card problem and contact your customer support representative with the results of the diagnostic steps above and the observed results.
  4. Reload the ASE card using the reload card slot-ID command. This can also be done through card or no-card.
  5. If you receive an ASP prompt, enter the sh log command at the prompt to show the status of the DP cores and processes started.

    If the DPs fail to come up, the command stalls. This means that the DPs are not booting up, but the CP cores are up.

  6. Document the situation that caused the ASE/ASP problem.
  7. Log into the CPs and use the dpmonitor –d core-ID command for the DP cores (range from 2 to 15) from the BSD shell at the ASP level to gather additional debug information. Sample output for these commands is shown in Appendix A.
  8. Contact your customer support representative giving the detailed steps that put ASE/ASP in the problem state along with the debug information from the sh log and dpmonitor –d core-ID commands. Only a sample set of output is required.
  9. Reload the ASE card using the reload card slot-ID command. This can also be done through card or no-card.

5.2   Recovering After an XC or L4L7d Restart

Sometimes after an XC restart or L4L7d restart, mini-pm is not updated. In this state, ASPs are up and communication occurs, but XC and ASP processes are not synced.

To sync XC and ASP processes and update mini-pm:

  1. Use the show asp detail command to view the Operating State output field. The Operating State reports perm-failure.
  2. Document the situation that caused the ASP problem.
  3. Connect to the ASPs and use the show proc command to collect information.
  4. Contact your customer support representative giving detailed steps and the output of the show asp detail command and the show proc command.
  5. Use the reload card slotprocessor ID soft-reset command to perform a soft reset of the ASP to recover it from this initialization failure state.

5.3   Recovering from ASP Soft Reset Errors

If you soft-reset an ASP too often, an error results where the ASE card and ASPs are up and appear configured but data cannot be communicated and is dropped.

Use the following procedure to resolve this error:

  1. Issue the commands in section Section 6.6.3.1 and see if drops are reported.
  2. If drops are reported, use the connect and start shell commands to collect information on the issue.

Example 16  

[local]Redback-Resp#connect 1 1
Trying 127.0.200.1...
Connected to 127.0.200.1.
Escape character is '^]'.

Redback
[local]ASE[01/1]#
[local]ASE[01/1]#start shell
Note: octspiX where X is zero-based of the line card slot.
ase-ksh(1)# ifconfig -v octspi1
octspi1: flags=8f1<UP,POINTOPOINT,NOTRAILERS,RUNNING,NOARP,SIMPLEX> mtu 32768 context 0x40080001

    input: 415 packets, 75370 bytes
             output: 415 packets, 75370 bytes, 1001 errors
Note:  
The error count above indicates traffic being black holed in ASE.

  1. Document the situation that caused the ASE/ASP problem.
  2. Collect the output from the commands listed in the above diagnostic steps.
  3. Contact your customer support representative including this information.
  4. Reload ASE card using the reload card slot-ID command. This can also be done through card or no-card.

6   Deep Packet Inspection Information and Statistics

SmartEdge OS documentation lists all show commands available for debugging the Deep Packet Inspection (DPI) feature. This chapter lists some of the more frequently used commands for debugging or gathering information. Both Broadband Remote Access Server (BRAS)-level subscribers show commands and DPI-specific commands are used.

6.1   View Active Subscriber DPI Information

The show subscribers active all command retrieves information about DPI policy for subscribers.

Use the show subscribers active all command for all subscribers, or for a specific subscriber by providing the username. The output field dpi traffic –management policy name(applied) provides information on individual policies applied to the specific subscriber.

Example 17   show subscribers active all

[local]Redback# show subscribers active all
user_port2_vlan101_1
    Circuit  4/9 vlan-id 101 pppoe 41
    Internal Circuit  4/9:1023:63/6/2/125
    Interface bound pppoe_subs_1
    Current port-limit unlimited
    ip pool ip_pool1 (applied from sub_default)
    ip address 16.1.0.6 (applied from pool)
    timeout idle 35400000 (applied from sub_default)
    dpi traffic-management dpi_pol_01 (applied from sub_default)
user_port2_vlan101_2
    Circuit  4/9 vlan-id 101 pppoe 42
    Internal Circuit  4/9:1023:63/6/2/126
    Interface bound pppoe_subs_1
    Current port-limit unlimited
    ip pool ip_pool1 (applied from sub_default)
    ip address 16.1.0.7 (applied from pool)
    timeout idle 35400000 (applied from sub_default)
    dpi traffic-management dpi_pol_01 (applied from sub_default)

6.2   View Subscriber-to-ASP Mapping

Use the show security circuits username user command to retrieve subscriber to ASP mapping.

Note:  
This is a context specific command. Check that the output field USER_BOUND is true to have a proper association to the ASP.

Example 18   show security circuits username <user>

[local]Redback#context isp1 show security circuits username user1@isp1

CCT     = 6/1:1023:63/1/2/11
  ctxt-id  = 40080002
  pg-id   = 1
  vsg-id   = 2
  sm-cct   = 6/1:1023:63/1/2/11
  sm-pg-id  = 1
  sm-asp-id = 5/1
  asp-homing-attempts  = 1
  asp-homing-history   = 5/1,
  asp-homed       = true
  user_id  = 3000000b
  user_name = user1@isp1
  dpi_policy = p1
  FLAGS:
    SEND_USER_BIND   -> false
    SEND_USER_UNBIND  -> false
    SEND_UNBIND_PREV  -> false
    USER_BOUND     -> true
    SEND_ISM_CCT_CFG  -> false
    SEND_ISM_CCT_UNCFG -> false
[local]Redback#

6.3   View Subscriber-to-DPI Engine Mapping

Use the show dpi asp asp ID subscriber subscriber ID command to check the propagation of subscriber information to the ASP and DPI engine.

Note:  
Hidden command. The output field Subscriber ID has the prefix 2 which could be the ASP index.


Example 19   show dpi asp <asp ID> subscriber <subscriber ID>

[local]Redback#sh dpi asp 5/1 subscriber      
Subscriber ID     Policy-Name    Uptime
23000000b              p1        494381
[local]Redback#sh dpi asp 5/1 subscriber 23000000b
 Subscriber ID: 23000000b
 Traffic Management Policy Name: p1
 Uptime: 494390
 Number of TCP/UDP/Other sessions: 1
 Error Counters Maintained per Subscriber: 0
 Internal Subscriber State: OK
[local]Redback#

6.4   View DPI Subscriber Information

Use the show dpi asp asp-id traffic-management statistics subscriber command to view DPI bound subscribers at the ASP level. This command provides a cumulative count.

Example 20   DPI Bound Subscribers

 [local]Redback# show dpi asp 5/1 traffic-management statistics subscriber
 Current Subscriber Count: 24000
 Maximum Subscriber Count: 24000
 Subscribers Per Profile:
      Profile-Name           Subscriber-Count
        dpi_pol_01                     24000

[local]Redback#sho dpi asp 5/2 traffic-management statistics subscriber
 Current Subscriber Count: 24000
 Maximum Subscriber Count: 24000
 Subscribers Per Profile:
      Profile-Name           Subscriber-Count
        dpi_pol_01                     24000

Example 21   DPI All Subscribers

[local]Redback#sho subscribers summary all
---------------------------------------------
Total=48000

Type      Authenticating     Active     Disconnecting
PPP		        0 		         0		             0
PPPoE 		     0		         48000		          0
DOT1Q		        0		         0		             0
CLIPs		        0		         0		             0
ATM-B1483       0		            0		             0
ATM-R1483	     0		         0		             0
Mobile-IP	     0		         0		             0
[local]Redback#

6.5   View DPI Protocol Matching Information

Example 22  

[local]Redback# show dpi asp 5/1 traffic-management statistics protocol yahoo-messenger
 Protocol: yahoo-messenger
    Packets Received: 43135812
    Bytes Received: 5762860962
    Packets Dropped: 0
    Bytes Dropped: 0
    Flow Count: 13778
    Packets Inspected: 14818
    Packets Rate Limited: 0
    Packets Sent: 43135811
    Bytes Sent: 5762860779
[local]Redback#

[local]Redback#sho dpi asp 5/1 traffic-management statistics protocol bit-torrent
 Protocol: bit-torrent
    Packets Received: 0
    Bytes Received: 0
    Packets Dropped: 0
    Bytes Dropped: 0
    Flow Count: 0
    Packets Inspected: 0
    Packets Rate Limited: 0
    Packets Sent: 0
    Bytes Sent: 0
[local]Redback#

6.6   DPI Application Problems

In an ASE system, packets can be dropped in a number of places. Also, packets may not be forwarded properly for the specific service. Use the following steps to gather useful information:

6.6.1   XCRP – ASE Control Plane Issues

This section describes how to check for control plane issues and provides supporting show commands and sample output.

6.6.1.1   Check for Applied DPI Policies

Use the show subscriber active username user command to check if the DPI policy is applied. The output lists the name of the policy that is applied for the subscriber, such as dpi traffic-management policy name(applied).

Note:  
Context specific command.

Example 23   Checking the DPI Policy

[local]Redback#context isp1 show subscribers active username user1@isp1 
user1@isp1
    Session state Up
    Circuit  6/1 vlan-id 1
    Internal Circuit  6/1:1023:63/1/2/11
    Interface bound subs
    Current port-limit unlimited
    ip address 100.1.1.1 255.255.255.252 (applied)
    dpi traffic-management policy p1 (applied from sub_default)
[local]Redback#

If you have not applied any DPI policies, ensure that all DPI configuration steps are in place.

Important elements to check include:

For information and procedures for these tasks, see Application Traffic Management Configuration and Operation.

6.6.1.2   Check for ASP Assigned Subscribers

Use the show security circuits username user command to check if the subscriber is assigned to an ASP.

Note:  
Hidden and context specific command.

Example 24   Checking if a Subscriber is Assigned to an ASP

[local]Redback#context isp1 show security circuits username user1@isp1

CCT     = 6/1:1023:63/1/2/11
  ctxt-id  = 40080002
  pg-id   = 1
  vsg-id   = 2
  sm-cct   = 6/1:1023:63/1/2/11
  sm-pg-id  = 1
  sm-asp-id = 5/1
  asp-homing-attempts  = 1
  asp-homing-history   = 5/1,
  asp-homed       = true
  user_id  = 3000000b
  user_name = user1@isp1
  dpi_policy = p1
  FLAGS:
    SEND_USER_BIND   -> false
    SEND_USER_UNBIND  -> false
    SEND_UNBIND_PREV  -> false
    USER_BOUND     -> true
    SEND_ISM_CCT_CFG  -> false
    SEND_ISM_CCT_UNCFG -> false
[local]Redback#

If the subscriber has not been assigned to an ASP, then do following:

6.6.1.3   Check if a Subscriber is Known to the DPI Engine

Use the show dpi asp asp ID subscriber [subscriber ID] command to check if the subscriber is known to the DPI engine. Subscriber ID is a concatenation of context ID and AAA user ID. Information displayed by this command is retrieved from the DPI engine and reflects its perspective.

View Subscriber to DPI Engine Mapping describes the relevant command.

If the subscriber information is not being propagated from l4l7d to ASP, it may be due to issues with XC to ASE communications.

6.6.2   PPA and DPI Troubleshooting

In a typical BRAS application, subscriber traffic travels from the ingress line card to the egress line card and vice-versa (upstream and downstream). Traffic must be redirected to the ASE for the DPI service. The Packet Processing ASIC (PPA) is programmed to direct traffic to the ASE. This chapter describes how to debug problems with this path.

6.6.2.1   Check if the Line Card is Dropping Packets

Using the following commands, issues at the line card level can be debugged:

If the line card drops packets, refer to the Data Collection Guideline.

6.6.3   ASE and ASP Troubleshooting

This section details the procedures for debugging the packet flow issues at the ASE/ASP level. In this chapter a number of different debug scenarios are documented.

6.6.3.1   Dallas Register State

Dallas FPGA is the first point on the ASE where the packet arrives from the backplane or the last point on the ASE where the packet departs for the backplane. Follow the step given below to gather debug information:

Example 25  

[local]Redback#telnet 127.0.2.3 1000
Trying 127.0.2.3...
Connected to 127.0.2.3.
Escape character is '^]'.

Type 'logout' to exit.

Enter password: 

-> dallas_show_ififo 4
Dallas IFIFO registers:
    Slot 4: Dallas reg 0x00000400 = 0x00000000
    Slot 4: Dallas reg 0x00000404 = 0x00000000
    Slot 4: Dallas reg 0x00000408 = 0x00000210
    Slot 4: Dallas reg 0x0000040C = 0x00000000
    Slot 4: Dallas reg 0x00000410 = 0x00000000
    Slot 4: Dallas reg 0x00000414 = 0x00000000
    Slot 4: Dallas reg 0x00000418 = 0x00000000
    Slot 4: Dallas reg 0x0000041C = 0x00000000
    Slot 4: Dallas reg 0x00000420 = 0x00000000
    Slot 4: Dallas reg 0x00000424 = 0x00000000
    Slot 4: Dallas reg 0x00000428 = 0x00000000
    Slot 4: Dallas reg 0x0000042C = 0x00000000
    Slot 4: Dallas reg 0x00000430 = 0x00000000
    Slot 4: Dallas reg 0x00000434 = 0x00000000
    Slot 4: Dallas reg 0x00000438 = 0x00000000
    Slot 4: Dallas reg 0x0000043C = 0x00000000
    Slot 4: Dallas reg 0x00000440 = 0x04000400
    Slot 4: Dallas reg 0x00000444 = 0x04000400
    Slot 4: Dallas reg 0x00000448 = 0x04000400
    Slot 4: Dallas reg 0x0000044C = 0x04000400
    Slot 4: Dallas reg 0x00000450 = 0x04000400
    Slot 4: Dallas reg 0x00000454 = 0x04000400
    Slot 4: Dallas reg 0x00000458 = 0x04000400
    Slot 4: Dallas reg 0x0000045C = 0x04000400
    Slot 4: Dallas reg 0x00000460 = 0x04000400
    Slot 4: Dallas reg 0x00000464 = 0x04000400
    Slot 4: Dallas reg 0x00000468 = 0x04000400
    Slot 4: Dallas reg 0x0000046C = 0x04000400
    Slot 4: Dallas reg 0x00000470 = 0x04000400
    Slot 4: Dallas reg 0x00000474 = 0x04000400
    Slot 4: Dallas reg 0x00000478 = 0x04000400
    Slot 4: Dallas reg 0x0000047C = 0x04000400
    Slot 4: Dallas reg 0x00000480 = 0x00000000
    Slot 4: Dallas reg 0x00000484 = 0x00000000
    Slot 4: Dallas reg 0x00000488 = 0x00000000
    Slot 4: Dallas reg 0x0000048C = 0x00000000
    Slot 4: Dallas reg 0x00000490 = 0x00000000
    Slot 4: Dallas reg 0x00000494 = 0x00000000
    Slot 4: Dallas reg 0x00000498 = 0x00000000
    Slot 4: Dallas reg 0x0000049C = 0x00000000
    Slot 4: Dallas reg 0x000004A0 = 0x00000000
    Slot 4: Dallas reg 0x000004A4 = 0x00000000
    Slot 4: Dallas reg 0x000004A8 = 0x00000000
    Slot 4: Dallas reg 0x000004AC = 0x00000000
    Slot 4: Dallas reg 0x000004B0 = 0x00000000
    Slot 4: Dallas reg 0x000004B4 = 0x00000000
    Slot 4: Dallas reg 0x000004B8 = 0x00000000
    Slot 4: Dallas reg 0x000004BC = 0x00000000
    Slot 4: Dallas reg 0x000004C0 = 0x00000000
    Slot 4: Dallas reg 0x000004C4 = 0x00000000
    Slot 4: Dallas reg 0x000004C8 = 0x00000000
    Slot 4: Dallas reg 0x000004CC = 0x00000000
    Slot 4: Dallas reg 0x000004D0 = 0x00000000
    Slot 4: Dallas reg 0x000004D4 = 0x01EB39B9
    Slot 4: Dallas reg 0x000004D8 = 0x00000000
    Slot 4: Dallas reg 0x000004DC = 0x00000000
    Slot 4: Dallas reg 0x000004E0 = 0x00000000
    Slot 4: Dallas reg 0x000004E4 = 0x00000000
    Slot 4: Dallas reg 0x000004E8 = 0x00000000
    Slot 4: Dallas reg 0x000004EC = 0x00000000
    Slot 4: Dallas reg 0x000004F0 = 0x00000000
    Slot 4: Dallas reg 0x000004F4 = 0x00000000
    Slot 4: Dallas reg 0x000004F8 = 0x00000000
    Slot 4: Dallas reg 0x000004FC = 0x00000000
    Slot 4: Dallas reg 0x00000500 = 0x04000400
    Slot 4: Dallas reg 0x00000504 = 0x04000400
    Slot 4: Dallas reg 0x00000508 = 0x04000400
    Slot 4: Dallas reg 0x0000050C = 0x04000400
    Slot 4: Dallas reg 0x00000510 = 0x04000400
    Slot 4: Dallas reg 0x00000514 = 0x04000400
    Slot 4: Dallas reg 0x00000518 = 0x04000400
    Slot 4: Dallas reg 0x0000051C = 0x04000400
    Slot 4: Dallas reg 0x00000520 = 0x04000400
    Slot 4: Dallas reg 0x00000524 = 0x04000400
    Slot 4: Dallas reg 0x00000528 = 0x04000400
    Slot 4: Dallas reg 0x0000052C = 0x04000400
    Slot 4: Dallas reg 0x00000530 = 0x04000400
    Slot 4: Dallas reg 0x00000534 = 0x04000400
    Slot 4: Dallas reg 0x00000538 = 0x04000400
    Slot 4: Dallas reg 0x0000053C = 0x04000400
    Slot 4: Dallas reg 0x00000540 = 0x04000400
    Slot 4: Dallas reg 0x00000544 = 0x04000400
    Slot 4: Dallas reg 0x00000548 = 0x04000400
    Slot 4: Dallas reg 0x0000054C = 0x04000400
    Slot 4: Dallas reg 0x00000550 = 0x04000400
    Slot 4: Dallas reg 0x00000554 = 0x04000400
    Slot 4: Dallas reg 0x00000558 = 0x04000400
    Slot 4: Dallas reg 0x0000055C = 0x04000400
    Slot 4: Dallas reg 0x00000560 = 0x04000400
    Slot 4: Dallas reg 0x00000564 = 0x04000400
    Slot 4: Dallas reg 0x00000568 = 0x04000400
    Slot 4: Dallas reg 0x0000056C = 0x04000400
    Slot 4: Dallas reg 0x00000570 = 0x04000400
value = 43 = 0x2b = '+'
-> 
-> 
-> dallas_show_efifo 4
Dallas EFIFO registers:
    Slot 4: Dallas reg 0x00000A00 = 0x00000000
    Slot 4: Dallas reg 0x00000A04 = 0x00000000
    Slot 4: Dallas reg 0x00000A08 = 0x00300020
    Slot 4: Dallas reg 0x00000A0C = 0x00300020
    Slot 4: Dallas reg 0x00000A10 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A14 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A18 = 0x00000000
    Slot 4: Dallas reg 0x00000A1C = 0x00000000
    Slot 4: Dallas reg 0x00000A20 = 0x00000000
    Slot 4: Dallas reg 0x00000A24 = 0x00000000
    Slot 4: Dallas reg 0x00000A28 = 0x00000000
    Slot 4: Dallas reg 0x00000A2C = 0x00000000
    Slot 4: Dallas reg 0x00000A30 = 0x00000000
    Slot 4: Dallas reg 0x00000A34 = 0x00000000
    Slot 4: Dallas reg 0x00000A38 = 0x00000000
    Slot 4: Dallas reg 0x00000A3C = 0x00000000
    Slot 4: Dallas reg 0x00000A40 = 0x00000000
    Slot 4: Dallas reg 0x00000A44 = 0x00000000
    Slot 4: Dallas reg 0x00000A48 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A4C = 0x0A000A00
    Slot 4: Dallas reg 0x00000A50 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A54 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A58 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A5C = 0x0A000A00
    Slot 4: Dallas reg 0x00000A60 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A64 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A68 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A6C = 0x0A000A00
    Slot 4: Dallas reg 0x00000A70 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A74 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A78 = 0x0A000A00
    Slot 4: Dallas reg 0x00000A7C = 0x0A000A00
    Slot 4: Dallas reg 0x00000A80 = 0x00000000
    Slot 4: Dallas reg 0x00000A84 = 0x00000000
    Slot 4: Dallas reg 0x00000A88 = 0x00000000
    Slot 4: Dallas reg 0x00000A8C = 0x00000000
    Slot 4: Dallas reg 0x00000A90 = 0x00000000
    Slot 4: Dallas reg 0x00000A94 = 0x00000000
    Slot 4: Dallas reg 0x00000A98 = 0x00000000
    Slot 4: Dallas reg 0x00000A9C = 0x00000000
    Slot 4: Dallas reg 0x00000AA0 = 0x00000000
    Slot 4: Dallas reg 0x00000AA4 = 0x00000000
    Slot 4: Dallas reg 0x00000AA8 = 0x00000000
    Slot 4: Dallas reg 0x00000AAC = 0x00000000
    Slot 4: Dallas reg 0x00000AB0 = 0x00000000
    Slot 4: Dallas reg 0x00000AB4 = 0x00000000
    Slot 4: Dallas reg 0x00000AB8 = 0x00000000
    Slot 4: Dallas reg 0x00000ABC = 0x00000000
    Slot 4: Dallas reg 0x00000AC0 = 0x00000000
    Slot 4: Dallas reg 0x00000AC4 = 0x00000000
    Slot 4: Dallas reg 0x00000AC8 = 0x00000000
    Slot 4: Dallas reg 0x00000ACC = 0x00000000
    Slot 4: Dallas reg 0x00000AD0 = 0x00000000
    Slot 4: Dallas reg 0x00000AD4 = 0x01D67229
    Slot 4: Dallas reg 0x00000AD8 = 0x00000000
    Slot 4: Dallas reg 0x00000ADC = 0x00000000
    Slot 4: Dallas reg 0x00000AE0 = 0x00000000
    Slot 4: Dallas reg 0x00000AE4 = 0x00000000
    Slot 4: Dallas reg 0x00000AE8 = 0x00000000
    Slot 4: Dallas reg 0x00000AEC = 0x00000000
    Slot 4: Dallas reg 0x00000AF0 = 0x00000000
    Slot 4: Dallas reg 0x00000AF4 = 0x00000000
    Slot 4: Dallas reg 0x00000AF8 = 0x00000000
    Slot 4: Dallas reg 0x00000AFC = 0x00000000
value = 43 = 0x2b = '+'
-> logout

6.6.3.2   ASP Octeon-Security Parameter Index Counters

The interface between Dallas and Octeon is the Security Parameter Index (SPI) interface. SPI interface counters are used to check whether packets are being exchanged between Dallas and Octeon. Use the show security asp asp ID statistics packet line card command to get the Octeon-SPI counters. If ingress and egress are in two different line cards (which is usually the case), the ingress counters on card 1 should be correlated with egress counters on card 2.

Note:  
Ingress and egress are from the same port 6/1 in this example.

Example 26  

[local]Redback#show security asp 5/1 statistics packet 6
 Slot 6 :

  Ingress: 
    Packets: 207101
    Error Packets: 0
    Packets QOS Dropped: 0
    Bytes Processed: 137514222
    QOS Bytes Dropped: 0

  Packet Distribution:
    Packet-Length(Bytes)       Number-of-Packets 
       64                              0
       65-127                          69034
      128-255                          0
      256-511                          69034
      512-1023                         0
      1024-1518                        69033
     Greater than 1518                 0

   Egress:
     Packets: 207101
     Bytes:  132958000
[local]Redback#

6.6.3.3   DP Shim Layer

The DP Shim Layer, a small interface layer at the application level, performs basic packet validation and label checks. The received, forwarded and sent values should match.

Example 27  

l4l7sh:/stats>glbpktstats isp1

 Global Packet Stats : 
====================== 
Received Packets: 207101 
Dropped Packets: 0 
Forwarded Packets: 207101 
Received IKE pkts: 0 
Dropped IKE pkts: 0 
Received Local Stack Packets: 0 
Received NAT-T Keepalive Packets: 0 
Total IP Packets Received From CP: 0 
DPI Received Shim pkts: 0 
DPI Received Packets: 0 
DPI Dropped Packets: 0 
DPI Bypassed Packets: 0 
DPI Sent Packets: 207101 
DPI Orig Packets: 0 
L3 Bypassed Packets (AllContexts): 0 

l4l7sh:/stats>

6.6.3.4   Control Plane IPC Statistics

IPC statistics are primarily used to debug the communication between the XCRP (l4l7D) and ASE. These statistics are used for debugging any issues on the control plane, primarily subscriber bring up and configuration information flow.

Example 28  

l4l7sh:/config/rbak/dp/cmnshm>show_async_msg_stats

IPC Statistics
==============
Messages Received : 12 ASP Messages    : 24 
Length Errors     : 0 
Tx Send Successes : 1 Tx Send Failures : 0 

User Statistics
===============
Login Requests   : 1 Successful Logins  : 1 
Failed Logins    : 0 
Logout Requests  : 0 Successful Logouts : 0 
Failed Logouts   : 0 
Unknown Requests : 0 Invalid Requests   : 0 

IPSec Statistics
================
Bind Requests          : 0 Successful Binds       : 0 
Bind Failures          : 0 
Config Requests        : 0 Successful Configs     : 0 
Config Failures        : 0 
Unbind Requests        : 0 Successful Unbinds     : 0 
Unbind Failures        : 0 
Unknown Requests       : 0 Invalid Requests       : 0 
Total Tunnel Status Rx : 0 Total Tunnel Status Tx : 0 
First SA Added         : 0 Last SA Deleted        : 0 
SA Up Evts             : 0 SA Dn Evts             : 0 
Op Status Up Evts      : 0 Op Stauts Dn Evts      : 0 
Total SA Status Rx     : 0 Total SA Status Tx     : 0 

Config Message Statistics
=========================
IPSec Msgs : 1 IPSec Failures : 0 
DPI Msgs   : 13 DPI Failures  : 0 

l4l7sh:/config/rbak/dp/cmnshm>

6.6.4   ASE and DPI Troubleshooting

You use various DPI show and debug commands to view counters and statistics and debug application-level problems. For more information, see Application Traffic Management Command Reference.

Some common debug scenarios and corresponding show commands and examples are described in the following sections.

6.6.4.1   Capacity and Scaling Issues

If capacity and scaling issues occur and the behavior observed differs from the published numbers for the DPI application, Octeon cores are possibly not being used evenly or ASPs are not evenly loaded. Check the subscriber and load distribution across ASPs and Octeon using the following example:

Note:  
Hidden commands.

Example 29   Subscriber Load Balancing Over 14 Octeon Cores

[local]Redback#show dpi asp 5/1 traffic-management statistics subscriber 
 Current Subscriber Count: 3000
 Peak Subscriber Count: 3000

 Subscribers Per Profile:
    Profile-Name         Subscriber-Count
    policy_dpi               3000
[local]Redback#
[local]Redback#show dpi asp 5/1 traffic-management statistics subscriber instance 1
 Current Subscriber Count: 215
 Peak Subscriber Count: 2215

 Subscribers Per Profile:
    Profile-Name         Subscriber-Count
    policy_dpi               215
[local]Redback#
[local]Redback#show dpi asp 5/1 traffic-management statistics subscriber instance 2
 Current Subscriber Count: 216
 Peak Subscriber Count: 216

 Subscribers Per Profile:
    Profile-Name         Subscriber-Count
    policy_dpi               216
[local]Redback#
&mldr; Snippet
...
[local]Redback#show dpi asp 5/1 traffic-management statistics subscriber instance 14
 Current Subscriber Count: 186
 Peak Subscriber Count: 186

 Subscribers Per Profile:
    Profile-Name         Subscriber-Count
    policy_dpi               186
[local]Redback#

Example 30   Traffic Load Distribution Across Octeon Cores

[local]Redback#show dpi asp 5/1 traffic-management statistics packet instance 1
 Packets Received: 2116774
 Bytes Received: 1523585194
 Packets Dropped: 0
 Bytes Dropped: 0
 Packets Inspected: 286337
 Packets Rate Limited: 0
 Packets Sent: 2116774
 Bytes Sent: 1523585194
 Non-TCP/UDP Packets Received: 0
 Packets Bypassed: 0
[local]Redback#
[local]Redback#show dpi asp 5/1 traffic-management statistics packet instance 2
 Packets Received: 2116770
 Bytes Received: 1549117145
 Packets Dropped: 0
 Bytes Dropped: 0
 Packets Inspected: 281276
 Packets Rate Limited: 0
 Packets Sent: 2116770
 Bytes Sent: 1549117145
 Non-TCP/UDP Packets Received: 0
 Packets Bypassed: 0
[local]Redback#
&mldr; Snippet
...
[local]Redback#show dpi asp 5/1 traffic-management statistics packet instance 14
 Packets Received: 2094688
 Bytes Received: 1514046617
 Packets Dropped: 0
 Bytes Dropped: 0
 Packets Inspected: 282300
 Packets Rate Limited: 0
 Packets Sent: 2094688
 Bytes Sent: 1514046617
 Non-TCP/UDP Packets Received: 0
 Packets Bypassed: 0
[local]Redback#

7   Appendix A Sample Output dpmonitor –d <core-ID>

Example 31  

[local]bittor#connect 5 1
Trying 127.0.204.1...
Connected to 127.0.204.1.
Escape character is '^]'.

Redback
[local]ASE[05/1]#st sh
ase-ksh(1)# 
ase-ksh(1)# dpmonitor -d 2
dpmonitor_display_core(2)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014800000
Stack Phys:   0x2ce00000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    2
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2dc00000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014800000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01100000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014600000             0x000000002ce00000 DG
24:  1M 0x0000000001000000             0x000000002dc00000 DG


Normal Stack 32: 0x00100000 Bytes at 0x14700000.


Core 2: TLB Refill (EXL == 0):
Core 2: GPR:
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 2: Status: 0x00000000 Cause: 0x00000000
Core 2: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 2: CVM HWREna:        0x00000000
Core 2: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 2: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(2)# 
ase-ksh(2)# 
ase-ksh(2)# dpmonitor -d 3
dpmonitor_display_core(3)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014900000
Stack Phys:   0x2cf00000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    3
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2dd00000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014900000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01200000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014800000 0x000000002cf00000 DG            
24:  1M 0x0000000001200000 0x000000002dd00000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x14800000.


Core 3: TLB Refill (EXL == 0):
Core 3: GPR:
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 3: Status: 0x00000000 Cause: 0x00000000
Core 3: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 3: CVM HWREna:        0x00000000
Core 3: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 3: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(3)# 
ase-ksh(3)# 
ase-ksh(3)# dpmonitor -d 4
dpmonitor_display_core(4)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014a00000
Stack Phys:   0x2d000000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    4
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2de00000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014a00000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01300000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014800000             0x000000002d000000 DG
24:  1M 0x0000000001200000             0x000000002de00000 DG


Normal Stack 32: 0x00100000 Bytes at 0x14900000.


Core 4: TLB Refill (EXL == 0):
Core 4: GPR:
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 4: Status: 0x00000000 Cause: 0x00000000
Core 4: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 4: CVM HWREna:        0x00000000
Core 4: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 4: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(4)# 
ase-ksh(4)# 
ase-ksh(4)# dpmonitor -d 5
dpmonitor_display_core(5)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014b00000
Stack Phys:   0x2d100000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    5
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2df00000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014b00000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01400000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014a00000 0x000000002d100000 DG            
24:  1M 0x0000000001400000 0x000000002df00000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x14a00000.


Core 5: TLB Refill (EXL == 0):
Core 5: GPR:
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 5: Status: 0x00000000 Cause: 0x00000000
Core 5: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 5: CVM HWREna:        0x00000000
Core 5: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 5: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(5)# 
ase-ksh(5)# 
ase-ksh(5)# dpmonitor -d 6
dpmonitor_display_core(6)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014c00000
Stack Phys:   0x2d200000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    6
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e000000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014c00000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01500000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014a00000             0x000000002d200000 DG
24:  1M 0x0000000001400000             0x000000002e000000 DG


Normal Stack 32: 0x00100000 Bytes at 0x14b00000.


Core 6: TLB Refill (EXL == 0):
Core 6: GPR:
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 6: Status: 0x00000000 Cause: 0x00000000
Core 6: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 6: CVM HWREna:        0x00000000
Core 6: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 6: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(6)# 
ase-ksh(6)# 
ase-ksh(6)# dpmonitor -d 7
dpmonitor_display_core(7)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014d00000
Stack Phys:   0x2d300000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    7
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e100000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014d00000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01600000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014c00000 0x000000002d300000 DG            
24:  1M 0x0000000001600000 0x000000002e100000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x14c00000.


Core 7: TLB Refill (EXL == 0):
Core 7: GPR:
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 7: Status: 0x00000000 Cause: 0x00000000
Core 7: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 7: CVM HWREna:        0x00000000
Core 7: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 7: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(7)# 
ase-ksh(7)# 
ase-ksh(7)# dpmonitor -d 8
dpmonitor_display_core(8)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014e00000
Stack Phys:   0x2d400000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    8
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e200000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014e00000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01700000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014c00000             0x000000002d400000 DG
24:  1M 0x0000000001600000             0x000000002e200000 DG


Normal Stack 32: 0x00100000 Bytes at 0x14d00000.


Core 8: TLB Refill (EXL == 0):
Core 8: GPR:
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 8: Status: 0x00000000 Cause: 0x00000000
Core 8: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 8: CVM HWREna:        0x00000000
Core 8: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 8: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(8)# 
ase-ksh(8)# 
ase-ksh(8)# dpmonitor -d 9
dpmonitor_display_core(9)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000014f00000
Stack Phys:   0x2d500000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    9
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e300000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000014f00000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01800000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014e00000 0x000000002d500000 DG            
24:  1M 0x0000000001800000 0x000000002e300000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x14e00000.


Core 9: TLB Refill (EXL == 0):
Core 9: GPR:
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 9: Status: 0x00000000 Cause: 0x00000000
Core 9: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 9: CVM HWREna:        0x00000000
Core 9: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 9: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(9)# 
ase-ksh(9)# 
ase-ksh(9)# dpmonitor -d 10
dpmonitor_display_core(10)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000015000000
Stack Phys:   0x2d600000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    10
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e400000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000015000000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01900000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000014e00000             0x000000002d600000 DG
24:  1M 0x0000000001800000             0x000000002e400000 DG


Normal Stack 32: 0x00100000 Bytes at 0x14f00000.


Core 10: TLB Refill (EXL == 0):
Core 10: GPR:
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 10: Status: 0x00000000 Cause: 0x00000000
Core 10: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 10: CVM HWREna:        0x00000000
Core 10: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 10: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(10)# 
ase-ksh(10)# 
ase-ksh(10)# dpmonitor -d 11
dpmonitor_display_core(11)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000015100000
Stack Phys:   0x2d700000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    11
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e500000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000015100000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01a00000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000015000000 0x000000002d700000 DG            
24:  1M 0x0000000001a00000 0x000000002e500000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x15000000.


Core 11: TLB Refill (EXL == 0):
Core 11: GPR:
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 11: Status: 0x00000000 Cause: 0x00000000
Core 11: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 11: CVM HWREna:        0x00000000
Core 11: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 11: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(11)# 
ase-ksh(11)# 
ase-ksh(11)# 
ase-ksh(11)# dpmonitor -d 12
dpmonitor_display_core(12)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000015200000
Stack Phys:   0x2d800000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    12
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e600000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000015200000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01b00000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000015000000             0x000000002d800000 DG
24:  1M 0x0000000001a00000             0x000000002e600000 DG


Normal Stack 32: 0x00100000 Bytes at 0x15100000.


Core 12: TLB Refill (EXL == 0):
Core 12: GPR:
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 12: Status: 0x00000000 Cause: 0x00000000
Core 12: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 12: CVM HWREna:        0x00000000
Core 12: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 12: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(12)# 
ase-ksh(12)# 
ase-ksh(12)# 
ase-ksh(12)# dpmonitor -d 13
dpmonitor_display_core(13)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000015300000
Stack Phys:   0x2d900000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    13
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e700000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000015300000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01c00000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000015200000 0x000000002d900000 DG            
24:  1M 0x0000000001c00000 0x000000002e700000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x15200000.


Core 13: TLB Refill (EXL == 0):
Core 13: GPR:
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 13: Status: 0x00000000 Cause: 0x00000000
Core 13: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 13: CVM HWREna:        0x00000000
Core 13: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 13: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(13)# 
ase-ksh(13)# 
ase-ksh(13)# dpmonitor -d 14
dpmonitor_display_core(14)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000015400000
Stack Phys:   0x2da00000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    14
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e800000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000015400000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01d00000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000015200000             0x000000002da00000 DG
24:  1M 0x0000000001c00000             0x000000002e800000 DG


Normal Stack 32: 0x00100000 Bytes at 0x15300000.


Core 14: TLB Refill (EXL == 0):
Core 14: GPR:
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 14: Status: 0x00000000 Cause: 0x00000000
Core 14: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 14: CVM HWREna:        0x00000000
Core 14: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 14: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(14)# 
ase-ksh(14)# 
ase-ksh(14)# dpmonitor -d 15
dpmonitor_display_core(15)
Simple Exec Loaded: /usr/local/simple_exec/l4l7apps.se.

DP_Core Info Structure:
Stack Top:   0x0000000015500000
Stack Phys:   0x2db00000
Stack Size:   0x00100000
Shmem Base:   0x30000000
Shmem Size:   0x50000000
Text VA Base:  0x10000018
Text PA Base:  0x2c000018
Text Length:  0x0072ba38
Core Mask:   0x0000fffc
Core ID:    15
Octeon ID:   0
ASE Slot ID:  4
Debug Buf PA:  0x2e900000
Debug Buf Len: 0x00100000

PCB:
Boot Descriptor block (S0):

     stack_top:  0x0000000015500000
     stack_size:  0x00100000
  shared_mem_base:  0x30000000
   shared_mem_len:  0x50000000
  boot_info_flags:  0x00000000
     core_mask:  0x0000fffc
      cpu_clk:  600000000
      dram_clk:  533
      spi_clk:  625
      dfa_clk:  600000000
boot_info_cfg_flags:  0x00000000
  boot_desc_flags:  0x00000000
     octeon_id:  0
      slot_id:  4
    debug_buf_va:  0x01e00000
   debug_buf_len:  0x00100000
  asmd_chassis_va:  0x1451c1c8
     asmd_lc_va:  0x1451c1dc
   base_mac_addr:  00:30:40:00:30:40
    num_mac_addr:  1

 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
cpc0_tlb_entryhi: 0x0000000000000000 cpc0_tlb_wired: 0x00000019
   cpc0_status: 0x504000a0
   cpc0_cause: 0x00000000
  cpc0_config_0: 0x00000000

32 bit entrypoint: 0x10000158

 0:  1M 0x0000000000e00000 0x0000000000e00000 DG 0x0000000000f00000 DG
 1:  16M 0x0000000004000000 0x0000000004000000 DG 0x0000000005000000 DG
 2:  64M 0x0000000030000000 0x0000000030000000 DG 0x0000000034000000 DG
 3:  64M 0x0000000038000000 0x0000000038000000 DG 0x000000003c000000 DG
 4: 256M 0x0000000040000000 0x0000000040000000 DG 0x0000000050000000 DG
 5: 256M 0x0000000060000000 0x0000000060000000 DG 0x0000000070000000 DG
 6:  1M 0x0000000010000000 0x000000002c000000 G 0x000000002c100000 G
 7:  1M 0x0000000010200000 0x000000002c200000 G 0x000000002c300000 G
 8:  1M 0x0000000010400000 0x000000002c400000 G 0x000000002c500000 G
 9: 256K 0x0000000010600000 0x000000002c600000 G 0x000000002c640000 G
10: 256K 0x0000000010680000 0x000000002c680000 G 0x000000002c6c0000 G
11:  64K 0x0000000010700000 0x000000002c700000 G 0x000000002c710000 G
12:  16K 0x0000000010720000 0x000000002c720000 G 0x000000002c724000 G
13:  16K 0x0000000010728000 0x000000002c728000 G            
14:  16K 0x0000000012000000 0x000000002c730000 DG 0x000000002c734000 DG
15:  1M 0x0000000014000000 0x000000002c800000 DG 0x000000002c900000 DG
16:  1M 0x0000000014200000 0x000000002ca00000 DG 0x000000002cb00000 DG
17: 256K 0x0000000014400000 0x000000002cc00000 DG 0x000000002cc40000 DG
18: 256K 0x0000000014480000 0x000000002cc80000 DG 0x000000002ccc0000 DG
19:  16K 0x0000000014500000 0x000000002cd00000 DG 0x000000002cd04000 DG
20:  16K 0x0000000014508000 0x000000002cd08000 DG 0x000000002cd0c000 DG
21:  16K 0x0000000014510000 0x000000002cd10000 DG 0x000000002cd14000 DG
22:  4K 0x000000001451c000 0x000000041f895000 G 0x000000041f894000 DG
23:  1M 0x0000000015400000 0x000000002db00000 DG            
24:  1M 0x0000000001e00000 0x000000002e900000 DG            


Normal Stack 32: 0x00100000 Bytes at 0x15400000.


Core 15: TLB Refill (EXL == 0):
Core 15: GPR:
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: 0x0000000000000000 0x0000000000000000 0x0000000000000000 0x0000000000000000
Core 15: Status: 0x00000000 Cause: 0x00000000
Core 15: Bad Addr:     0x0000000000000000 EPC:        0x0000000000000000
Core 15: CVM HWREna:        0x00000000
Core 15: CVM ICache Err:  0x0000000000000000 CVM DCache Err:  0x0000000000000000
Core 15: CVM Ctl:      0x0000000000000000 CVM MemCtl:    0x0000000000000000


EPC: 0x0000000000000000
ase-ksh(15)# 
ase-ksh(15)# 
ase-ksh(15)# exit
[local]ASE[05/1]#

Glossary

AAA
Authentication, Authorization and Accounting
 
ASE
Advanced Services
 
ASP
Advanced Services Processor
 
BRAS
Broad Remote Access Server
 
BSD
Berkeley Standard Distribution
 
CF
CompactFlash
 
CPLD
Complex Programmable Logic Device
 
DP
Data Plane
 
DPI
Deep Packet Inspection
 
FTP
File Transfer Protocol
 
IPC
Interprocess Communication
 
IPPA
ASIC
 
PPA
Packet Processing ASIC
 
RMA
Return Merchandise Authorization
 
SPI
Security Parameter Index
 
TFPT
Trivial FTP