Using EDEV FCP Monitor Data

With VM66095, z/VM now emits monitor records describing EDEV-related FCP chpid activity and EDEV-related FCP device activity.

In this article we describe how to collect and format the records and also how to interpret the report.

Collecting the Records and Building the Report

Get the R4MON package and follow the instructions in the README file therein.

Appearance of The $R4MON Chpid Report

Metrics calculated from the new monitor records describe the behavior of FCP chpids as it relates to the supporting of EDEVs.

Here is an excerpt of the FCP chpid report. The report is very wide; on this web page, for page rendering purposes, we have broken the columns into groups.

The workload here was entirely contrived for internal lab purposes; the values in the report mean absolutely nothing as far as customer workload expectations are concerned.

FCP Chpid Report from file PFSYR43 MVR4 B __ISO-UTC__________ CH _Type_ Paths_ >>Mean>> 14 5 112 >>Mean>> 15 5 112 >>Mean>> 16 5 112 >>Mean>> 17 5 112 2018-01-11 14:15:51 14 5 112 2018-01-11 14:15:51 15 5 112 2018-01-11 14:15:51 16 5 112 2018-01-11 14:15:51 17 5 112 (continued) _InReq/Sec__ __InMB/Sec__ __InB/Req___ 4134.14 207.39 52602.86 4132.28 206.95 52514.95 4132.50 207.35 52612.94 4134.74 206.92 52474.09 4130.76 211.26 53627.33 4136.68 212.44 53849.17 4137.68 211.47 53591.18 4129.45 213.10 54112.79 (continued) _OutReq/Sec_ _OutMB/Sec__ __OutB/Req__ 2242.35 207.16 96870.88 2244.22 207.44 96921.24 2244.00 207.43 96929.42 2241.76 207.01 96828.42 2148.73 210.96 102947.96 2143.08 209.80 102654.14 2142.24 210.90 103232.51 2150.31 211.77 103267.86 (continued) ___ProcU____ __M(ProcU)__ _SD(ProcU)__ 11 11.52 1.14 12 11.43 1.14 12 11.38 1.09 11 11.43 1.05 12 12.00 0.00 12 12.00 0.00 12 12.00 0.00 12 12.00 0.00 (continued) ____BusU____ __M(BusU)___ __SD(BusU)__ 22 21.81 2.08 23 21.81 2.36 23 21.81 2.26 23 21.90 1.87 22 22.00 0.00 22 22.00 0.00 23 23.00 0.00 22 22.00 0.00 (continued) ___AdapU____ __M(AdapU)__ _SD(AdapU)__ 0 1.95 1.76 1 1.81 1.62 1 1.76 1.69 1 1.86 1.46 0 0.00 0.00 0 0.00 0.00 0 0.00 0.00 1 1.00 0.00 (continued) SSLastReset_ __Gathers___ _Time/Gath__ _GatherErrs_ 1948898.00 21 1339.90 0 1948894.00 21 581.81 0 1948899.00 21 344.71 0 1948905.00 21 317.86 0 1948298.00 1 193.00 0 1948294.00 1 174.00 0 1948299.00 1 147.00 0 1948305.00 1 557.00 0

The table below gives definitions for each of the columns in the report.

Column Meaning
ISO-UTC The yyyy-mm-dd hh:mm:ss of the CP Monitor interval-end time, in UTC.

The first flock of rows is marked ">>Mean>>" to indicate that the rows are the mean experience of each chpid over the whole time range recorded in the MONWRITE file.

CH The chpid number.
Type The chpid type. Values (decimal) are:
1, port type unknown
3, port not accessible
5, N_Port attached to a fabric
33, port is point-to-point attached to a device
Paths The number of EDEV paths running through this chpid.
InReq/Sec The number of input (read) requests per second.
InMB/Sec The amount of input (read) data per second.
InB/Req The amount of input (read) data per request.
OutReq/Sec The number of output (write) requests per second.
OutMB/Sec The amount of output (write) data per second.
OutB/Req The amount of output (write) data per request.
ProcU The most recent sample of chpid processor utilization.
M(ProcU) The mean of the samples of chpid processor utilization, for the samples contributing to this row.
SD(ProcU) The standard deviation of the samples of chpid processor utilization, for the samples contributing to this row.
BusU The most recent sample of bus utilization.
M(BusU) The mean of the samples of bus utilization, for the samples contributing to this row.
SD(BusU) The standard deviation of the samples of bus utilization, for the samples contributing to this row.
AdapU The most recent sample of adapter utilization.
M(AdapU) The mean of the samples of adapter utilization, for the samples contributing to this row.
SD(AdapU) The standard deviation of the samples of adapter utilization, for the samples contributing to this row.
SSLastReset The number of seconds since the FCP chpid was last reset.
Gathers The number of gathers of data from the chpid, for the data that contributed to this row.
Time/Gath The time per gather operation, in TOD units.
GatherErrs The number of errant gathers of data from the chpid, for the data that contributed to this row.

Appearance of The $R4MON Device Report

Metrics calculated from the new monitor records describe the behavior of FCP devices as it relates to the supporting of EDEVs.

Here is an excerpt of the FCP device report. The report is very wide; on this web page, for page rendering purposes, we have broken the columns into groups.

The workload here was entirely contrived for internal lab purposes; the values in the report mean absolutely nothing as far as customer workload expectations are concerned.

FCP RDEV Report from file PFSYR43 MVR4 B __ISO-UTC__________ RDEV _Type_ __Paths___ >>Mean>> DF40 6 112 >>Mean>> DF60 6 112 >>Mean>> DF80 6 112 >>Mean>> DFA0 6 112 2018-01-11 14:15:51 DF40 6 112 2018-01-11 14:15:51 DF60 6 112 2018-01-11 14:15:51 DF80 6 112 2018-01-11 14:15:51 DFA0 6 112 (continued) _InReq/Sec__ __InMB/Sec__ __InB/Req___ 4134.17 207.39 52602.90 4132.29 206.95 52514.85 4132.51 207.35 52613.48 4134.74 206.92 52474.07 4131.03 211.27 53626.04 4136.96 212.43 53844.84 4137.73 211.50 53598.33 4129.56 213.10 54110.60 (continued) _OutReq/Sec_ _OutMB/Sec__ __OutB/Req__ 2242.35 207.16 96870.88 2244.22 207.44 96921.24 2244.00 207.43 96929.42 2241.76 207.01 96828.42 2148.82 210.97 102947.96 2143.05 209.80 102654.14 2142.21 210.90 103232.51 2150.28 211.77 103267.86 (continued) __Latency___ __BufferOF__ 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 (continued) ___QDepth___ _M(QDepth)__ _SD(QDepth)_ _QTime/Req__ 5 23.62 131.32 0.20 9 20.43 116.42 0.20 11 22.29 122.68 0.19 13 21.19 119.38 0.20 7 7.00 0.00 0.21 5 5.00 0.00 0.19 6 6.00 0.00 0.28 7 7.00 0.00 0.19 (continued) SSLastReset_ __Gathers___ _Time/Gath__ _GatherErrs_ 1853 21 233.67 0 1839 21 183.43 0 1838 21 171.19 0 1839 21 429.38 0 1253 1 109.00 0 1239 1 104.00 0 1238 1 97.00 0 1239 1 195.00 0

The table below gives definitions for each of the columns in the report.

Column Meaning
ISO-UTC The yyyy-mm-dd hh:mm:ss of the CP Monitor interval-end time, in UTC.

The first flock of rows is marked ">>Mean>>" to indicate that the rows are the mean experience of each chpid over the whole time range recorded in the MONWRITE file.

RDEV The FCP device number.
Type The chpid type. Values (decimal) are:
1, Ficon Adapter
2, Ficon Express
3, Ficon Express2
4, Ficon Express4
5, Ficon Express8
6, Ficon Express8S
7, Ficon Express16S
8, Ficon Express16XS
Paths The number of EDEV paths running through this device.
InReq/Sec The number of input (read) requests per second.
InMB/Sec The amount of input (read) data per second.
InB/Req The amount of input (read) data per request.
OutReq/Sec The number of output (write) requests per second.
OutMB/Sec The amount of output (write) data per second.
OutB/Req The amount of output (write) data per request.
Latency Fabric latency per operation, in nanoseconds.
BufferOF The number of buffer overflows seen in the samples contributing to this row.
QDepth The most recent sample of queue depth.
M(QDepth) The mean of the samples of queue depth, for the samples contributing to this row.
SD(QDepth) The standard deviation of the samples of queue depth, for the samples contributing to this row.
QTime/Req Mean queue time per request, in microseconds.
SSLastReset The number of seconds since the FCP device was last reset.
Gathers The number of gathers of data from the device, for the data that contributed to this row.
Time/Gath The time per gather operation, in TOD units.
GatherErrs The number of errant gathers of data from the device, for the data that contributed to this row.

Appearance of The $R4MON Event Log

At the bottom of the $R4MON file there is a small log that summarizes what was seen in config records and event records.

Here is an excerpt of the FCP event log.

FCP Event Log from file PFSYR43 MVR4 B __ISO-UTC__________ D_ _R_ _Record_ Event 2018-01-11 14:14:53 1 33 MRMTRFCC Config EDEV FCP device DF40 2018-01-11 14:14:53 1 33 MRMTRFCC Config EDEV FCP device DF60 2018-01-11 14:14:53 1 33 MRMTRFCC Config EDEV FCP device DF80 2018-01-11 14:14:53 1 33 MRMTRFCC Config EDEV FCP device DFA0 2018-01-11 14:14:53 1 32 MRMTRCHC Config EDEV FCP chpid 14 2018-01-11 14:14:53 1 32 MRMTRCHC Config EDEV FCP chpid 15 2018-01-11 14:14:53 1 32 MRMTRCHC Config EDEV FCP chpid 16 2018-01-11 14:14:53 1 32 MRMTRCHC Config EDEV FCP chpid 17

The table below gives definitions for each of the columns in the report.

Column Meaning
ISO-UTC The yyyy-mm-dd hh:mm:ss of the CP Monitor event record, in UTC.
D The monitor domain number.
R The monitor record number.
Record The name of the monitor record.
Event A textual description of the event.