|
| 1 | +# LDMS-Kokkos Connector |
| 2 | + |
| 3 | +The LDMS Kokkos Tools Connector - along with the optional Kokkos Sampler Tools utility - utilizes LDMS Streams to collect kernel messages generated by it (or optionally generated by the Kokkos Tools Sampler) and received by the Kokkos Tools Connector. |
| 4 | + |
| 5 | +The LDMS-Kokkos Connector relies on LDMS Streams to publish data to your provided database. Please refer to the following on how to setup LDMS Streams: https://ovis-hpcreadthedocs.readthedocs.io/en/latest/ldms-streams.html |
| 6 | + |
| 7 | +The following libraries are needed for the kokkosConnector: |
| 8 | +* Kokkos-Tools: https://github.com/kokkos/kokkos-tools |
| 9 | + |
| 10 | +To install the appropriate utitilies in Kokkos-Tools for the optional Kokkos Tools sampler: |
| 11 | +* Navigate to kokkos-tools/common/kokkos-sampler/ |
| 12 | +* Follow the appropriate make instructions in Kokkos-Tools to make the kokkos-sampler with its included Makefile. |
| 13 | + |
| 14 | +The following information will need to be added to the kokkosConnector's Makefile before running make: |
| 15 | +* Path to Ovis needs to be set for OVIS_DIR in the Makefile |
| 16 | +* Path to Kokkos-Tools needs to be set of KTO_DIR in the Makefile |
| 17 | + |
| 18 | +When using the KokkosConnector, the following environmental variables are required to be set prior to application execution command: |
| 19 | + * KOKKOS_LDMS_HOST="localhost" |
| 20 | + * KOKKOS_LDMS_PORT="412" |
| 21 | + * KOKKOS_TOOLS_LIBS="[INSERT PATH TO OVIS]/kokkosConnector/kp_kernel_ldms.so" |
| 22 | + * KOKKOS_LDMS_AUTH="munge" |
| 23 | + * KOKKOS_LDMS_XPRT="sock" |
| 24 | + |
| 25 | +# Usage with sampler utility |
| 26 | + |
| 27 | +Because of the large amount of performance data obtained from LDMS via the |
| 28 | +Kokkos Tools connector, it is recommended to use the Kokkos Tools sampler |
| 29 | +utility, which was in part inspired by the needs of data order reduction for |
| 30 | +performance profiling data of LDMS. Please see the documentation for the |
| 31 | +sampler for its usage. When using the sampler with the LDMS connector, one must |
| 32 | +enables the sampler utility tool connector _and_ considers the LDMS connector |
| 33 | +as its child tool connector library. |
| 34 | + |
| 35 | +This is done by: |
| 36 | + |
| 37 | +export KOKKOS_TOOLS_LIBS="kp_sampler.so; kp_kernel_ldms.so"; |
| 38 | + |
| 39 | +# Verbose Output |
| 40 | + |
| 41 | +For verbose output for the LDMS data, set the KOKKOS_LDMS_VERBOSE environment |
| 42 | +variable. |
| 43 | + |
| 44 | +* KOKKOS_LDMS_VERBOSE |
| 45 | + * This variable is for debug purposes and prints all Kokkos messages received by the LDMS-Kokkos Connector to the output file. |
0 commit comments