Create an observability demo showing telemetry data from Structures flowing to a 3P observability provider (probably DataDog)

[ian-griptape-ai]

I'm not sure whether this sample is current?

[collindutter]

@ian-griptape-ai would you mind tackling this one?

[ian-griptape-ai]

As there's no way to display observability data in GTC right now, to illustrate observability capabilities, we need to provide a demo showing integration with a third party observability provider.

[ian-griptape-ai]

I set up an environment with Honeycomb and I can send traces from Griptape Frameworks apps over there. That is working great. We're light on metrics though, which makes the demo (and solution) kind of underwhelming. To address this I opened a feature request with @collindutter in the issue that I made a parent to this to add metrics to PromptDrivers. See the other issue for more details.

griptape-ai/griptape#1790

Once that is done, I will update docs and write an externally facing blog post.

The people from Honeycomb want a mention in the post, which is fine by me.

[ian-griptape-ai]

Discussion with Datadog - the only GA mechanisms for ingest of OTEL data into Datadog are using an OTel Collector, or using the Datadog Agent. Their direct ingest features are in various states of development. Logs in preview (we don't need this with our current observability implementation), metrics is in private preview (we would use this when our additional observability features are implemented), traces/spans (which we could use right now) is not yet released and the DA I spoke with did not know when that would be made available to customers.

So, we are blocked on doing anything with Datadog for now, unless we want to explore running OTel Collectors alongside Structures for Observability, which seems like a very heavy lift to me.

[collindutter]

Why don't we use honeycomb?