🤖 Meet OnCall AI, our observability copilot that makes troubleshooting easy. Read announcement.

Skip to content
Back to Videos

From The Edge August 2023: Visual Pipelines Post-Launch Updates and Log Search Improvements

Sep 1, 2023 / 8:14
On this episode of From The Edge, we discuss four new post-launch updates to Visual Pipelines. We also go over several improvements to Log Search & Analytics which enable greater ease of use. Read more about the Log Search updates here: https://edgedelta.com/company/blog/log-search-analytics-upgrades?utm_source=youtube&utm_medium=social&utm_campaign=to-the-edge-august23


Hi, I'm Riley Peronto, the director of product marketing at Edge Delta, and I'm here to talk about what's new across our observability, pipelines and logs, search and analytics products. Let's start with pipelines.

A few weeks ago, we launched visual pipelines and graphical interface for creating, managing, and testing your pipelines. This release makes it easier for your Central Observability team to manage pipelines at scale, and for developers to build pipelines in a self-service manner. Since we launched Visual Pipelines, we've had several new updates. This includes built-in integration support so you can integrate with external providers directly within the pipelines interface field level validation, ensuring each configuration is populated correctly, and image formatting allowing configuration groupings from the visual interface. Now we also support toggling between visual pipelines and YAML editing.

Next, I'm going to pass it off to our director of product, Zach Quiring, to show you these changes in more detail.

Today, I'll be walking through a few new feature releases and product updates from the last few weeks. The first update is support for integrations within the pipeline, essentially for the output section. There are different types of destinations such as archive, streaming, and others. Support for integrations means any integration you've created in the integration portal can now be pulled directly into the pipeline. A use case might be, for instance, if you want to forward a subset of data to Splunk temporarily. When it opens, you'll see the definition and value for that integration. You can either use it as is or tweak the integration settings. In this case, for the index, the data is set to raw, but you might want to update that for specific use cases.

Now, I've played around with this node, and I might want to test if it does what I expect. The test shows the incoming and outgoing data items, and the default paths have the tags we added, like environment and region. There are also updates like in-line validation to highlight any mistakes or unpopulated fields. Another update is the ability to toggle between form view or editor view, allowing interaction with the generated YAML configurations.

To recap, we've added our Splunk raw logs output integration, a filter for forwarding errors, and an enrichment tags processor node. Once everything looks good, we can deploy our changes. I hope you find these updates beneficial. Stay tuned for more exciting things down the pipeline. Thanks a lot.


Now let's talk about our updates to the log search and analytics product. We launched our log search capability last fall as part of the Edge Delta free release. Over the past several weeks, our engineering team has enhanced the user experience. New features include saved searches at user and organizational levels, search history to save recent queries, view in context for troubleshooting, AI-based filters for precise search results, an improved facets UI, and the option to customize row density for a better viewing experience. Check out the blog post in the description of this video for more information.

That's it for this update. I'll check back in a few weeks to discuss our other new additions. Thanks for watching.