Most observability vendors use a “centralize-then-analyze” approach. In other words, your data must be centralized in their platform before users can search or run analytics on it.
This approach worked well before the rise of cloud and microservices. However, log data has multiplied 5x over the past three years. This creates challenges, such as:
High Costs:Â Observability platforms are becoming prohibitively expensive. A simple mistake, like leaving debug logs on, can cause a massive overage.
Limited Visibility:Â Teams must neglect large portions of data to contain costs.
Poor Performance:Â As datasets continue to grow, it becomes increasingly difficult to support real-time analytics.