Loggregation: Making Big Data Small

In this post, you will learn how to make the most of Coralogix’s very own automatic log clustering feature: Loggregation©.

Loggregation is an algorithm that condenses millions of log entries into a narrow set of patterns. It does so by automatically analyzing each log record sent to Coralogix, then separating the log constants from its variables.

Let’s have a look.

1) Below you can see, ~12.6M log entries from a certain query:

coralogix loggregation all logs

2) Within seconds of clicking Loggregation, the 12.6M logs become grouped into their original patterns, thereby dramatically reducing the number of entries.

coralogix loggregation clicking loggregation

As you can see below, we went from 12.6M entries to only 710 templates. There is also a display of how many times each pattern arrived, the ratio of each pattern, and a full visualization of all parameters. This serves as a major timesaver in terms of log analysis.

3) Have JSON format log data? no problem! Coralogix clusters your JSON’s into their unique appearances while allowing you to graphically view the different values including an automatic text clustering. 

coralogix JSON loggregation / clustering

4) For further analysis, you can click on any of the variables and immediately display a graph with relevant information.

5) To further drill into a template, hover it and click the magnifying glass icon to the right side of it. 

loggregation drill down

In addition, clicking the pin icon at the top right corner of each visualization allows you to send that graph directly to your dashboard or Tags view in seconds.

That is it! Now you know how you can a full day’s worth of data in a matter of minutes, including deep analyses of distributions and variables. Save time and resources with Coralogix!

Start solving your production issues faster

Let's talk about how Coralogix can help you

Managed, scaled, and compliant monitoring, built for CI/CD

Get a demo

No credit card required

© 2021 Copyright Coralogix. All rights reserved.

Get a personalized demo

Jump on a call with one of our experts and get a live personalized demonstration