Our next-gen architecture is built to help you make sense of your ever-growing data Watch a 4-min demo video!

Back to All Docs

TCO Optimizer TCO Optimizer

Last Updated: Feb. 20, 2023

Coralogix TCO not only reduces your logging costs by up to two-thirds but also improves your ability to query, monitor, and manage your data, by allowing you to define the data pipeline your logs will go through, based on the importance of data to your business.

This enables you to get all of the benefits of an ML-powered logging solution at only a third of the cost and with more real-time analysis and alerting capabilities than before.

The TCO Optimizer allows you to assign different logging pipelines for each application/subsystem pair and log severity, giving you maximum control over your data.

TCO Data Pipelines

Compliance Data (Low)

Log data that needs to be kept for compliance/post-processing reasons will go straight to your archive.

Monitoring Data (Medium)

Logs that are used for monitoring or statistics will be fully available for those use cases by allowing you to define alerts, build dashboards, view statistics, query the live data stream, and receive proactive anomalies.

Frequent Search Data (High)

These logs need to be individually queried and analyzed. Typically high severity, or business-critical data will be stored on highly available SSDs replicated, and ready to be queried within seconds.

TCO Optimizer Screen

The TCO Optimizer screen includes three sections:

  • Log’s distribution that shows the % of logs for each TCO pipeline, ‘Frequent search’, ‘Monitoring’, and ‘Compliance’ (compliance includes low and blocked logs).
    Coralogix TCO Optimizer
  • Policy criteria includes current policies and allows for the creation of new ones. Policies will be applied on combinations of applications/subsystems/severities as the logs are ingested and will assign them the appropriate TCO pipeline based on the policy content. The default policy for all logs is high. Policies simplify assigning TCO pipelines and will capture any applicable future logs on ingestion.
    TCO Policy criteria
    Each policy creates new default values for the logs the policy is applicable for. If Policies conflict, the first policy will have precedence (in the order they appear on the screen).

     

    TCO Optimizer create new policy

    To create a new policy click the “ADD NEW POLICY” button, choose the relevant filters for applications/subsystems/severities combinations and set the desired TCO pipeline. These will become the default TCO pipelines assignments for all matching logs that will be ingested into Coralogix.

  • ‘Application and policy overrides’ section displays the usage of all applications and subsystems, sorted by the top consumers. You may use the top filters to easily locate a specific component.
    TCO Policy override
    Clicking on any row will allow you to see a detailed view of the application-subsystem pair usage broken by level of severity and its default TCO pipelines assignments as created initially.

    In this view, you are able to change the priority for an entire application-subsystem pair (1) or to change the priority for specific severities within any application-subsystem pair (2). The priority will determine the data pipeline the logs of this subsystem will go through. In case there are different TCO pipelines for different severities the main priority will be Multiple.
TCO Tune Severity


Note: If you would like to start overriding from the beginning, you can remove all overrides by clicking on the “Reset All Overrides” button.

TCO - Reset all overrides

On this page