Log Analytics 2019 - Coralogix partners with IDC Research to uncover the latest requirements by leading companies

FREE REPORT

INTEGRATIONS

S3 Log Collection

Description

S3 to Coralogix lambda allows you to send your logs from your S3 bucket to Coralogix.

Usage

Make sure you add the following environment variables when using this lambda.

NameDescription
private_keyA private key which is used to validate your authenticity, this key will be sent to your mail once you register to Coralogix and should not be transferred outside your company
app_nameThe name of your main application, for example, a company named “SuperData” would probably insert the “SuperData” string parameter or if they want to debug their test environment they might insert the “SuperData– Test”
sub_nameYour application probably has multiple subsystems, for example, Backend servers, Middleware, Frontend servers etc. in order to help you examine the data you need, inserting the subsystem parameter is vital

1. Create an “author from scratch” Node.js 8.10 runtime lambda with an S3 read permissions 

logs from S3 to Coralogix

2. At “Code entry type” choose “Upload a ZIP file” and upload “s3ToCoralogix.zip”

https://s3-eu-west-1.amazonaws.com/coralogix-public/tools/s3ToCoralogix.zip

coralogix S3 logs

3. Add the mandatory environment variables: private_key, app_name, sub_name

env vars for coralogix S3 lambda

4. Choose the S3 bucket you want to get triggered by and change the event type from “PUT” to “Object Created(All)”

S3 bucket for coralogix

5. Multiline pattern: Coralogix supports multiline pattern by default, you can define a custom pattern with an environment variables, for example: newline_pattern [\s(?={)|(?<=})\s,\s(?={)|(?<=})\s\]. 

custom multiline in S3

6. Click ‘Save’

Your all set! data would be streaming to Coralogix, need help? ping us on our in-app chat for tech support. 

Start solving your production issues faster

Let's talk about how Coralogix can help you better understand your logs

No credit card required