Our next-gen architecture is built to help you make sense of your ever-growing data Watch a 4-min demo video!

Start Free Trial Request Demo
Back to All Integrations

AWS S3 Log Collection AWS S3 Log Collection

Last Updated: May. 22, 2023

One of the easiest ways to collect logs is to send all of them to S3 buckets.
To make the log collection a breeze, use our app in the AWS Serverless Application Repository.

Requirements

  • You need to have a ready-made S3 bucket.
  • The bucket should be clear of any Lambda triggers.
  • Your AWS user should have permissions to create lambdas and IAM roles.

Installation

  • Navigate to: Application Page
  • Fill in the required parameters
  • be sure to check the checkbox labeled as
    I acknowledge that this app creates custom IAM roles and resource policies.
  • Click Deploy

Once the deployment is done every new gzipped log file placed in the lambda will be sent to Coralogix

Parameters and Descriptions

VariableDescription
Application NameStack name of the application created via AWS CloudFormation.
If your log is JSON format, use its dynamic value.
Example: $.level1.level2.value
NotificationEmailFailure notification email address
S3BucketNameName of the S3 bucket to watch
ApplicationNameApplication name as it appears in your Coralogix UI
BlockingPatternIf you wish to block some of the logs adding a substring will act as selector.
Default is empty to send all logs.
BufferSizeBuffer size for logs in the lambda function
CoralogixRegionRegion [Europe, Europe2, India, Singapore, or US] associated with your Coralogix account domain.
DebugCoralogix logger debug mode
FunctionArchitectureFunction supports x86_64 or arm64
FunctionMemorySizeMax memory for the function itself
FunctionTimeoutMaximum time in seconds the function may be allowed to run
NewlinePatternPattern for lines splitting. Default is (?:\r\n|\r|\n).
S3BucketNameName of the S3 bucket to watch
S3KeyPrefixThe S3 path prefix to watch, if you want to watch a particular subfolder within the bucket
S3KeySuffixS3 path suffix to watch
SamplingRateSets the sampling rate
SsmEnabledTrue if you want to store your coralogix private_key as a secret and False if you do not
SubsystemNameSubsystem name as it appears in your Coralogix UI. If your log is JSON format, can use its dynamic value, for example: $.level1.level2.value.
CustomDomainCoralogix custom domain. Leave empty if you do not use a custom domain.
PrivateKeyYour Coralogix ‘Send Your Data’ API Key
LayerARNYour Coralogix SSM Layer ARN

Support

Need help?

Our world-class customer success team is available 24/7 to walk you through your setup and answer any questions that may come up.

Feel free to reach out to us via our in-app chat or by sending us an email at [email protected].

On this page