Our next-gen architecture is built to help you make sense of your ever-growing data Watch a 4-min demo video!

Back to All Integrations

Amazon Web Services (AWS) S3 Log Collection via SNS Trigger Amazon Web Services (AWS) S3 Log Collection via SNS Trigger

Last Updated: Mar. 04, 2023

Like our S3 Log collection integration, this integration will process logs from you S3 buckets, but is triggered by an SNS notification. For easy setup, use our app in the AWS Serverless Application Repository.

Prerequisites

  • Ready-made SNS Topic
  • Ready-made S3 bucket with configured Event Notifications to above SNS Topic
  • AWS permissions to create Lambdas and IAM roles

Installation

STEP 1. Navigate to Application Page and search for Coralogix-S3-via-SNS.

STEP 2. Fill in the required parameters.

STEP 3. Click Deploy.

Parameters and Descriptions

VariableDescription
Application NameStack name of this application created via AWS CloudFormation. If your log is JSON format, can use a dynamic value from it.
Example:$.level1.level2.value
NotificationEmailFailure notification email address
S3BucketNameName of the S3 bucket
SNSTopicArnARN of SNS topic to subscribe
ApplicationNameCoralogix application name
BlockingPatternIf you wish to block some of the logs, adding a substring will act as selector. Default is empty to send all logs.
BufferSizeBuffer size for logs in the lambda function
CoralogixRegionCoralogix region associated with your Coralogix domain
DebugCoralogix logger debug mode
FunctionArchitectureFunction supports x86_64 or arm64
FunctionMemorySizeMax memory for the function itself
FunctionTimeoutFunction TimeOut
NewlinePatternPattern for multiline example: [\s(?={)
PrivateKeyCoralogix private key
SamplingRateSets the sampling rate
SubsystemNameCoralogix subsystem name
If your log is in JSON format, you may use a dynamic value from it. Example:$.level1.level2.value
S3KeyPrefixS3 path prefix to watch if you want to watch a particular subfolder within the bucket

Note:

  • To perform filtering based on prefix or suffix of the S3 object, filters need to be placed on the S3 bucket’s Event Notification. Documentation for this process can be found here.

Support

Need help?

Our world-class customer success team is available 24/7 to walk you through your setup and answer any questions that may come up.

Feel free to reach out to us via our in-app chat or by sending us an email at [email protected].

On this page