AWS SNS data ingestion

Open in ChatGPTOpen in Claude

Amazon SNS fans messages out to distributed systems over SMS, email, HTTP endpoints, and mobile push. Subscribing Coralogix to a topic gives you a record of what was broadcast and when, so notification events can be searched and alerted on alongside the systems that produced them.

The Contextual Data integration generates the HTTPS endpoint; SNS delivers to it.

What you need

• An AWS account with an SNS topic you want to forward.
• A Coralogix API key. You can create one during setup.
• An application and subsystem name to file the messages under.

Generate the endpoint in Coralogix

1.

Open the AWS SNS integration

Select Data Flow, then Contextual Data, then AWS SNS, then Add, then Add new.

2.

Enter the integration details

Enter a Name. Supply Your API Key or select Create new key. Enter an App Name and Subsystem Name.

3.

Generate the URL

Select Generate URL and copy the result.

Shows the form that produces the HTTPS endpoint SNS delivers to.

Subscribe the endpoint in AWS

4.

Create a subscription

In the AWS console, open the topic you want to forward and create a subscription.

5.

Fill in the details

Set Topic ARN to the topic's ARN, Protocol to HTTPS, and Endpoint to the URL Coralogix generated. Select Create subscription.

Shows the three fields that bind the topic to your Coralogix endpoint.

Note

AWS requires the subscription to be confirmed after it is created. Until then, nothing is delivered. See getting started with SNS.

Example log

{
  "source_system": "awssns",
  "awssns": {
    "MessageId": "ab11a2b6-2b53-53b3-af61-fa1b95c7a52a",
    "TopicArn": "arn:aws:sns:eu-central-1:1234567890:coralogix-integration",
    "Subject": "Backend error",
    "Message": {
      "customeAlert": "Too many connections!"
    },
    "Timestamp": "2021-02-22T14:14:44.582Z",
    "SignatureVersion": "1",
    "Signature": "ioQos7NF5tDSLvUBKOBJjsi8VyMA4RWksfNV4K++mr5sOqv/4jUGSo8RRpCgE+du2NX07oq5j5tOHV/E02YDklOSZTzPHiR9fSNdV3wip4kZIEh+/CJfQIuHpLkJpFysw/Gkwxd4LDhDax+Fi1YmiFd2FaYKwgk9c2MJEarnUtAr5j7Nj/H32K4qU3F8Er+8efJ+nh+3EEAM9JnMPHCd7ryMtxoOQGv73pyROkMI+F28cx5v7lOxHQb0AqlO8uzCSksa2HByRgeTVS2akHO6tIBMJ5LoqaoBCwWmjhT8XWYODyMGGcdXiIFZdRA/mKrjZfcsCwqaVKjSnDpFZC1Rgw==",
    "SigningCertURL": "https://sns.eu-central-1.amazonaws.com/SimpleNotificationService-010a507c1833636cd94bdb98bd911111.pem",
    "UnsubscribeURL": "https://sns.eu-central-1.amazonaws.com/?Action=Unsubscribe&SubscriptionArn=arn:aws:sns:eu-central-1:1234567890:coralogix-integration:12345678990"
  }
}

Related resources

Application and subsystem namesCloudTrail collection via SNS triggerGeneric incoming webhooks