Stream logs to Oracle Cloud

DataStream 2 supports sending logs to Oracle Cloud Storage using Oracle Cloud’s S3-compatible API connectivity option to store data. It uploads log data as gzip-compressed files.

For security reasons, DataStream 2 sends logs over TLS even if the endpoint’s policies allow insecure requests.

Before you begin

Before you use Oracle Cloud Storage as a destination for your stream, you need to:

  • Sign in to Oracle Cloud Storage and make sure you have created an Amazon S3-compatible compartment for the bucket. See Designing compartments for S3 compatibility in the Oracle Cloud documentation.
  • Create an Oracle Cloud bucket. See Create an Object Storage Bucket in the Oracle Cloud documentation.
  • Create an Oracle customer secret key, which consists of the access and secret key in the Identity & Security tab of your Oracle Cloud account. See Managing User Credentials in Oracle Cloud.
    Find and save the namespace identifier assigned to your bucket in the Bucket Information tab on the Oracle Cloud bucket page.

How to

  1. In Destination, select Oracle Cloud Storage.

  2. In Display name, enter a human-readable name description for the destination.

  3. In Bucket, enter the name of the bucket you created in Oracle Cloud to send logs to. You need to have READ and WRITE access to the bucket.

  4. In Path, enter the path to the folder where you want to store logs. You can use Dynamic variables in folder paths for timestamps, stream ID, and stream version.

  5. In Region, enter the code of the cloud region where your bucket resides in lowercase.

  6. In Access key, enter the access key identifier associated with your Oracle Cloud account.

  7. In Secret key, enter the secret key associated with your Oracle Cloud account.

  8. Optionally, in the Delivery options menu, edit the Filename field to change the prefix and suffix for your log files. File name prefixes support Dynamic time variables.

  9. Optionally, change the Push frequency to receive bundled logs to your destination every 30 or 60 seconds.

  10. Click Next.