DataStream 2 is a robust tool for monitoring the performance of your properties on the ​Akamai​ Intelligent Edge Platform.

You can gather low-latency raw data for insight into traffic analysis, security, and CDN health. Here you'll find the most typical reasons to use DataStream 2 and its practical applications.

How does DataStream work?

Let's have a look at how DataStream 2 works:

1. Configure DataStream using the DataStream 2^{(login required)} application in the ​Akamai​ Control Center or the DataStream API.

2. DataStream is activated on ​Akamai​'s log processing infrastructure and is ready to gather log data.

3. DataStream monitors the activity on your property on the edge. You can configure it for properties with other products listed in Product integration.

4. The stream logs client requests and responses at the edge.

5. DataStream sends logs from the edge to ​Akamai​'s distributed data collection and processing systems.

6. The stream uploads logs to the endpoint of your choice within minutes of activity on the ​edge network.

7. Retrieve, store and analyze raw log data uploaded to the destination.

You can combine DataStream 2 with other ​Akamai​ products and third-party applications to reach its full potential, including when setting up or transitioning to the cloud:

In this example, you can configure DataStream 2 along Edge Diagnostics and Reporting (in Step 3) for critical visibility into your end user’s experience and ​Akamai​ infrastructure at the edge with real-time reports, alerts, and log data.

For other workflow examples, see Reference Architectures for DataStream.

📘

Third-party integration

DataStream 2 is optimized for high-volume raw data delivery, and we recommend using log data for basic traffic analytics and monitoring CDN health.

In case of latency or connection problems involving third-party destinations, DataStream 2 attempts to deliver log data in up to 10 retries over 5 minutes. For details, see the Delivery retry feature. You can create backup streams or Set up alerts to prevent data loss.

You should take these limitations into account before using data served on your stream for audit, compliance, or billing purposes.

Now, let's go over the list of practical applications of DataStream 2:

Low latency data

Get raw log data within minutes of activity on the ​Akamai​ edge network. You can configure your streams to bundle and upload raw logs as often as every 30 seconds. Measure the success of your new cloud, code or CDN configuration in near real-time without risking downtime or end-user experience. Check on cloud and CDN health, efficiency, and usage after rolling out new features.

Insights and trends

Leverage log data analysis for long-term trends and valuable insights for your business, based on performance and traffic metrics. You can integrate CDN access and traffic data data with third-party analytics tools to make critical decisions more data-driven.

Troubleshooting and diagnostics

Use DataStream 2 to proactively monitor performance, spot and quickly resolve issues such as traffic degradations, bottlenecks, and potentially malicious traffic. Keep track of traffic split based on real-time performance and availability metrics.

Event monitoring

DataStream is optimized for high-throughput raw data delivery that you can leverage to proactively monitor large-scale, live events, and media streaming.

Product integration

Integrate DataStream 2 with a line of ​Akamai​ products (including Adaptive Media Delivery, API Acceleration, ChinaCDN, Download Delivery, Dynamic Site Accelerator, Dynamic Site Delivery, EdgeWorkers, HTTPS Download, Ion Standard and Premier, Progressive Media Downloads, Rich Media Accelerator, Object Delivery, and Web Application Accelerator).

You can configure DataStream 2 with third-party applications supporting log delivery, storage and analytics, such as AWS S3, Microsoft Azure Blob, Splunk, and Datadog, called destinations. For additional and customizable features supported by each destination, see Stream logs to a destination.

Features

Check the list of useful features that DataStream offers to effectively gather and stream data in Supported features.