AWS CloudWatch Logs Insights - export full query result?

amazon-web-services aws-cloudwatch-log-insights
lznt picture lznt · Aug 8, 2019 · Viewed 10.9k times · Source

I have a CloudWatch Logs Insights query, which shows "7000 records matched", but when I try Actions -> Download query results (CSV), only 1000 records are exported (same as shown in the console). I cannot find any way to export the "full" query results. Am I missing anything?

Answer

lznt picture lznt · Aug 9, 2019

Adding

| limit 7000

to the end of the query fixed the issue

The max is 10000 according to https://docs.aws.amazon.com/AmazonCloudWatchLogs/latest/APIReference/API_StartQuery.html#API_StartQuery_RequestSyntax, so if my query has more than 10000 records, there seems to be no way to get the complete data.

Related questions

How to query distinct from AWS log insights

I need to query data from lambda using AWS Cloudwatch log insights. The query syntax provide by aws doesn't have distinct. Only support (count_distinct(fieldname)) ref. https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_QuerySyntax.html Example data …

Read More
CloudWatch Insights Query - How to get a single count from counts

I have a log file which contains playerId values, some players have multiple entries in the file. I want to get an exact distinct count of to unique players, regardless of if they have 1 or multiple entries in the log …

Read More
Filter by timestamp query on AWS Cloudwatch Logs Insights

I am trying to use AWS Cloudwatch Logs insights in order to search in some quite old logs of our lambda functions. I am reading this guide on AWS docs, but nowhere is documented how you can filter by timestamp. …

Read More