What is difference between s3 select and athena

amazon-web-services amazon-s3 amazon-athena amazon-s3-select
user3444718 picture user3444718 · Mar 5, 2018 · Viewed 19.3k times · Source

I am trying to understand what is difference between aws athena service and newly released s3 select (still in preview). And how usecases different for both of those? It seems both helps in selecting partial data from s3.

Answer

Sayat Satybald picture Sayat Satybald · Apr 22, 2018

You can think about AWS S3 Select as a cost-efficient storage optimization that allows retrieving data that matches the predicate in S3 and glacier aka push down filtering.

AWS Athena is fully managed analytical service that allows running arbitrary ANSI SQL compliant queries - group by, having, window and geo functions, SQL DDL and DML.

Related questions

How to get input file name as column in AWS Athena external tables

I have external tables created in AWS Athena to query S3 data, however, the location path has 1000+ files. So I need the corresponding filename of the record to be displayed as a column in the table. select file_name , col1 …

Read More
How to make MSCK REPAIR TABLE execute automatically in AWS Athena

I have a Spark batch job which is executed hourly. Each run generates and stores new data in S3 with the directory naming pattern DATA/YEAR=?/MONTH=?/DATE=?/datafile. After uploading the data to S3, I want to investigate it …

Read More
Amazon Athena - Column cannot be resolved on basic SQL WHERE query

I am currently evaluating Amazon Athena and Amazon S3. I have created a database (testdb) with one table (awsevaluationtable). The table has two columns, x (bigint) and y (bigint). When I run: SELECT * FROM testdb."awsevaluationtable" I get all of …

Read More