Load CSV into Redshift, with header?

csv amazon-web-services amazon-redshift etl
Some Guy picture Some Guy · Mar 1, 2015 · Viewed 22.3k times · Source

Is there an option to load a CSV into Redshift with a header? I see the documentation for CSV but it says nothing about a header. Ideally it could use the header to determine the columns to load.

Answer

John Rotenstein picture John Rotenstein · Mar 1, 2015

Use the IGNOREHEADER 1 option when using the COPY command:

IGNOREHEADER [ AS ] number_rows

Treats the specified number_rows as a file header and does not load them. Use IGNOREHEADER to skip file headers in all files in a parallel load.

See: Amazon Redshift COPY command documentation

Related questions

Amazon Redshift - COPY from CSV - single Double Quote in row - Invalid quote formatting for CSV Error

I'm loading a CSV file from S3 into Redshift. This CSV file is analytics data which contains the PageUrl (which may contain user search info inside a query string for example). It chokes on rows where there is a single, …

Read More
Hadoop/Hive : Loading data from .csv on a local machine

As this is coming from a newbie... I had Hadoop and Hive set up for me, so I can run Hive queries on my computer accessing data on AWS cluster. Can I run Hive queries with .csv data stored on …

Read More
How can I import bulk data from a CSV file into DynamoDB?

I am trying to import a CSV file data into AWS DynamoDB. Here's what my CSV file looks like: first_name last_name sri ram Rahul Dravid JetPay Underwriter Anil Kumar Gurram

Read More