when unloading a table from amazon redshift to s3, how do I make it generate only one file
amazon-redshift, amazon-s3
Solution
Amazon recently added support for unloading to a single file by using PARALLEL OFF in the UNLOAD statement. Note that you still can end up with more than one file if it is bigger than 6.2GB.
Problem
When I unload a table from amazon redshift to S3, it always splits the table into two parts no matter how small the table. I have read the redshift documentation regarding unloading, but no answers other than it says sometimes it splits the table (I've never seen it not do that). I have two questions: Has anybody every seen a case where only one file is created? Is there a way to force redshift to unload into a single file?