Top "Large-files" questions

Large files, whether binary or text, can sometimes be problematic even for an experienced programmer.

Reading Huge File in Python

I have a 384MB text file with 50 million lines. Each line contains 2 space-separated integers: a key and a value. The …

python performance file-io large-files
Get Large File Size in C

Before anyone complains of "duplicate", I've been checking SO quite thoroughly, but there seem to be no clean answer yet, …

c file large-files filesize
ERROR: could not stat file "XX.csv": Unknown error

I run this command: COPY XXX FROM 'D:/XXX.csv' WITH (FORMAT CSV, HEADER TRUE, NULL 'NULL') In Windows 7, it …

postgresql large-files postgresql-copy
Nodejs Read very large file(~10GB), Process line by line then write to other file

I have a 10 GB log file in a particular format, I want to process this file line by line and …

node.js file-io large-files file-handling file-processing
Nuking huge file in svn repository

As the local subversion czar i explain to everyone to keep only source code and non-huge text files in the …

svn large-files
How can I process a large file via CSVParser?

I have a large .csv file (about 300 MB), which is read from a remote host, and parsed into a target …

java csv filtering large-files apache-commons-csv
Charting massive amounts of data

We are currently using ZedGraph to draw a line chart of some data. The input data comes from a file …

c# .net charts large-files zedgraph
Computing MD5SUM of large files in C#

I am using following code to compute MD5SUM of a file - byte[] b = System.IO.File.ReadAllBytes(file); …

c# md5 hash large-files
Can someone provide an example of seeking, reading, and writing a >4GB file using boost iostreams

I have read that boost iostreams supposedly supports 64 bit access to large files semi-portable way. Their FAQ mentions 64 bit offset …

c++ large-files boost-iostreams
Does fread fail for large files?

I have to analyze a 16 GB file. I am reading through the file sequentially using fread() and fseek(). Is it …

c large-files fread