Read Big TXT File, Out of Memory Exception
.net, .net-4.0, c#, exception, out-of-memory
Solution
Just use File.ReadLines which returns an `IEnumerable<string>` and doesn't load all the lines at once to the memory.
foreach (var line in File.ReadLines(_filePath))
{
//Don't put "line" into a list or collection.
//Just make your processing on it.
}
Problem
I want to read big TXT file size is 500 MB, First I use ``` var file = new StreamReader(_filePath).ReadToEnd(); var lines = file.Split(new[] { '\n' }); ``` but it throw out of memory Exception then I tried to read line by line but again after reading around 1.5 million lines it throw out of memory Exception ``` using (StreamReader r = new StreamReader(_filePath)) { while ((line = r.ReadLine()) != null) _lines.Add(line); } ``` or I used ``` foreach (var l in File.ReadLines(_filePath)) { _lines.Add(l); } ``` but Again I received An exception of type 'System.OutOfMemoryException' occurred in mscorlib.dll but was not handled in user code My Machine is powerful machine with 8GB of ram so it shouldn't be my machine problem. p.s: I tried to open this file in NotePadd++ and I received 'the file is too big to be opened' exception.