Import-CSV Taking Forever Powershell

Question

I am trying to import-csv of a file that is 3GB and store it in a variable and then run a script based on all that data. I need all the information in the file. The import command is taking hours though to import the data. Is there a faster way to accomplish this?

Thanks

Answer 1

Look into System.IO.StreamReader and System.IO.File. When I had to process a large - tens or hundreds of thousands of lines - CSV file, that was the only way I could do it with any efficiency.

Here's an example.

$FileReader = [System.IO.File]::OpenText($FileName)
While ($FileLine = $FileReader.ReadLine())
{
    # Do Things with $FileLine
}
$FileReader.Close()