I came across this CSV splitter using a simple Google search: csv-splitter-1.1.zip (.
The download works great, and I am able to split a large text file containing a large date range of symbol data (i.e., 2009- 2012 ES NT7 compatible tick import file).
The problem is that the max number of lines the splitter is able to make the split files is 10,000,000--which ends up limiting the split files to about 245 MB, which is pretty small when one is looking to split a 10 GB data file (i.e., about 41 split files).
The original creator of this file also includes in the source code in the .zip download, and I was able to get it to open, but when I changed the max lines from 10,000,000 to 500,000,000 (which would be a more robust max, which would allow me to split the 10 GB file into ~2 GB files), I get some sort of compile error.
The challenge is that I have no freaking idea what I am doing, and as such I'm likely going about the edit process wrong.
Therefore, would someone be willing to open up the source code and change the max number of lines variable from 10,000,000 to 500,000,000 and post it back up? I'll then post it in the downloads area for all members to use--obviously giving credit to the futures.io (formerly BMT) user that is able to help me with this small programming change.
Here is a screen capture of the files that are included in the source code:
136765
So from this we can see that it looks like it's a Visual Basic code, which I have no idea how to change or modify.
As a heads up, I have used this tool to split a large CL tick file that Big Mike had uploaded to the historical CL tick and minute thread, after which I posted the split files for other futures.io (formerly BMT) users to download--and several have. My goal is to use this modified tool to upload more split files for other instruments on their respective historical data threads (i.e., ES, 6E, etc) for other futures.io (formerly BMT) users to use.
Thank you in advance for your help--and please let me know if you have any questions.