C: Process billions strings in chunks.

Job Description:

I need to create script described below in the best way with C.

1. Read input file with strings (up to 10 billion strings) line by line into memory (Yes, I'm pretty sure. I have enough memory). Let assume each input string length has 128 bytes.

2. Create array of strings.

3. Chunk previously created array into chunks with the specific length. Chunk length is 9216 strings.

4. Pass chunk into function.

5. Wait when function finished and pass other chunk.

6. Finish process.

That's it. =)

Taidot: C-ohjelmointi, Tietojärjestelmäarkkitehtuuri

Projektin tunnus: #34465474