counting duplicate

I need an algorithm in C that can work with huge files and still be time efficient. (That's my number one concern!) The program need to be able to partition the processes on 4 different processors. Here is a scoope of what the program does. I will sent more detail when I accept the bid. Algorithm: 1) read from a file, the file is in the following format, but the length of pattern will vary from 2-certain number user specifies (most likely within the range of 2-40): 2) ACAGGCAA 1 GCAGGCAA 2 TCAGGCAA 3 CCAGGCAA 4 3) replace the letter in col 1 with N, so: NCAGGCAA 1 NCAGGCAA 2 NCAGGCAA 3 NCAGGCAA 4 4) count the duplicates and add their frequencies at the end together. 5) Save the result in a different file, the result will appear as: NCAGGCA 10 6) repeat the above steps for col 2-8. 7) Then replace letters in col 1&2 with N: NNAGGCAA 1 NNAGGCAA 2 NNAGGCAA 3 NNAGGCAA 4 8) count the duplicates and add their frequencies at the end together. 9) do this for col 2&3, 3&4, 4&5, 5&6, 6&7,7&8 10)then repeat with 3 N, 4N up to 7N. 11) The last replacement will look like this: NNNNNNNA 1 NNNNNNNA 2 NNNNNNNA 3 NNNNNNNA 4 Please feel free to email me if you have any questions. I needed it by Nov 29,2002 ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Installation package that will install the software (in ready-to-run condition) on the platform(s) specified in this bid request. 3) Complete ownership and distribution copyrights to all work purchased. ## Platform unix solaris