Text deduplication algorithm problem ~~ Please give pointers

yunshenxin

Is it something wrong with my DELPHI

supperman

No problem. Tested many times

yunshenxin

TmpStrings.Assign (TStrings (StringsList.Items [Pred (StringsList.Count)]));
Run here and it appears

supperman

You recreate a text file and copy your text back into the new text file. Your problem is that you have a blank line with a carriage return in your original text file

yunshenxin

OK, 3Q

supperman

I modified the algorithm a bit:

..........
// Write data to List
    StringsList: = TList.Create;
    for Idx: = 0 to Pred (Memo.Lines.Count) do
    begin
      if Pos (',', Memo.Lines [Idx])> 0 then // Remove empty lines
      begin
        Strings: = TStringList.Create;
        Strings.Delimiter: = ',';
        Strings.DelimitedText: = Memo.Lines [Idx];
        StringsList.Add (Pointer (Strings));
      end;
    end;

.............

supperman

The more rigorous algorithm should be like this:

// Write data to List
    StringsList: = TList.Create;
    for Idx: = 0 to Pred (Memo.Lines.Count) do
    begin
      Strings: = TStringList.Create;
      Strings.Delimiter: = ',';
      Strings.DelimitedText: = Memo.Lines [Idx];
      if Strings.Count = 5 then // Only process rows with 5 columns
        StringsList.Add (Pointer (Strings));
    end;

yunshenxin

You are really good ~~ The algorithm thinks so flexible ~ Thanks