求大侠帮忙（文本处理问题）

zhuyongxin

各位大侠好：
      我有一个文本文件，和下面的一样，每1行分成3个部分，第一部分是时间，第二部分是报警代码，第三部分是报警内容，每一行的报警代码和报警内容一一对应。
2008-12-17 14:50        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:48        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:46        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:44        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:41        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:40        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:39        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:30        2006036        LD200-6036  Loader frame pusher forward error.
2008-12-17 14:16        2006006        LD200-6006  Loader elevator up/down interlock.
2008-12-17 14:16        2006006        LD200-6006  Loader elevator up/down interlock.
2008-12-17 14:15        2006013        LD200-6013  Loader switch ON.
2008-12-17 14:12        2006013        LD200-6013  Loader switch ON.
2008-12-17 14:12        4006091        FEE00-6091  No work on 1st gripper
2008-12-17 14:10        13006001        AGR00-6001 Island position recognition error.
2008-12-17 14:07        13006001        AGR00-6001 Island position recognition error.
2008-12-17 13:52        13006001        AGR00-6001 Island position recognition error.
2008-12-17 12:37        9006055        ULD00-6055  Work request signal off error(back-end).
2008-12-17 12:32        9006055        ULD00-6055  Work request signal off error(back-end).
2008-12-17 12:16        6006002        PRF00-6002  Preform already done for work at preform position.
2008-12-17 12:12        13006001        AGR00-6001 Island position recognition error.
2008-12-17 11:00        4006001        FEE00-6001  Work align error
2008-12-17 09:56        31006065        WFT00-6065  Vacuum stage limit sensor wiring cut-off (open circuit).
2008-12-17 04:10        4006003        FEE00-6003  Work edge detection error
2008-12-17 04:10        4006227        FEE00-6227  Work drawing miss error
2008-12-17 04:09        4006003        FEE00-6003  Work edge detection error
2008-12-17 04:08        4006003        FEE00-6003  Work edge detection error
2008-12-17 04:07        4006003        FEE00-6003  Work edge detection error
2008-12-17 04:02        4006227        FEE00-6227  Work drawing miss error
2008-12-17 04:01        4006003        FEE00-6003  Work edge detection error
2008-12-17 04:00        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:59        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:59        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:58        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:56        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:54        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:54        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:53        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:52        4006004        FEE00-6004  Work edge detection sensor ON
2008-12-17 03:52        4006003        FEE00-6003  Work edge detection error
2008-12-17 03:50        4006003        FEE00-6003  Work edge detection error
      如果上下相邻行报警内容相同，则把下一行删除，也就是要把红色字体部分删除，这个怎么做啊？

savagejin

1. 
   
2. #!/bin/bash
   
3. awk '
   
4. BEGIN { ID=0 }
   
5. {
   
6.     if (ID != $3) {
   
7.         ID=$3
   
8.         printf "%s\n", $0
   
9.     }
   
10. } ' "$*"
    

复制代码

这样大概就可以了吧

savagejin

发现这样也可以

1. 
   
2. uniq --skip-chars=17 inputfile outputfile
   

复制代码

zhuyongxin

谢谢大侠的指点，问题解决了！

ServerOnly

uniq -f 2 filename