How to extract data from html table in shell script?

Question

I am trying to create a BASH script what would extract the data from HTML table. Below is the example of table from where I need to extract data: ```

Component	Status	Time / Error
SAVE_DOCUMENT	OK	0.406 s
GET_DOCUMENT	OK	0.332 s
DVK_SEND	OK	0.001 s
DVK_RECEIVE	OK	0.001 s
GET_USER_INFO	OK	0.143 s
NOTIFICATIONS	OK	0.001 s
ERROR_LOG	OK	0.001 s
SUMMARY_STATUS	OK	0.888 s

``` And I want the BASH script to output it like so: ``` SAVE_DOCUMENT OK 0.475 s GET_DOCUMENT OK 0.345 s DVK_SEND OK 0.002 s DVK_RECEIVE OK 0.001 s GET_USER_INFO OK 4.465 s NOTIFICATIONS OK 0.001 s ERROR_LOG OK 0.002 s SUMMARY_STATUS OK 5.294 s ``` How to do it? So far I…

Accepted Answer

Go with `(g)awk`, it's capable :-), here is a solution, but please note: it's only working with the exact html table format you had posted. ``` awk -F "|" '/<\/*t[rd]>.*[A-Z][A-Z]/ {print $3, $5, $7 }' FILE ``` Here you can see it in action: https://ideone.com/zGfLe Some explanation: `-F` sets the input field separator to a regexp (any of `tr`'s or `td`'s opening or closing tag then works only on lines that matches those tags AND at least two upercasse fields then prints the needed fields. HTH

How to extract data from html table in shell script?

Solution

Problem