Using BeautifulSoup To Extract Specific TD Table Elements Text?

Question

I trying to extract IP Addresses from a autogenerated HTML table using the BeautifulSoup library and im having a little trouble. The HTML is structured like so: ```

IP	Country
127.0.0.1	uk
192.168.0.1	us
255.255.255.0	br

``` The small code below extracts the text from the two td rows but i only need the IP data, not the IP and Country data: ``` from bs4 import BeautifulSoup soup = BeautifulSoup(open("data.htm")) table = soup.find('table', {'class': 'mainTable'}) for row in table.findAll("a"): print(row.text) ``` this outputs: ``` 127.0.0.1 uk 192.168.0.1 us 255.255.255.0 br ``` What i need is the I…

Accepted Answer

This gives you the right list: ``` >>> pred = lambda tag: tag.parent.find('img') is None >>> list(filter(pred, soup.find('tbody').find_all('a'))) [127.0.0.1 , , 192.168.0.1 , , 255.255.255.0 , ] ``` just apply `.text` on the elements of this list. There are multiple empty `` tags in above list because the `` tags in the html are not closed properly. To get rid of them, you may use ``` pred = lambda tag: tag.parent.find('img') is None and tag.text ``` and ultimately: ``` >>> [tag.text for tag in filter(pred, soup.find('tbody').find_all('a'))] ['127.0.0.1', '192.168.0.1', '255.255.255.0'] ```

Using BeautifulSoup To Extract Specific TD Table Elements Text?

Solution

Problem