Parsing out data using BeautifulSoup in Python

Question

I am attempting to use BeautifulSoup to parse through a DOM tree and extract the names of authors. Below is a snippet of HTML to show the structure of the code I'm going to scrape. ```

Authors: Dacheng Lin, Ronald A. Remillard, Jeroen Homan

Authors: A.G. Kosovichev

``` My point of confusion is that when I do soup.find, it finds the first occurrence of the div tag that I'm searching for. After that, I search for all 'a' link tags. At this stage, how do I extract the authors names from each of the link tags and print them out? Is there a way…

Accepted Answer

just use findAll for the divs link you do for the links

for authordiv in soup.findAll('div', attrs={'class': 'list-authors'}):

Parsing out data using BeautifulSoup in Python

Solution

Problem