IRobotSoft Visual Web Scraping & Web Automation Forum
http://irobotsoft.org/bb/YaBB.pl
General Category >> Robot Show >> scraping similar items on the same page
http://irobotsoft.org/bb/YaBB.pl?num=1404290969

Message started by david.ellis on 07/02/14 at 04:49:28

Title: scraping similar items on the same page
Post by david.ellis on 07/02/14 at 04:49:28

I want to scrape a page with a list of university staff (see attachment) . this isnt a list or links  it is a list of headings and descriptions (see image) I thought that "extract data like" would go down the page and extract each record but I only get the first one

Title: Re: scraping similar items on the same page
Post by IRobotSoft Administrator on 07/02/14 at 07:30:26

You want an Extract Table action.

Title: Re: scraping similar items on the same page
Post by david.ellis on 07/09/14 at 02:10:02

OK I extracted a table, which seems fine when I look at what is extracted. I then named the four variables in the table that I want to save, I then went to save variable and created a csv file with each of the named variables as expressions (also tried string). When I run it nothing is saved?

Title: Re: scraping similar items on the same page
Post by IRobotSoft Administrator on 07/09/14 at 10:07:57

One possible reason is you didnot put a name under TargetField.

Also, you can use action log to check if the variables are extracted correctly.

IRobotSoft Visual Web Scraping & Web Automation Forum » Powered by YaBB 2.1!
YaBB © 2000-2005. All Rights Reserved.