|
Welcome, Guest. Please Login.
|
||||
|
||||
| 1 | General Category / Newcomers / Re: ajax sites???? on: 06/07/17 at 16:49:14 |
| Started by 20GT | Post by IRobotSoft Administrator | |
| Yes, irobot supports ajax websites. Just follow the manual and create an "Go URL" action to the search page, and "submit form" action for search. The results should come out. | |
  
|
|
| 2 | General Category / Newcomers / ajax sites???? on: 06/05/17 at 22:38:00 |
| Started by 20GT | Post by 20GT | |
| I'm trying to scrape data from this (after clicking scroll down to the first link and click "Court Record Search") but its an ajax site. once you click the link scroll down to "Court Record Search" and that's where to start. Any advice would be great | |
|
|
|
| 3 | General Category / Newcomers / Re: Need a sample robot file for extracting data on: 05/20/17 at 23:51:22 |
| Started by vakkenapally | Post by IRobotSoft Administrator | |
| You will need to change the target format. Under the "save" task, find the last action "Schedule task", right click it and select "Save variable...". Then on the Save Variables page, change the target type: XML file to "CSV file". Rerun it, and the data will be in csv format. You can change the Save to file name to .csv or just rename the file to .csv. |
|
|
|
|
| 4 | General Category / Newcomers / Re: Need a sample robot file for extracting data on: 05/20/17 at 16:42:50 |
| Started by vakkenapally | Post by 20GT | |
| thanks I found literature.txt but how can I get it to export as csv? | |
|
|
|
| 5 | General Category / Newcomers / Re: Need a sample robot file for extracting data on: 05/18/17 at 21:12:54 |
| Started by vakkenapally | Post by IRobotSoft Administrator | |
| Sorry, the pubmed page has changed recently. We have make a new release with a fix. Please download the new package at: http://irobotsoft.com/irobot-eval.zip or the pubmed robot at: http://irobotsoft.com/robots/pubmed.irb. Data should be scraped to literature.txt. Let us know if you still cannot find the scraped data. |
|
|
|
|
| 6 | General Category / Newcomers / Re: Need a sample robot file for extracting data on: 05/18/17 at 17:09:00 |
| Started by vakkenapally | Post by 20GT | |
| I ran the "pubmed.irb" robot but have no idea what it was doing??? I saw it browsing but didn't see what it was scraping. what is it doing ? where is it saving the data it's scraping |
|
|
|
|
| 7 | General Category / Newcomers / Re: callParallel browser limitation... on: 10/11/16 at 21:49:17 |
| Started by BrentH | Post by BrentH | |
| I tried testing using: Advanced -> Server Test Mode -> Test Server-mode Full ...this did not work. Is a 'user agent' string being passed with the website request? Something is telling yellowpages.com that the request is coming from an unsupported browser. What is it? Thanks |
|
|
|
|
| 8 | General Category / Newcomers / Re: CrawlWebsites() using https... on: 10/11/16 at 21:19:10 |
| Started by BrentH | Post by BrentH | |
I just mis-typed in the blog  I am definitely using crawlWebsite() correctly. I am testing with a mix of http and https urls... http sites are crawled and data is returned without issues. https sites show "0 of 0 bytes..." for each https site in the download popup. The log shows each https site as a tuple...but no data is returned for them. It seems that they are being skipped. A bug? Thanks |
|
|
|
|
| 9 | General Category / Newcomers / Re: CrawlWebsites() using https... on: 10/11/16 at 09:40:05 |
| Started by BrentH | Post by IRobotSoft Administrator | |
| Are you sure it is not the typo in crawlWebsite(), note there is no s? |
|
|
|
|
| 10 | General Category / Newcomers / Re: callParallel browser limitation... on: 10/11/16 at 09:28:50 |
| Started by BrentH | Post by IRobotSoft Administrator | |
| Socket Browser does not support any browser version. You can use menu Advanced -> Server Test Mode -> Test Server-mode Full to see if the socket browser works for the website. Otherwise, you have to use the embedded IE browser. You can parallelize through dividing the job and running multiple irobot instances on your computer. |
|
|
|
|
IRobotSoft Visual Web Scraping & Web Automation Forum » Powered by YaBB 2.1!
YaBB © 2000-2005. All Rights Reserved.
