Welcome, Guest. Please Login.
IRobotSoft Robot
02/19/17 at 18:31:15
News: IRobotSoft is the Best Visual Web Computing Platform!
Home Help Search Login
Google
 


1  General Category / Newcomers / Re: callParallel browser limitation...
 on: 10/11/16 at 21:49:17 
Started by BrentH | Post by BrentH
I tried testing using: Advanced -> Server Test Mode -> Test Server-mode Full  
...this did not work.
 
Is a 'user agent' string being passed with the website request? Something is telling yellowpages.com that the request is coming from an unsupported browser.  What is it?
 
Thanks
Reply Quote Notify of replies  

2  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/11/16 at 21:19:10 
Started by BrentH | Post by BrentH
I just mis-typed in the blog Wink  I am definitely using crawlWebsite() correctly.
 
I am testing with a mix of http and https urls...
 
http sites are crawled and data is returned without issues.
https sites show "0 of 0 bytes..." for each https site in the download popup.
 
The log shows each https site as a tuple...but no data is returned for them.  It seems that they are being skipped.
 
A bug?
 
Thanks
Reply Quote Notify of replies  

3  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/11/16 at 09:40:05 
Started by BrentH | Post by IRobotSoft Administrator
Are you sure it is not the typo in crawlWebsite(), note there is no s?  
Reply Quote Notify of replies  

4  General Category / Newcomers / Re: callParallel browser limitation...
 on: 10/11/16 at 09:28:50 
Started by BrentH | Post by IRobotSoft Administrator
Socket Browser does not support any browser version.   You can use menu Advanced -> Server Test Mode -> Test Server-mode Full to see if the socket browser works for the website.   Otherwise, you have to use the embedded IE browser.   You can parallelize through dividing the job and running multiple irobot instances on your computer.  
Reply Quote Notify of replies  

5  General Category / Newcomers / Re: callParallel browser limitation...
 on: 10/10/16 at 21:58:14 
Started by BrentH | Post by BrentH
yellowpages.com only supports IE 9 and above (I tested with IE emulation mode).
 
I now believe this is a browser version issue and nothing to do with javascript.
 
What version is the embedded socket browser? Is there a method to switch versions?
 
I also, tried to use the Advanced --> Main Browser --> IE Browser (run as admin).
With IE 11 installed I still get browser not supported page. This should work, right?
 
Thanks
 
Reply Quote Notify of replies  

6  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/10/16 at 21:21:49 
Started by BrentH | Post by BrentH
Ok that worked!
 
callParallel now works with https sites after installing the 'Windows x86 MSI installer'. Thanks for the fix!
 
However, I retested the crawlWebsites() function for crawling https sites and found that it does not work.  
crawlWebsites() only seems to work with http sites.
 
Is there a fix for that?
 
Thanks again
 
Reply Quote Notify of replies  

7  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/08/16 at 08:39:03 
Started by BrentH | Post by IRobotSoft Administrator
Looks like it is the python issue.  Please try to remove the python27.dll from your irobot directory, then install Python 2.7 version 32 bit from
https://www.python.org/downloads/release/python-2712/  (Windows x86 MSI installer)
 
Please let us know if this works.  
Reply Quote Notify of replies  

8  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/07/16 at 15:53:20 
Started by BrentH | Post by BrentH
I am running Windows 7, 64 bit; IE 11.
 
I also test ran on virtual machine --> Windows XP with IE 8 with python27.dll in irobot or windows/system32 folders and https.dll in irobot/system folder.
 
I still get Error code: -2! when testing https('https://google.com/').
 
Unfortunately I do not have access to any other test environments.
 
What is the ideal environment to be running the software?
 
Has anybody else had this issue?
 
Thanks
 
Reply Quote Notify of replies  

9  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/06/16 at 10:25:10 
Started by BrentH | Post by IRobotSoft Administrator
What is your Windows and IE versions?  Can you test it on some other machines to see if it works?  
 
Currently it is difficult to pin point the issue because it is related to the OS environment, we will try to add some logging so that later we can identify such issues more easily.  
 
Reply Quote Notify of replies  

10  General Category / Newcomers / Re: CrawlWebsites() using https...
 on: 10/05/16 at 14:08:16 
Started by BrentH | Post by BrentH
It has been three weeks since I last posted.
The new irobot.exe file and python27.dll did not work.
 
Are there plans to fix the software?
 
Thanks
Reply Quote Notify of replies