IRobotSoft Visual Web Scraping & Web Automation Forum

IRobotSoft Visual Web Scraping & Web Automation Forum
http://irobotsoft.org/bb/YaBB.pl
General Category >> IRobot Applications >> project only showing up in program browser
http://irobotsoft.org/bb/YaBB.pl?num=1513202272

Message started by 20GT on 12/13/17 at 16:57:52

Title: project only showing up in program browser
Post by 20GT on 12/13/17 at 16:57:52

my project file is only showing up in the program browser not in my explorer window?

http://i.imgur.com/p2D0GTr.png
http://i.imgur.com/qInYyms.png
Plus I'm getting this error

20171213 19:09:39 NAVIGATION TIMEOUT From: res://ieframe.dll/dnserrordiagoff.htm#file:///C:/Program%20Files%20(x86)/irobot-eval/system/actions.log To: C:\Program Files (x86)\irobot-eval\system/actions.log

Title: Re: project only showing up in program browser
Post by IRobotSoft Administrator on 12/19/17 at 21:34:51

You should be able to find your projects from the File Open window.

The NAVIGATION TIMEOUT error is just a warning when your network is too slow, or a web page cannot be opened.

Title: Re: project only showing up in program browser
Post by 20GT on 12/20/17 at 15:26:09

any ideas why my file is not showing up? :-?

Title: Re: project only showing up in program browser
Post by IRobotSoft Administrator on 12/20/17 at 23:40:40

I guess you are running at a different location. You can check the path under "My Robots" or on the tool bar, to see where it is.

Title: Re: project only showing up in program browser
Post by 20GT on 12/21/17 at 10:05:48

I'll check when I get home, thanks.

Title: Re: project only showing up in program browser
Post by 20GT on 12/23/17 at 11:56:58

nope its correct
from file://C:\Users\Steve\AppData\Local\Temp\$tmp_list_robots.html

Code:

<HTML><BODY bgcolor=white>
<h2><font color=LightSalmon face=cursive> My Robots </font> </h2>
<font color=SlateGray face=cursive>C:\Program Files (x86)\irobot-eval\</font><br>
<TABLE width="100%%" border=0><TR><TD valign=top width="20%">
<TABLE bgcolor=PaleGoldenrod bordercolor=MidnightBlue border=1 cellpadding=1 cellspacing=1 bordercolordark=Moccasin bordercolorlight=DarkRed>
<TH bgcolor=DarkSalmon>Local Robots</TH>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\Test.irb">Test.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\automate_it.irb">automate_it.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\change_proxy.irb">change_proxy.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\go_urls_csv.irb">go_urls_csv.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\go_urls_sequential.irb">go_urls_sequential.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\mom.irb">mom.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\naive-bayes-classifier.irb">naive-bayes-classifier.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\parse-address.irb">parse-address.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\parse-address_script.irb">parse-address_script.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\parse-email.irb">parse-email.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\pubmed.irb">pubmed.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\scripting-examples.irb">scripting-examples.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\sendappkeys.irb">sendappkeys.irb</a></TD></TR>
<TR><TD bgcolor='#f0f8ff'><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\structures.irb">structures.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\submit_form_csv.irb">submit_form_csv.irb</a></TD></TR>
</TABLE>
<font size=-1>Sort by: <a href=irobot://Show/AllRobots?order=name>name</a> <a href=irobot://Show/AllRobots?order=date>date</a> <a href=irobot://Show/AllRobots?order=size>size</a></font>
</TD><TD valign=top width=100%>
<table width=100%><tr><td align=left valign=top>
<table width=100% bgcolor='DDEEAA' border=1 bordercolor=Yellow bordercolordark=White bordercolorlight=Firebrick cellspadding=1 cellspacing=0>
<tr><td bgcolor=#7799AA><b>path1 <a href="irobot://CListPaths/TreeView?action=show&selected_task=path1"> >> </a></b>
</td></tr><tr><td>
<font size=-1>(<a href='irobot://Robot/AddBookmark?IrbFile=C:\Program Files (x86)\irobot-eval\structures.irb&IrbTask=path1&BookmarkFile=C:\Program Files (x86)\irobot-eval\Bookmarks.bmk&ReturnUrl=irobot://Show/AllRobots'>bookmark it</a>)</font><br>
It includes: <br><table width=90%><tr><td><ul>
<li><i>Go to Url: https://ark.gamepedia.com/Item_IDs/Structures</i></li><br>
<li><i>Extract data like '12 × Thatch'</i></li><br>
<li><i>Extract data like '1 × Flint'</i></li><br>
<li><i>Extract data like '16 × Stone'</i></li><br>
<li><i>Extract data like '2 × Wood'</i></li><br>
</ul></td></tr></table>
</td></tr></table>
</td><td align=right valign=top>
<TABLE align=left valign=top bgcolor=Wheat border=1 bordercolor=Yellow bordercolordark=White bordercolorlight=Firebrick cellpadding=1 cellspacing=0>
<TH bgcolor=Violet>Recent Robots</TH>
<TR><TD bgcolor='#f0f8ff'><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\structures.irb">C:\Program Files (x86)\irobot-eval\structures.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Users\Steve\Desktopstructures.irb">C:\Users\Steve\Desktopstructures.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\Test.irb">C:\Program Files (x86)\irobot-eval\Test.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\pubmed.irb">C:\Program Files (x86)\irobot-eval\pubmed.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\clerk.irb">C:\Program Files (x86)\irobot-eval\clerk.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\submit_form_csv.irb">C:\Program Files (x86)\irobot-eval\submit_form_csv.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\mom.irb">C:\Program Files (x86)\irobot-eval\mom.irb</a></TD></TR>
<TR><TD><a href="irobot://Robot/Open?IrbFile=C:\Program Files (x86)\irobot-eval\go_urls_csv.irb">C:\Program Files (x86)\irobot-eval\go_urls_csv.irb</a></TD></TR>
</TABLE>
</td></tr></table>
<p><hr><p> <iframe width="100%" height=768 border=0 src="http://www.irobotsoft.com/robots.html?robot=structures.irb">
</iframe>
</TD></TR></TABLE>
</BODY></HTML>

Title: Re: project only showing up in program browser
Post by 20GT on 12/23/17 at 12:21:36

I'm having a horrible time scraping the item names¹ and the resources breakdown to build them²

I ran across your program I'm trying to do this for my kid

¹https://ark.gamepedia.com/Item_IDs/Structures
²https://ark.gamepedia.com/Campfire
Ingredients
Resources breakdown
Campfire
12 × Thatch
1 × Flint
16 × Stone
2 × Wood

excel csv attached

I get navigating "about:blank" at the bottom
http://i.imgur.com/3R9W1v0.png

Title: Re: project only showing up in program browser
Post by IRobotSoft Administrator on 12/23/17 at 22:22:32

Not sure if I got your issue right. But if you want to extract data from the table structure, you will need to add a Take Data action.

The generated table action probably will not work for all columns, you will need to check its property and manually remove the (TITLE='Campfire') in its Query for the first 4 columns.

Also, it looks like your file should be at: C:\Program Files (x86)\irobot-eval\structures.irb. Not sure why it does not show up on your windows browser window.

Title: Re: project only showing up in program browser
Post by 20GT on 12/24/17 at 08:58:34

Quote:

[quote]you will need to add a Take Data action. The generated table action probably will not work for all columns, you will need to check its property and manually remove the (TITLE='Campfire') in its Query for the first 4 columns.

Thanks for your reply, but this is all above my head, do i add a Take Data action once or for each instance? do i leave in the "like thatch"
Plus your program disappears from view and when i click the icon again it tells me an instance is already running and to restart my computer

Title: Re: project only showing up in program browser
Post by IRobotSoft Administrator on 12/24/17 at 10:17:06

Actually you should add Take Table action. It will extract all rows at once.

For the program, you can find it running in the task bar area.

Title: Re: project only showing up in program browser
Post by 20GT on 12/25/17 at 19:16:32

I apologise but this is going nowhere is there a video that shows how to get table data?
how do I get it in there??? I click add to task and it put test.irb in at the bottom

I don't think you understand..... the first page just contains the links to the other pages where the info is located. I don't think they are in a table on that page but its not getting to that page its going to about:blank as seen

http://i.imgur.com/cnSkvX5.jpg

Title: Re: project only showing up in program browser
Post by IRobotSoft Administrator on 12/26/17 at 10:00:01

It seems your web pages are almost identical to the demo pubmed.irb.

After going to the URL, you need to add a List of Links action to open each link. On the page:
1) Right-click the link but do not select any option from the popup menu
2) Click on the ‘A List of Links’ radio button in the designer window;
3) Click the [Add to Task] button.

Note that after adding the action, you need to manually change the TITLE clause so it can go to all links.

You Extract Data action should follow the List of Links action.