IRobotSoft Visual Web Scraping & Web Automation Forum - Resolve list of URL and save destination

Welcome, Guest. Please Login.

	12/09/23 at 00:26:11 News: Welcome to the IRoboSoft Visual Web Scraping and Web Automation forum.

IRobotSoft Visual Web Scraping & Web Automation Forum › General Category › IRobot Applications

Pages: 1

Resolve list of URL and save destination (Read 9017 times)

frank3n Junior Member Posts: 11 Gender:	Resolve list of URL and save destination 06/19/14 at 12:19:37 I have a list of 10k URLs that I want the final destination URL for. Could this be automated? Saving both in a csv would be ideal, a list of destination URLs would is an option
Back to top	IP Logged

IRobotSoft Administrator IRobotSoft Administrator IRobotSoft, the Best Internet Robot System Posts: 1609 Gender:	Re: Resolve list of URL and save destination Reply #1 - 06/19/14 at 17:30:34 Yes, of course. You just need to use a Go to URL action and save the TargetUrl check the go_urls_csv.irb in the package for example.
Back to top	The Administrator. IP Logged

frank3n Junior Member Posts: 11 Gender:	Re: Resolve list of URL and save destination Reply #2 - 07/04/14 at 16:05:27 I can go to a list of URLs and save the TargetUrl now Is there a variable name for the last Go to URL?
Back to top	IP Logged

frank3n Junior Member Posts: 11 Gender:	Re: Resolve list of URL and save destination Reply #3 - 07/04/14 at 16:09:14 I know how to name the Go to URL task, but when saving it saves the entire page source - or nothing Same happens with SourcePage SourceURL UpdatedPage UpdatedUrl TargetPage
Back to top	IP Logged

IRobotSoft Administrator IRobotSoft Administrator IRobotSoft, the Best Internet Robot System Posts: 1609 Gender:	Re: Resolve list of URL and save destination Reply #4 - 07/04/14 at 18:05:10 What do you want to save? Not the TargetUrl?
Back to top	The Administrator. IP Logged

frank3n Junior Member Posts: 11 Gender:	Re: Resolve list of URL and save destination Reply #5 - 07/04/14 at 18:08:28 I want to save both, into the same csv
Back to top	IP Logged

frank3n Junior Member Posts: 11 Gender:	Re: Resolve list of URL and save destination Reply #6 - 07/04/14 at 20:47:06 To be precise that is saving both the Go to URL and the TargetUrl in the same csv
Back to top	IP Logged

IRobotSoft Administrator IRobotSoft Administrator IRobotSoft, the Best Internet Robot System Posts: 1609 Gender:	Re: Resolve list of URL and save destination Reply #7 - 07/04/14 at 20:59:53 You can save the _TargetUrl as well.
Back to top	The Administrator. IP Logged

frank3n Junior Member Posts: 11 Gender:	Re: Resolve list of URL and save destination Reply #8 - 07/05/14 at 08:51:32 Blank field. irb is attached test.txt contains "StrField"\|"ValueField"\|"Url" "aaa"\|"111"\|"http://zzzzz.aelite.hop.clickbank.net" "aaa"\|"111"\|"http://zzzzz.affiliacad.hop.clickbank.net"
Back to top	go_urls_csv_working.irb IP Logged

IRobotSoft Administrator IRobotSoft Administrator IRobotSoft, the Best Internet Robot System Posts: 1609 Gender:	Re: Resolve list of URL and save destination Reply #9 - 07/05/14 at 09:20:56 You can just use newdataset.Url then.
Back to top	The Administrator. IP Logged

frank3n Junior Member Posts: 11 Gender:	Re: Resolve list of URL and save destination Reply #10 - 07/05/14 at 11:29:38 Aha. Thanks
Back to top	IP Logged

Pages: 1

IRobotSoft Visual Web Scraping & Web Automation Forum › General Category › IRobot Applications