IRobotSoft Visual Web Scraping & Web Automation Forum - website data not visible for scrapping

Welcome, Guest. Please Login.

	06/01/23 at 22:41:17 News: Welcome to the IRoboSoft Visual Web Scraping and Web Automation forum.

IRobotSoft Visual Web Scraping & Web Automation Forum › General Category › Newcomers

‹ Previous topic | Next topic ›

Pages: 1

website data not visible for scrapping (Read 4334 times)

Junior Member

Posts: 22
Gender: male

website data not visible for scrapping
07/24/20 at 06:31:42

Hi,
I have been using iRobot to scrap data from a website.
however they have revamped the website.
in the new website data is not showing up in the scrapped page.
I have tried with the latest iRobot available on your website.
still it does not work.
sample webpage url not working is https://www.nse-india.com/companies-listing/corporate-filings-financial-results
also attaching sample iRobot file calling this website page.
on standalone browser a table is displayed below 'download' link after a line.
however this table is not available/visible when this page is viewed in iRobot script file including table header.
please let me know what needs to be done to get the table data in iRobot script.
note: also in the new version I observe error in a file named LoadLibraries.log as "loading DLL ...D:\DEV_FI~1\iRobot\new_irobot\system/https.dll FAILED! error code=193"
but the file https.dll do exist in the folder mentioned in the error log. only issue I see is slash is forward for last one whereas for all others it is backward
thanks for your help
regards
Babu

sample_test.irb

regards
SB

IP Logged

IRobotSoft Administrator

IRobotSoft, the Best
Internet Robot
System

Posts: 1609
Gender: male

Re: website data not visible for scrapping
Reply #1 - 09/13/20 at 15:33:53

Unfortunately, IE browser is not able to show the web page correctly. To scrape the content, you can use Chrome inspector to see which URL is used to fetch the content. For example, the content is at: https://www.nseindia.com/api/corporates-financial-results?index=equities&period=Quarterly . Then add the following command to save the content to a file.

SaveUrlFile('https://www.nseindia.com/api/corporates-financial-results?index=equities&period=Quarterly', 'test.json')

It will save the content to the 'test.json'. Then you can try to process the json data file.

The Administrator.

IP Logged

Pages: 1

IRobotSoft Visual Web Scraping & Web Automation Forum › General Category › Newcomers

‹ Previous topic | Next topic ›