snap() can't capture elements off initial page (Chromium has changed) [fixed]

[JS-code-dev]

Hi, I am looking to snap images that could be potentially off the initial screen and requires scrolling.

I am using t.hover to scroll to the image, then use t.snap to take a capture of the image. However it seems like the capture of the off screen element always turns up blank even though it has already scrolled to the element.

Refer to my sample code in Python:

t.url('https://www.google.com/search?q=test')
t.hover('(//div[@role="navigation"])[2]')
t.snap('(//div[@role="navigation"])[2]', 'test.png')

Is this a bug? Or is there a way to overcome this?

[JS-code-dev]

Hello, You are searching for the wrong xPath. The xPath is (//div[@ROLE="navigation"])[2]  The snap works if the element is on the main screen, but if it needs scrolling to reach the element, snapping does not work.

…

On Tue, May 30, 2023 at 10:07 AM Amanaway ***@***.***> wrote: When you run the RPA process, it will open a new chrome browser, but I run your RPA process, I can't find your xpath. [image: error] <https://user-images.githubusercontent.com/21170982/241829844-a1737bf5-927b-4b03-9cc4-142c4756a70e.png> So, you can try this xpath: ***@***.***="tsf"]/div[1]/div[1], you will get a png like this: [image: test] <https://user-images.githubusercontent.com/21170982/241830155-659c9411-7a34-4ebb-9f47-8c041e7168b7.png> Hi, I am looking to snap images that could be potentially off the initial screen and requires scrolling. I am using t.hover to scroll to the image, then use t.snap to take a capture of the image. However it seems like the capture of the off screen element always turns up blank even though it has already scrolled to the element. t.url('https://www.google.com/search?q=test') ***@***.***="navigation"])[2]') ***@***.***="navigation"])[2]', 'test.png') Is this a bug? Or is there a way to overcome this? — Reply to this email directly, view it on GitHub <#479 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AOMVVFLKDEFXWE7JQVIJHATXIVI5RANCNFSM6AAAAAAYO2MU3Q> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[Vic-Lau]

yes, scrolling will get this bug, I delete the reply.

Hello, You are searching for the wrong xPath. The xPath is (//div[@ROLE="navigation"])[2] The snap works if the element is on the main screen, but if it needs scrolling to reach the element, snapping does not work.
…
On Tue, May 30, 2023 at 10:07 AM Amanaway @.> wrote: When you run the RPA process, it will open a new chrome browser, but I run your RPA process, I can't find your xpath. [image: error] https://user-images.githubusercontent.com/21170982/241829844-a1737bf5-927b-4b03-9cc4-142c4756a70e.png So, you can try this xpath: @.="tsf"]/div[1]/div[1], you will get a png like this: [image: test] https://user-images.githubusercontent.com/21170982/241830155-659c9411-7a34-4ebb-9f47-8c041e7168b7.png Hi, I am looking to snap images that could be potentially off the initial screen and requires scrolling. I am using t.hover to scroll to the image, then use t.snap to take a capture of the image. However it seems like the capture of the off screen element always turns up blank even though it has already scrolled to the element. t.url('https://www.google.com/search?q=test') @.="navigation"])[2]') @.="navigation"])[2]', 'test.png') Is this a bug? Or is there a way to overcome this? — Reply to this email directly, view it on GitHub <#479 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AOMVVFLKDEFXWE7JQVIJHATXIVI5RANCNFSM6AAAAAAYO2MU3Q . You are receiving this because you authored the thread.Message ID: @.***>

[kensoh]

@JS-code-dev @Vic-Lau I can replicate. I get the following from the logs. The log output looks correct, but somehow a blank image is returned. It's been a while since I created this function so I don't remember if it supports taking snapshot outside of the initial view. Likely this was working but along the way it might have stopped working with newer Chromium because below log output looks correct. I'll check more and update back.

[tagui] INPUT  -
[30] {"id":30,"method":"Page.captureScreenshot","params":{"format":"png","quality":80,"clip":{"x":180,"y":559,"width":652,"height":56,"scale":1},"fromSurface":true}}
[tagui] OUTPUT -
[30] {"id":30,"result":{"data":"iVBORw0KGgoAAAANSUhEUgAAAowAAAA4CAYAAAB396mcAAABL2lDQ1BTa2lhAAAokX2QPUsDQRCGH0NQonYqprC4RrBRc1FzBGzyocHCJlGIFsLlcgQxicflRHux80dYipWF/0SwsrDRWghYWPneXXEBjbPMzrPvDjM7C6kssnQOev3Ar9fKRvPo2Jh6Y0IrMtsZeIw3ZX29xLnPq//kjbNM2x04ip/ywFdzlWyL5zsxX4Xcivk25MvAC8R3IfsH9Yr4SbzSGeHWCDueH+a/ird73QsneTezbv+wodiUL1HjXKtDF5d1Gpxxii0qYVKkwIZ8l01FkwpVLEVL5wpldnRTIqe7KnntWxEXpVrhf8YtnRuwNGfmO9F6Q3icBmM/0ZZPIDsJ9x+JlvyxZ/t2JKXlKbcMwwWN8gBz7zBzLXUxqvz3rMavWQ326OOwJsrr3SaFHwYiSrMQwHDKAAABHElEQVR4nO3WMQHAIBDAwFL/nh8FZIXhTkHGrJmZDwAADv7bAQAAvM0wAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAMkwAgCQDCMAAGkDitEEbJUz5HAAAAAASUVORK5CYII="}}

[kensoh]

@JS-code-dev @Vic-Lau I've fixed the issue. Can you try again with v1.49 to see if it works now, no need to do hover() first, it will auto-move to the web page element before taking screenshot.

There is some change in Chromium behaviour so the old snapshot code no longer works with the browser. In v1.49 I've updated logic to use absolute x,y coordinates instead of relative coordinates and it works now.

[kensoh]

@JS-code-dev , this year I'm running a promotion if a user reports a new bug, there is 200 USD gift voucher. Could you pick a vendor you like so that I can get a gift voucher to appreciate reporting this bug and benefit other users of this package?

Thank you very much for raising this issue!!

[kensoh]

Adding on, any online vendor will do, does not need to be in USD. Roughly 200 USD value will do.

If more it is also ok, you can cover the rest of the cost and I can cover the 200 USD. Thank you 🙏

[JS-code-dev]

@kensoh I have verified that snapping off-page works as intended without the need for hover! Should I go ahead and close this then? Also, that's very generous of you for the 200 USD! I will pm you regarding the details! Thank you :)

Edit: I just noticed there is no dm function in GitHub. How should I get in touch with you?

[kensoh]

It's ok can leave issue open for a while so users with the same problem will know to upgrade their rpa package version.

You can email me at opensource@tebel.org thank you for raising this issue! So I know Chromium has changed and broke the snap() function.