Skip to main content
961 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
2 votes
1 answer
207 views

I'm trying to extract tables from this site: https://www.dnb.com/business-directory/company-information.beverage_manufacturing.br.html As you can see, the complete table has 14,387 rows and each page ...
Alejandro Carrera's user avatar
  • 603
1 vote
1 answer
73 views

Using RSelenium, I'm trying to open a new tab and scroll down. Unfortunately, I can't make this work because my browser stays at the first tab. Does anyone know how to solve this? This is a simplied ...
dr_E's user avatar
  • 35
10 votes
1 answer
2k views

I'm using RSelenium to scrape some data. It was working for me no problem yesterday but when I got back to it today I'm getting an error I don't understand. Here's what I'm doing: library(rJava) ...
ndivers's user avatar
  • 99
0 votes
0 answers
60 views

I am trying to run a simple code in R Studio on my new laptop, and I am trying desperately to get my code to run, by failing since hours ... any help would be highly appreciated! I run this code: ...
Jochen's user avatar
  • 9
0 votes
0 answers
68 views

I am using a selenium/standalone-firefox docker container that I have installed R into. The aim is to set up a daily scrape of a webpage using GCS. I have an R selenium script that runs well locally. ...
M-C's user avatar
  • 1
4 votes
1 answer
104 views

At this link (https://portraits.ouranos.ca/fr/spatial?a=0&c=0&discrete=1&e=CMIP6&i=tg_mean&p=50&r=mrc001&s=annual&scen=ssp370&w=0&yr=2071) there is a tag (...
M. Beausoleil's user avatar
  • 3,843
0 votes
1 answer
70 views

I'm trying to extract the name and prices of the AKI supermarket in Ecuador. There is a page called tipti that gathers products from several supermarkets. However, it requires login and the page seems ...
Rafael Díaz's user avatar
  • 2,339
0 votes
1 answer
175 views

It's been a few months since I used rSelenium but now what used to work doesn't. I updated both java and the rselenium package thinking that must be it. Here's my code: library(tidyverse) library(...
Jeff Henderson's user avatar
  • 689
0 votes
1 answer
141 views

I am trying to open firefox with RSelenium and I am getting this error: Warning: cannot open URL 'https://api.bitbucket.org/2.0/repositories/ariya/phantomjs/downloads?pagelen=100': HTTP status was '...
lucky13's user avatar
  • 1
0 votes
1 answer
45 views

I'm dealing with a dynamically loaded page. After the load, the "next" button appears, which I want to click until the full list of divs is loaded (= until the button is no longer there). ...
ben_aaron's user avatar
  • 1,542
0 votes
1 answer
69 views

I'm trying to automate login with Rselenium in Rstudio please see below remote_driver <- rsDriver(browser = "firefox", geckover = "0.33.0", ...
Yomi.blaze93's user avatar
  • 424
0 votes
0 answers
106 views

I am trying to scrape dynamically filled webpages like this, on R. I am trying to do that with RSelenium, but I am open to alternatives. For example, I would happy to do everything with rvest only. ...
oibaFox's user avatar
  • 141
0 votes
2 answers
90 views

Using R, I am trying to get the text (ideally, with some formatting) of a pdf embedded in html. THe url, as an example, is "https://www.nycourts.gov/courts/ad2/Handdowns/2024/10-October/10-02-...
user17661126's user avatar
  • 153
1 vote
0 answers
43 views

I have a list of strings (slightly over a thousand), and I would like to find out the year when each string was mentioned in the web for the first time and save the link of the webpage where this &...
tipofey's user avatar
  • 57
4 votes
1 answer
270 views

I'm unable, most of the time, to make request to the following website: https://www.adondevivir.com/proyectos-etapa-pre-venta-en-construccion.html library(rvest);library(tibble);library(httr2) ...
Amarullazo's user avatar
  • 149
1 vote
1 answer
74 views

I am trying to collect some Dutch historical election data. Below you see the code I have been using. I still need to figure out how to iterate the process for every 'Gemeente', but my main problem ...
Jasper's user avatar
  • 115
0 votes
1 answer
102 views

I've managed to get RSelenium to work and so far I've been successful in extracting some data from the following website: https://www.immobiliare.it/vendita-case/belluno-provincia/?criterio=rilevanza ...
crossgamma's user avatar
  • 5
0 votes
1 answer
69 views

I'm wondering how I can in R visit a website and see the Network activity and responses as I would in Google Chrome and copy their associated attributes as url? Dont even know where to start but I ...
MLEN's user avatar
  • 2,579
0 votes
0 answers
63 views

I am using Azul jdk to set Rselenium if is good until when I go into R remote_driver <- rsDriver(browser = "chrome", chromever = "114.0.5735.90", ...
Dabin Xuan's user avatar
  • 1
0 votes
1 answer
51 views

I'm trying to get get a background color of a element and see if its bold using getElementValueOfCssProperty. For the color it returns "rgba(255, 222, 173, 1)", which I can convert to hex, ...
MLEN's user avatar
  • 2,579
0 votes
1 answer
78 views

I would like to use RSelenium to scrape a webpage to check if a certain text exists. I need to click on Staatsangehörigkeitsangelegenheiten followed by clicking 02. Antrag Einbürgerung [sorry as the ...
Mido's user avatar
  • 1
1 vote
1 answer
1k views

Most of the instructions for setting up Chrome servers with RSelenium advise users set the version of Chrome to the most recent version or the version found in their Chrome drivers folder. For example:...
socialscientist's user avatar
  • 4,347
1 vote
1 answer
87 views

I am trying to scrape this website. You need to click on the magnifying galss icon in the search bar to see the records I want to extract. The issue is that the website is dynamic and I need to scroll ...
Abdullah Abdelaziz's user avatar
  • 13
2 votes
2 answers
214 views

I'm trying to automate web scraping using RSelenium in R. I've successfully located and clicked a button on a webpage using RSelenium, but I'm having trouble extracting href attributes from the page ...
Derek Corcoran's user avatar
  • 4,142
0 votes
2 answers
195 views

I am trying to access the elements on the rhs of the google search, sometimes called the knowledge graph. In particular I am interested in the short bio (normally a wikipedia snippet) and the external ...
Manfredo's user avatar
  • 1,750
1 vote
2 answers
134 views

library(readr) library(tidyverse) library(rvest) salary_link <- "https://www.spotrac.com/mlb/rankings/salary/pitching/" salary_page <- read_html(salary_link) salaries <- html_text(...
Chris Franco's user avatar
  • 11
0 votes
1 answer
104 views

I'm getting this netTimeout error when I try to navigate more than once with RSelenium. The first time I use navigate after loading the browser, it always works. The second time I use navigate, I ...
Frank's user avatar
  • 1,244
0 votes
1 answer
104 views

I am webscraping using RSelenium. After hanging on a website for some minutes, I get the following error message: "_Error in .Call(R_curl_fetch_memory, enc2utf8(url), handle, nonblocking) : ...
Mikevoli's user avatar
  • 1
2 votes
2 answers
149 views

enter image description hereI was writing code to web scrape the post title, comments and author names from a reddit post for a project. I am able to web scrape the post title, author names but the ...
Zoro's user avatar
  • 33
1 vote
0 answers
20 views

I found a way in which one can load a single Extension directly with RSelenium. The question here is how to load multiple extensions? Anyone? ZoteroConnector="C:/Users/Documents/URLsToZotero/...
Camilo's user avatar
  • 449
0 votes
1 answer
106 views

I have to perform a search repeatedly on a website (https://franklin.genoox.com/clinical-db/home) A long time ago I found the Rselenium package and I have used it successfully in previous times (After ...
MARIA RODRIGUEZ SANZ's user avatar
  • 51
0 votes
1 answer
131 views

RSelenium is a great package for web interface using R, but lacks functionality on the use of hotkeys as a way to run external functions or for programmatically activate extensions. One possibility I ...
Camilo's user avatar
  • 449
1 vote
1 answer
279 views

I would like to download a pdf from this website using R. The problem is that you first have to click on the "Maak een pdf" button on the website. Because this is an javascript onclick ...
Quinten's user avatar
  • 42.9k
2 votes
0 answers
97 views

I have a test repo in GitHub and I am using GitHub Actions to visit a URL and download a .zip file, using RSelenium and a Docker container running Selenium Firefox. As shown in the code below, I run ...
datascienceuseR's user avatar
  • 53
0 votes
1 answer
102 views

How are shortcuts used in RSelenium? In the example below, I use a common shortcut to display the browsing history in Firefox. That is: push and hold Control key + press H key. While the shortcut ...
Camilo's user avatar
  • 449
0 votes
2 answers
128 views

Can anyone give me a hand to figure out how to activate a chrome extension with RSelenium? Extensions are located in the tab of the browsers, but are not preloaded when using RSelenium.
Camilo's user avatar
  • 449
0 votes
0 answers
53 views

I'm trying to loop through a job listing website to grab their job listing and do text analysis. For this job I use RSelenium. The code I am working on is as follows: #### REMOTE.COM #### remDR$...
toku_mo's user avatar
  • 120
1 vote
0 answers
98 views

I am learning about RSelenium. Does anyone have a solution for this error: Undefined error in httr call. httr output: Failed to connect to localhost port #####: Connection refused. I am surprised by ...
User_Pamplemousse's user avatar
  • 27
0 votes
1 answer
726 views

I am trying to scrape the marker coordinates from a website containing a leaflet map (osm data). I have been trawling the web for answers and it appears that a simple query to the parsed html will not ...
M.Teich's user avatar
  • 607
1 vote
0 answers
65 views

I've been working on a Shiny app using RSelenium. Locally, everything works, but when I try to host it on shinyapps.io, I encounter an error: "Connecting to remote server" Could not open ...
Sale Forecast's user avatar
  • 21
0 votes
1 answer
148 views

I was run shiny app through docker. But it works on RStudio but when I run it through docker it gives an error: Undefined error in httr call. httr output: Failed to connect to localhost port 4445 ...
Hello World's user avatar
  • 29
5 votes
3 answers
97k views

I am trying to install RSelenium for webscraping but am not able to get a chromedriver that matches with my current chrome version. I do not want to downgrade to an older google chrome as that seems ...
Ankita's user avatar
  • 63
0 votes
1 answer
157 views

My Rselenium suddenly stopped. I looked for answers, tried all of them without any luck.I then uninstalled docker and reinstalled, restarted my machine and all of that. Finally have managed to get a ...
cephalopod's user avatar
  • 1,906
0 votes
1 answer
120 views

I have to scrap data from a auctions website called Unicorn Auctions. When I try to do it using rvest everything that I can get is the auction title and URL, but I also need it's start and end dates. ...
João Paiva's user avatar
  • 1
1 vote
0 answers
50 views

Hi used RSelenium for some web-scraping a couple of weeks back. I finished the task but every time I open my RStudio I get this error in my console Warning: namespace ‘RSelenium’ is not available and ...
EconNoob's user avatar
  • 11
0 votes
1 answer
33 views

I am doing literature review, so I am trying to get the list of papers under certain search terms in Google scholar. I have trouble getting the PDF links when available. Some references have PDFs, ...
Camilo's user avatar
  • 449
1 vote
1 answer
75 views

I want to click on the right button of keyboard using Rselenum. But unfortunately, I get this error. x <- driver$findElement("xpath", "/html/body/c-wiz[2]/div/c-wiz/div[1]/div[1]/div[...
Hello World's user avatar
  • 29
2 votes
0 answers
697 views

I get this error when my google chrome update from 118 to 119. I have been changed the chromedriver also. Error in checkError(res) : Undefined error in httr call. httr output: length(url) == 1 is not ...
Hello World's user avatar
  • 29
2 votes
1 answer
474 views

I am working with the R programming language. I am using the Selenium library. Earlier (in August 2023), my code used to run without any problem - but now (November 2023) I am getting the following ...
stats_noob's user avatar
  • 6,889
2 votes
0 answers
175 views

Hello smart people of the internet, I have written an app in R Shiny that uses the package RSelenium (and specifically, its rsDriver function). It works fine on my local machine. However, when I try ...
user1713174's user avatar
  • 377

1
2 3 4 5
…
20