Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New DBI backend for Spark #76

Open
alibell opened this issue Oct 24, 2022 · 1 comment
Open

New DBI backend for Spark #76

alibell opened this issue Oct 24, 2022 · 1 comment

Comments

@alibell
Copy link

alibell commented Oct 24, 2022

Hello,

I've created a backend to add Spark connection support using the SparkR library.

There are actually two libraries which permit Spark connection with R: SparkR and Sparklyr.
Even if the Sparklyr interface exists, SparkR is the Spark official one and allow the user to follow Spark syntax and perform lazy and distributed computation before data retrieval.
I think it would be useful for users working with the SparkR library to have a DBI interface to keep compatibility with many R tools and packages.

My package repository is: https://github.com/alibell/SparkR-DBI

Related PR: #77

Thank you

@krlmlr
Copy link
Member

krlmlr commented Dec 5, 2022

Thanks, nice work! This should be picked up automatically once the package is on CRAN.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants