Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Will this repo be maintained anymore? #393

Open
MrPowers opened this issue Sep 6, 2024 · 4 comments
Open

Will this repo be maintained anymore? #393

MrPowers opened this issue Sep 6, 2024 · 4 comments

Comments

@MrPowers
Copy link

MrPowers commented Sep 6, 2024

First off, thank you for building this important library for the Spark Community!

I see that the last commit for this repo was two years ago and there are open issues to add support for Spark 3.4 and Spark 3.5.

Is there a project maintainer that would be willing to merge PRs and make releases for new Spark versions?

@banker
Copy link
Collaborator

banker commented Sep 16, 2024

@MrPowers Of course! And yes, we'd be happy to look over PRs and release a new version. What's your biggest need right now?

@MrPowers
Copy link
Author

Thanks @banker! Would you be willing to push up artifacts that are Spark 3.4 & Spark 3.5 compatible? Would you be willing to refactor to make spark-redis Spark Connect compatible?

@mpasa
Copy link

mpasa commented Sep 18, 2024

Also, as Spark 4.0 is dropping support for Scala 2.12, it would be great to see it cross-compiled for both 2.12 and 2.13. This is currently blocking our version upgrade and we'd need to drop the library if not possible.

@newfront
Copy link

I added a branch for 4.0 (#394). @banker there is one open question regarding expected behavior for the RedisNode.idx index. With the modifications to Jedis they deprecated conn.clusterSlots in favor of conn.clusterShards which provides different behavior. All cluster slots per Node are returned - so this might change the way things work. If you have a chance to look things over I'd be more than happy to change the logic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants