Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ability to merge ranges and create a larger token range to reduce number of tasks #141

Open
parekuti opened this issue Feb 22, 2017 · 0 comments
Assignees

Comments

@parekuti
Copy link
Contributor

FiloDB is very good at parallelism and performance, but if someone wants to increase concurrency they should have options to control number of tasks.

Please refer to the link for spark connector code on how to control the number of tasks getting created during full table scan.

https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector/src/main/scala/com/datastax/spark/connector/rdd/partitioner/CassandraPartitionGenerator.scala

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants