Top "Partitioning" questions

Partitioning is a performance strategy whereby you divide possibly very large groups of data into some number of smaller groups of data.

Apache Spark: Get number of records per partition

I want to check how can we get information about each partition such as total no. of records in each …

scala apache-spark hadoop apache-spark-sql partitioning
How to control partition size in Spark SQL

I have a requirement to load data from an Hive table using Spark SQL HiveContext and load into HDFS. By …

apache-spark hive apache-spark-sql partitioning
Auto sharding postgresql?

I have a problem where I need to load alot of data (5+ billion rows) into a database very quickly (ideally …

database postgresql partitioning sharding
Efficient querying of multi-partition Postgres table

I've just restructured my database to use partitioning in Postgres 8.2. Now I have a problem with query performance: SELECT * FROM …

sql performance postgresql partitioning
what is a good way to horizontal shard in postgresql

what is a good way to horizontal shard in postgresql 1. pgpool 2 2. gridsql which is a better way to use sharding …

postgresql partitioning sharding
Best way to manage row expiration in mysql

An application does the following: writes a row to a table that has a unique ID read the table and …

mysql performance cron indexing partitioning
What is the best way to partition large tables in SQL Server?

In a recent project the "lead" developer designed a database schema where "larger" tables would be split across two separate …

sql sql-server partitioning
How to understand the dynamic programming solution in linear partitioning?

I'm struggling to understand the dynamic programming solution to linear partitioning problem. I am reading the The Algorithm Design Manual …

algorithm partitioning dynamic-programming
How many table partitions is too many in Postgres?

I'm partitioning a very large table that contains temporal data, and considering to what granularity I should make the partitions. …

performance postgresql partitioning
How to partition Mysql across MULTIPLE SERVERS?

I know that horizontal partitioning...you can create many tables. How can you do this with multiple servers? This will …

mysql scalability scaling partitioning