One solution could be to have a large number of partitions / buckets, say 4096, and have every partition generate a partition ID prefixed unique ID. The large number of partitions ensures that issues related to adding new partitions go away.