Skip to content

New Presplit utility for Fate table#6471

Open
ArbaazKhan1 wants to merge 4 commits into
apache:mainfrom
ArbaazKhan1:accumulo-4979
Open

New Presplit utility for Fate table#6471
ArbaazKhan1 wants to merge 4 commits into
apache:mainfrom
ArbaazKhan1:accumulo-4979

Conversation

@ArbaazKhan1

Copy link
Copy Markdown
Contributor

closes issue #4979

Added support for pre-splitting Fate tables via accumulo admin command.

  • --numSplits option generates split points using the same partitioning logic as in FateManager.getDesiredPartitions. The logic ensures that pre-split boundires align with how the manger expects transaction IDs to be distributed. The split utility produces raw UUID row strings which should allow it be also be used by scan_ref.

  • --splitsFile flag writes the generated splits to a file.

Comment thread server/base/src/main/java/org/apache/accumulo/server/util/adminCommand/Fate.java Outdated
Comment thread server/base/src/main/java/org/apache/accumulo/server/util/adminCommand/Fate.java Outdated
Comment thread server/base/src/main/java/org/apache/accumulo/server/util/adminCommand/Fate.java Outdated
}
}

private void preSplitFateTable(FateOpts options) throws Exception {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
private void preSplitFateTable(FateOpts options) throws Exception {
private void generateFateTableSplits(FateOpts options) throws Exception {

Suggest changing the name as this is generating the splits, not applying them to the table.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Create utility to presplit the fate table

3 participants