Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Backfill from backups utility #54

Open
ghost opened this issue Sep 7, 2022 · 1 comment
Open

Backfill from backups utility #54

ghost opened this issue Sep 7, 2022 · 1 comment
Labels
enhancement New feature or request indexer

Comments

@ghost
Copy link

ghost commented Sep 7, 2022

Is your feature request related to a problem? Please describe.

Transactions are currently purged from the system after a number of epochs. This makes it impossible to index the currently running network. There exist backups of the badger database that have this information, but we'll need to parse those.

Describe the solution you'd like

A utility that can be run on badger DB backups that will backfill missing transactions.

Describe alternatives you've considered

None exist.

Additional context

#39 will get the worker running again, but will only mark transactions as missing. This item is to backfill the missing transactions.
@ghost ghost added the enhancement New feature or request label Sep 7, 2022
@ghost
Copy link
Author

ghost commented Sep 7, 2022

Will continue the long term work for #39

ghost pushed a commit that referenced this issue Sep 7, 2022
Worker no longer gets stuck on missing transactions
095b79b 
- Purged transactions will be marked as missing
- Will need to be backfilled by another process (#54)
@ghost ghost mentioned this issue Sep 7, 2022
Merged
ghost pushed a commit that referenced this issue Sep 7, 2022
Worker no longer gets stuck on missing transactions (#57)
83bf11c 
- Purged transactions will be marked as missing
- Will need to be backfilled by another process (#54)
- Closes #39
@ghost ghost added the indexer label Sep 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request indexer
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants