`bytewax.recovery`#

Failure recovery.

Classes#

class RecoveryConfig(db_dir, backup_interval=None)#

Configuration settings for recovery.

Parameters:

db_dir (Path) – Local filesystem directory to search for recovery database partitions.
backup_interval (Optional[timedelta]) – Amount of system time to wait to permanently delete a state snapshot after it is no longer needed. You should set this to the interval at which you are backing up the recovery partitions off of the workers into archival storage (e.g. S3). Defaults to zero duration.

Initialization

property backup_interval#

property db_dir#

Functions#

init_db_dir(db_dir, count)#

Create and init a set of empty recovery partitions.

Parameters:

db_dir (Path) – Local directory to create partitions in.
count (int) – Number of partitions to create.