Task Progress Recovery

Updated at：2025-11-03

status.log indicates detailed migration progress of corresponding file lists. If the client crashes, use the log to locate the corresponding breakpoint and resume migration at the task list granularity level.

Example:

client.properties file configuration:

                Java
                
                taskList=/home/work/list/task_list

Contents of the task_list file:

                Java
                
                /home/work/list/object_list1
/home/work/list/object_list2
# /home/work/list/object_list3

Contents of the object_list1 file:

Java

1bucket1 obj1
2bucket1 obj2
3bucket1 obj3
4#bucket1 obj4
5bucket1 obj5

Contents of the object_list2 file:

Java

1bucket1 obj21
2#bucket1 obj22
3bucket1 obj23
4bucket1 obj24
5bucket1 obj25
6bucket1 obj26

Contents of the status.log file:

                Java
                
            

                2015-12-31 17:13:42.013 /home/work/list/object_list1 2/-1
2015-12-31 17:13:45.014 /home/work/list/object_list2 3/-1
2015-12-31 17:13:48.014 /home/work/list/object_list2 4/6
2015-12-31 17:13:51.014 /home/work/list/object_list1 5/5 finished
2015-12-31 17:13:53.014 /home/work/list/object_list2 4/6
            

object_list1 2/-1 indicates completion of Line 2 in the object_list1, while -1 indicates that this file has not been read completely, and the number of lines is unknown. If a crash occurs in this case, it is unclear which files in the list have been migrated due to concurrent operations.
To restart a task from a specific progress point, create a list file and restart the client with new configurations. First, identify the data not migrated from the object_list files based on the status.log file. For example, if object_list2 is not migrated completed, add it to the new task_list_continue file and modify the configuration file. Examples are follows:

Modify the client.properties file:

                Java
                
                taskList=/home/work/list/task_list_continue

Modify the task_list_continue file:

                Java
                
                /home/work/list/object_list2

Redo

After processing all lists to be migrated, redo the migration of files not migrated successfully or having encountered problems during migration. Compile a list of files to be transferred again based on the migration logs: The files in the redo and unsent log files can be migrated using the KEEP_DESTITNATION migration strategy. However, for the list of files with failed migration, the FORCE_OVERWRITE strategy for migration should be considered, as data errors may have occurred during the migration.

Log

BOS-FS Mount Tool