Overview
Updated at：2025-11-03
BosImport facilitates data migration from other cloud storage services to BOS. The tool follows a client-server architecture. The client handles file listing, task scheduling, progress tracking, and parameter/configuration management related to migration. Migration tasks are executed on the server, with the client informing the server of the files to migrate via RPC requests.
BosImport tool has the following features:
- Support multiple migration methods with good scalability and support diverse source-to-destination location migrations (currently AWS S3, Alibaba Cloud OSS, Tencent Cloud COS, Qiniu Cloud-Object Storage (KODO), Xiaomi Ecosystem Cloud, BOS, Kingsoft Cloud KS3, etc.);
- Support real-time migration concurrency/pressure adjustment, server "hot upgrade";
- Support hot start and stop of migration tasks, and display real-time migration progress;
- The data transmission bypasses disk storage, reducing disk I/O. Large files are transmitted in multiple parts, with part sizes configurable in real-time to maximize bandwidth utilization of migration machines;
- Realize load balancing. Clients select idle servers for migration tasks;
- Support customizing the task list and number of files for migration;
- Support QPS and traffic rate limiting for migration tasks;
- Support multiple migration strategies:
1.
FORCE_OVERWRITE: Forcibly overwrite files at the destination location, which may damage files at the destination location. It is risky. Use this strategy with caution and only when the need is confirmed; 2.KEEP_DESTITNATION: Skip if a file with the same name exists at the destination location; 3.KEEP_NEWER: If a file with the same name exists at the destination location and is newer than the file at the source location, skip it; otherwise, overwrite it. If no file with the "same name" exists at the destination location (as files may require renaming during migration), copy it directly to the destination location according to the migration rules.
Download address
| File name and download address | MD5 |
|---|---|
| bosimport-1.0.2.tar | cc3fa596f917383278463aba1ebc3e65 |
Runtime environment
Java 1.7 and above
Directory structure
Plain Text
1├── client
2 │ ├── client.jar # client jar, read file lists, conduct task scheduling, and statistical analysis of progress
3 │ ├── resources # client configuration folder
4 │ │ ├── client.properties # client migration task configuration file
5 │ │ └── client_logback.xml # client log configuration file
6 │ ├── start_client.sh # Start client process
7 │ └── stop_client.sh # Stop client process
8 ├── properties_examples # Example configurations for migration task client.properties from different sources
9 │ ├── client.properties.bos # BOS to BOS migration
10 │ ├── client.properties.bos-check # BOS-to-BOS check
11 │ ├── client.properties.cos # COS-to-BOS migration
12 ├── client.properties.fds # Xiaomi Ecosystem Cloud to BOS migration
13 │ ├── client.properties.http # HTTP-to-BOS migration
14 │ ├── client.properties.oss # OOS-to-BOS migration
15 │ ├── client.properties.qiniu # KODO-to-BOS migration
16 ├── client.properties.ks3 # Kingsoft Cloud KS3 to BOS migration
17 │ └── client.properties.s3 # AWS S3 to BOS migration
18├── server
19 │ ├── resources # server configuration folder
20 │ │ ├── server.properties # Server configuration file
21 │ │ └── server_logback.xml # Server log configuration file
22 │ ├── server.jar # server.jar, read the data source and migrate to BOS
23 ├── supervise.sh # Supervisor script, ensure the server process automatically restarts upon exit
24 │ ├── start_server.sh # Start server process
25 │ └── stop_server.sh # Stop server process
26 ├── start_migration.sh # One-click start of migration task, including server and client
27 └── stop_migration.sh # One-click stop of migration task, including server and client