211 lines
3.2 KiB
Markdown
211 lines
3.2 KiB
Markdown
# 阿里云 APS Node 同步命令清单
|
||
|
||
## 1. 进入项目目录
|
||
|
||
```powershell
|
||
cd D:\project\python\aliyun-sync\aliyun-aps-sync
|
||
```
|
||
|
||
## 2. 安装依赖
|
||
|
||
```powershell
|
||
npm install
|
||
```
|
||
|
||
## 3. 登录
|
||
|
||
```powershell
|
||
npm run login
|
||
```
|
||
|
||
作用：
|
||
|
||
- 打开浏览器
|
||
- 手动完成阿里云 / RAM 登录
|
||
- 自动验证我的客户和账单查询
|
||
- 保存登录态
|
||
|
||
## 4. 全量同步
|
||
|
||
```powershell
|
||
npm run sync
|
||
```
|
||
|
||
如果要从已有 checkpoint 继续全量流程（当前主要覆盖 orders + bills）：
|
||
|
||
```powershell
|
||
npm run sync -- --resume
|
||
```
|
||
|
||
默认包含：
|
||
|
||
- customers
|
||
- customerDetails
|
||
- orders
|
||
- orderDetails
|
||
- bills
|
||
- messages
|
||
|
||
并在同步过程中直接写入数据库。
|
||
|
||
## 5. 日增量同步
|
||
|
||
```powershell
|
||
npm run incremental
|
||
```
|
||
|
||
默认包含：
|
||
|
||
- orders
|
||
- orderDetails
|
||
- bills
|
||
- messages
|
||
|
||
说明：
|
||
|
||
- 不抓 customer
|
||
- 按数据库 watermark + overlap 抓取
|
||
|
||
## 6. 单独抓账单
|
||
|
||
```powershell
|
||
npm run bills
|
||
```
|
||
|
||
## 7. 单独抓消息
|
||
|
||
```powershell
|
||
npm run messages
|
||
```
|
||
|
||
## 8. 从最新 checkpoint 继续抓账单
|
||
|
||
```powershell
|
||
npm run bills -- --resume
|
||
```
|
||
|
||
## 9. 定时任务
|
||
|
||
```powershell
|
||
npm run schedule
|
||
```
|
||
|
||
默认读取：
|
||
|
||
```env
|
||
ALIYUN_APS_SCHEDULE_MODE=incremental
|
||
```
|
||
|
||
## 10. 常用 `.env` 配置
|
||
|
||
```env
|
||
ALIYUN_APS_BASE_URL=https://aps.aliyun.com
|
||
ALIYUN_APS_HEADLESS=false
|
||
ALIYUN_APS_BROWSER_CHANNEL=
|
||
ALIYUN_APS_BROWSER_EXECUTABLE_PATH=
|
||
ALIYUN_APS_TIMEZONE=Asia/Shanghai
|
||
ALIYUN_APS_CRON=0 6 * * *
|
||
ALIYUN_APS_SCHEDULE_MODE=incremental
|
||
ALIYUN_APS_CLOSE_BROWSER=true
|
||
|
||
ALIYUN_APS_FULL_SYNC=true
|
||
ALIYUN_APS_ORDER_START_DATE=2024-01-01
|
||
ALIYUN_APS_INCREMENTAL_ORDER_START_DATE=
|
||
ALIYUN_APS_BILL_START_MONTH=2024-01
|
||
|
||
ALIYUN_APS_ORDER_INCREMENTAL_OVERLAP_DAYS=2
|
||
ALIYUN_APS_BILL_INCREMENTAL_OVERLAP_DAYS=7
|
||
ALIYUN_APS_MESSAGE_INCREMENTAL_OVERLAP_DAYS=7
|
||
|
||
ALIYUN_APS_DB_HOST=
|
||
ALIYUN_APS_DB_PORT=3306
|
||
ALIYUN_APS_DB_USER=
|
||
ALIYUN_APS_DB_PASSWORD=
|
||
ALIYUN_APS_DB_NAME=
|
||
ALIYUN_APS_DB_CHARSET=utf8mb4
|
||
ALIYUN_APS_DB_CONNECTION_LIMIT=5
|
||
|
||
ALIYUN_APS_SMTP_HOST=
|
||
ALIYUN_APS_SMTP_PORT=465
|
||
ALIYUN_APS_SMTP_SECURE=true
|
||
ALIYUN_APS_SMTP_USER=
|
||
ALIYUN_APS_SMTP_PASS=
|
||
ALIYUN_APS_NOTIFY_EMAIL=
|
||
|
||
ALIYUN_APS_CLOSE_BROWSER=true
|
||
```
|
||
|
||
浏览器选择规则：
|
||
|
||
- 两项都留空：使用 Playwright 自带 Chromium
|
||
- `ALIYUN_APS_BROWSER_CHANNEL=chrome`：使用 Chrome
|
||
- `ALIYUN_APS_BROWSER_CHANNEL=msedge`：使用 Edge
|
||
- `ALIYUN_APS_BROWSER_EXECUTABLE_PATH=...`：使用指定浏览器路径
|
||
|
||
## 11. 推荐执行顺序
|
||
|
||
### 首次初始化
|
||
|
||
```powershell
|
||
cd D:\project\python\aliyun-sync\aliyun-aps-sync
|
||
npm install
|
||
npm run login
|
||
npm run sync
|
||
```
|
||
|
||
### 日常增量
|
||
|
||
```powershell
|
||
cd D:\project\python\aliyun-sync\aliyun-aps-sync
|
||
npm run incremental
|
||
```
|
||
|
||
### 单独同步消息
|
||
|
||
```powershell
|
||
cd D:\project\python\aliyun-sync\aliyun-aps-sync
|
||
npm run messages
|
||
```
|
||
|
||
### 账单长任务恢复
|
||
|
||
```powershell
|
||
cd D:\project\python\aliyun-sync\aliyun-aps-sync
|
||
npm run login
|
||
npm run bills -- --resume
|
||
```
|
||
|
||
### 常驻定时任务
|
||
|
||
```powershell
|
||
cd D:\project\python\aliyun-sync\aliyun-aps-sync
|
||
npm run schedule
|
||
```
|
||
|
||
## 12. 错误文件
|
||
|
||
运行异常时会保存：
|
||
|
||
```text
|
||
data/errors/<dataset>/
|
||
```
|
||
|
||
## 13. 运行时热键
|
||
|
||
| 按键 | 功能 |
|
||
| --- | --- |
|
||
| F7 | 暂停 |
|
||
| F8 | 继续 |
|
||
| F9 | 终止 |
|
||
|
||
## 14. 本地数据目录
|
||
|
||
```text
|
||
data/current/
|
||
data/history/
|
||
data/delta/
|
||
data/checkpoints/
|
||
data/runs/
|
||
data/errors/
|
||
```
|