JamesFlare1212
32dee6b161
fix(cache): resolve scanning stop issue and add cache TTL management
...
- Fix Redis SCAN cursor type conversion (Buffer to String) to prevent early termination
- Add progress logging in initializeClubCache (every 100 activities with summary)
- Add Redis memory limits (512MB with LRU eviction policy)
- Implement cache TTL: 24h for normal data, 1h for error states (allows retry)
- Fix Docker permission issue by running app container as root
- Add TTL configuration to .env and example.env
Root cause: SCAN cursor comparison failed due to type mismatch (Buffer vs String)
Impact: Scanning now processes all 5000+ IDs instead of stopping at ~300
2026-04-06 21:03:30 -04:00
JamesFlare1212
0b9a42c7f3
fix(auth): add login lock to prevent concurrent Playwright login attempts
2026-04-06 18:25:52 -04:00
JamesFlare1212
480ba14688
fix(warp-proxy): host.docker.internal
2026-04-06 18:19:48 -04:00
JamesFlare1212
4a97057825
feat: 添加可选的代理功能支持
...
新增功能:
- 集成 Cloudflare WARP socks5 代理服务
- 通过环境变量 USE_PROXY 控制代理开关
- 支持自定义 HTTP/HTTPS/SOCKS5 代理服务器
- 使用 docker compose profile 管理 proxy 服务
配置方式:
- USE_PROXY=true 启用代理
- ALL_PROXY/HTTP_PROXY/HTTPS_PROXY 自定义代理
- docker compose --profile proxy up 启动 warp 服务
文件变更:
- docker-compose.yaml: 添加 warp-proxy 服务
- playwright-auth.ts: 添加代理配置逻辑
- example.env: 添加代理环境变量
- PROXY.md: 使用文档
2026-04-06 16:37:54 -04:00
JamesFlare1212
a8f468a497
feat: 使用 Playwright 实现自动化 cookie 获取和验证
...
主要变更:
- 新增 Playwright 登录认证服务 (services/playwright-auth.ts)
- 重构 get-activity.ts 使用 Playwright 替代 Axios 登录
- 实现自动 cookie 过期检测和重试机制
- 优化 Docker 配置支持 Playwright 浏览器运行
- 添加启动脚本自动验证和刷新 cookies
- 完善错误处理：区分 4xx(认证失败) 和 5xx(服务器错误)
技术细节:
- 删除旧版 login_template.txt 和 nkcs-engage.cookie.txt
- 添加 startup.sh 启动时自动验证 cookies
- 改进 cookie 验证逻辑，添加指数退避重试
- Dockerfile 安装 Playwright 系统依赖
- docker-compose.yaml 添加 volumes 和 health checks
测试:
- 添加 auth.spec.ts 自动化测试
- 添加 get-cookies.ts 和 test-cookies-validity.ts 工具脚本
- 验证 401/500/000 等错误场景处理正确
2026-04-06 16:05:38 -04:00
JamesFlare1212
b18b8a85e0
feat new s3 public url option
2026-03-15 19:40:59 -04:00
JamesFlare1212
7ba5f8f00f
feat: skip duplicate image on remote
2025-05-12 23:46:25 -04:00
JamesFlare1212
8598571f72
improve: code structure
2025-05-12 21:45:57 -04:00
JamesFlare1212
8136c76d46
feat: convert image into .avif
2025-05-12 18:41:15 -04:00
JamesFlare1212
2543e56ec4
init: port to typescript and bun
2025-05-10 23:39:39 -04:00
