fp/services/scout
CJ_Clippy 4d65294f7d
ci / build (push) Failing after 1s Details
move fetchers to their own package
2024-09-05 21:39:08 -08:00
..
src move fetchers to their own package 2024-09-05 21:39:08 -08:00
.dockerignore change scout to a service 2024-08-26 23:11:24 -08:00
.gitignore change scout to a service 2024-08-26 23:11:24 -08:00
.mocharc.json change scout to a service 2024-08-26 23:11:24 -08:00
README.md change scout to a service 2024-08-26 23:11:24 -08:00
node.d.ts change scout to a service 2024-08-26 23:11:24 -08:00
package.json combine_video_segments progress 2024-09-03 08:28:39 -08:00
pnpm-lock.yaml combine_video_segments progress 2024-09-03 08:28:39 -08:00
tsconfig.json change scout to a service 2024-08-26 23:11:24 -08:00
tsup.config.ts change scout to a service 2024-08-26 23:11:24 -08:00

README.md

scout

Vtuber data acquisition. Anything having to do with external WWW data acquisition goes in this module.

Features

  • Ingests going live notification e-mails
  • Sends start_recording signals to @futureporn/capture
  • Fetches vtuber data from platform
    • image
    • themeColor
    • displayName
  • Platform Support
    • fansly
    • chaturbate

Design requirements

  • get watched channels list from Strapi
  • every 3 mins, watch/unwatch based on channels list
    • watch important sources for go-live notifications
      • CB tab
      • email inbox
  • alerts realtime server when watched room goes live
  • logs chat messages
  • throws errors when unable to connect
  • runs browser headless
  • runs in the cloud
  • runs in k8s cluster

Puppeteer

For when we get to the point where we need it, here are the packages we used with success during past testing.

"puppeteer": "^22.7.1",
"puppeteer-extra": "^3.3.6",
"puppeteer-extra-plugin-repl": "^2.3.3",
"puppeteer-extra-plugin-stealth": "^2.11.2"

Adding API routes

  • Routes are specified in ./src/api.yml
  • Route handlers are specified in ./src/app.js