futureporn/fp
1
0
Fork 0
Code Issues 33 Pull Requests Actions Packages Projects Releases Wiki Activity
fp/services/worker/src/util/b2.README.md
CJ_Clippy 657ecbcdd1 add createMuxAsset
2025-11-26 03:34:32 -08:00

6.9 KiB
Raw Blame History

Known errors

Error: Failed to run 'b2 file info': b2: tar_extract_all() failed: Invalid argument

This one is weird. It happens when several failed b2cli are running in the background. I came across this during testing and first I thought my executable was somehow corrupted.

cj@cj54hd:~/Downloads$ b2 file info b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ b2 file ls b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ b2 ls b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ b2 ls
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ b2 -h
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ b2
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ which b2
/home/cj/.local/bin/b2
cj@cj54hd:~/Downloads$ head b2
head: cannot open 'b2' for reading: No such file or directory
cj@cj54hd:~/Downloads$ ~/.local/bin/b2
b2: tar_extract_all() failed: Invalid argument
cj@cj54hd:~/Downloads$ ls -la ~/.local/bin/b2
-rwxrwxr-x 1 cj cj 32597952 Aug 23 17:07 /home/cj/.local/bin/b2
cj@cj54hd:~/Downloads$ file ~/.local/bin/b2
/home/cj/.local/bin/b2: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, stripped
cj@cj54hd:~/Downloads$ cp b2v3-linux ~/.local/bin/b2
cp: cannot create regular file '/home/cj/.local/bin/b2': Text file busy

apparently there were a shitton of b2 instances running in the background!

cj@cj54hd:~/Downloads$ ps aux | grep 'b2:/[/]'
cj        191334  0.0  0.0    292   148 pts/11   S+   Nov21   0:00 b2 file download b2://fppbdev/pbc_144770472/6v80rae2m128yw1/projektmelody-chaturbate-2025-10-19.mp4 /tmp/vods/6v80rae2m128yw1/sourceVideo/13629592283.mp4
cj        191335  0.0  0.0   2840  2004 pts/11   S+   Nov21   0:00 /tmp/staticx-gDLAjK/b2v3 file download b2://fppbdev/pbc_144770472/6v80rae2m128yw1/projektmelody-chaturbate-2025-10-19.mp4 /tmp/vods/6v80rae2m128yw1/sourceVideo/13629592283.mp4
cj        191336  0.2  0.3 950960 90496 pts/11   Sl+  Nov21   5:48 /tmp/staticx-gDLAjK/b2v3 file download b2://fppbdev/pbc_144770472/6v80rae2m128yw1/projektmelody-chaturbate-2025-10-19.mp4 /tmp/vods/6v80rae2m128yw1/sourceVideo/13629592283.mp4
cj        205138  0.0  0.0    292   152 pts/11   S+   Nov21   0:00 b2 file download b2://fppbdev/pbc_144770472/6v80rae2m128yw1/projektmelody-chaturbate-2025-10-19.mp4 /tmp/vods/6v80rae2m128yw1/sourceVideo/13629592283.mp4
cj        205139  0.0  0.0   2840  1988 pts/11   S+   Nov21   0:00 /tmp/staticx-OMOMPi/b2v3 file download b2://fppbdev/pbc_144770472/6v80rae2m128yw1/projektmelody-chaturbate-2025-10-19.mp4 /tmp/vods/6v80rae2m128yw1/sourceVideo/13629592283.mp4
cj        205140  0.0  0.3 950960 90528 pts/11   Sl+  Nov21   0:18 /tmp/staticx-OMOMPi/b2v3 file download b2://fppbdev/pbc_144770472/6v80rae2m128yw1/projektmelody-chaturbate-2025-10-19.mp4 /tmp/vods/6v80rae2m128yw1/sourceVideo/13629592283.mp4
cj        257781  0.0  0.0    292    96 pts/11   S+   Nov21   0:00 b2 file download b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4 /tmp/2024-03-10-el_xox-4csbaj06u481x9t.mp4
cj        257782  0.0  0.0   2840  2028 pts/11   S+   Nov21   0:00 /tmp/staticx-GFFmLI/b2v3 file download b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4 /tmp/2024-03-10-el_xox-4csbaj06u481x9t.mp4
cj        257783  0.0  0.3 951984 90080 pts/11   Sl+  Nov21   1:37 /tmp/staticx-GFFmLI/b2v3 file download b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4 /tmp/2024-03-10-el_xox-4csbaj06u481x9t.mp4
cj        264819  0.0  0.0    292   148 pts/11   S+   Nov21   0:00 b2 file download b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4 /tmp/vods/4csbaj06u481x9t/sourceVideo/3835045469/2024-03-10-el_xox-4csbaj06u481x9t.mp4
cj        264820  0.0  0.0   2840  2032 pts/11   S+   Nov21   0:00 /tmp/staticx-NFonPF/b2v3 file download b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4 /tmp/vods/4csbaj06u481x9t/sourceVideo/3835045469/2024-03-10-el_xox-4csbaj06u481x9t.mp4
cj        264821  0.1  0.3 950956 90488 pts/11   Sl+  Nov21   2:47 /tmp/staticx-NFonPF/b2v3 file download b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4 /tmp/vods/4csbaj06u481x9t/sourceVideo/3835045469/2024-03-10-el_xox-4csbaj06u481x9t.mp4
cj        607425  0.0  0.0    292   148 pts/11   S+   Nov22   0:00 b2 file download b2://fppbdev/pbc_144770472/2ct5pnh3fdx91ks/projektmelody-chaturbate-2024-03-04.mp4 /tmp/vods/2ct5pnh3fdx91ks/sourceVideo/4784598000/2024-03-03-projektmelody-2ct5pnh3fdx91ks.mp4
cj        607426  0.0  0.0   2840  1972 pts/11   S+   Nov22   0:00 /tmp/staticx-cjcddG/b2v3 file download b2://fppbdev/pbc_144770472/2ct5pnh3fdx91ks/projektmelody-chaturbate-2024-03-04.mp4 /tmp/vods/2ct5pnh3fdx91ks/sourceVideo/4784598000/2024-03-03-projektmelody-2ct5pnh3fdx91ks.mp4
cj        607427  0.1  0.3 950956 90492 pts/11   Sl+  Nov22   1:09 /tmp/staticx-cjcddG/b2v3 file download b2://fppbdev/pbc_144770472/2ct5pnh3fdx91ks/projektmelody-chaturbate-2024-03-04.mp4 /tmp/vods/2ct5pnh3fdx91ks/sourceVideo/4784598000/2024-03-03-projektmelody-2ct5pnh3fdx91ks.mp4

kill 'em!

cj@cj54hd:~/Downloads$ killall b2
cj@cj54hd:~/Downloads$ ps aux | grep 'b2:/[/]'
cj@cj54hd:~/Downloads$

and now it works. holy shit!

cj@cj54hd:~/Downloads$ b2 file info b2://fppbdev/pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4
{
    "cacheControl": "max-age=604800",
    "contentSha1": "84bbd4218b16184f6204eeb8094720150c8479d5",
    "contentType": "video/mp4",
    "fileId": "4_zad63b74f11035a9993a30b18_f100aec8c206f88f4_d20251116_m225322_c000_v0001417_t0037_u01763333602168",
    "fileInfo": {
        "large_file_sha1": "84bbd4218b16184f6204eeb8094720150c8479d5",
        "src_last_modified_millis": "1710056557459"
    },
    "fileName": "pbc_144770472/4csbaj06u481x9t/el_xox-chaturbate-2024-03-10.mp4",
    "fileRetention": {
        "mode": null,
        "retainUntilTimestamp": null
    },
    "legalHold": null,
    "replicationStatus": null,
    "serverSideEncryption": {
        "mode": "none"
    },
    "size": 3835045469,
    "uploadTimestamp": 1763333602168
}

But it still failed when run by BullMQ.

Error: Failed to run 'b2 file info': b2: tar_extract_all() failed: Invalid argument
    at onFailed (/home/cj/Documents/futureporn-monorepo/services/worker/node_modules/bullmq/src/classes/job.ts:1295:16)
    at <anonymous> (/home/cj/Documents/futureporn-monorepo/services/worker/node_modules/bullmq/src/classes/job.ts:1324:11)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)

OH, it is actually that my /tmp dir doesn't have enough space to store the file being downloaded! @see https://github.com/JonathonReinhart/staticx/issues/244