mirror of
https://github.com/jellyfin/jellyfin.git
synced 2026-01-23 23:20:51 +01:00
[Issue]: Parallel library scan tasks limit default size too high #6079
Labels
No labels
area:database
awaiting-feedback
backend
blocked
breaking change: web api
bug
build
ci
confirmed
discussion needed
dotnet future
downstream
duplicate
EFjellyfin.db
enhancement
feature
future
github-actions
good first issue
hdr
help wanted
invalid
investigation
librarydb
live-tv
lyrics
media playback
music
needs testing
nuget
performance
platform
pull-request
question
regression
release critical
requires-web
roadmap
security
security
stale
support
syncplay
ui & ux
upstream
wontfix
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference: starred/jellyfin#6079
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @grobalt on GitHub (Jul 1, 2024).
Please describe your bug
The default setting is "" - empty. That causes many NAS (i tested mine and a few friends ones) to crash completly.
The combination of JELLYFIN_FFmpeg__analyzeduration=200M with endless ffprobes (full library scan, fresh install as example) causes out of memory. on my 13600k it ran more than 250 ffprobe processes on 8 spinning disks, they dont have enough IO and therefore never finished, eating up nearly 50GB of RAM and still crashed.
Reproduction Steps
Reproduction - run full scan with current version and default settings on pure spinning disk NAS / Unraid. I reproduced around 25 freezes in the last 24 hours ...
My recommendation is to set a default limit of 1 or 2 ... or many many people will crash disk based NAS. If someone has a flash based storage the limit can be increased, but the default value should be a safe number.
Jellyfin Version
Master branch
if other:
10.9.7
Environment
Jellyfin logs
FFmpeg logs
No response
Please attach any browser or client logs here
No response
Please attach any screenshots here
Code of Conduct
@jellyfin-bot commented on GitHub (Jul 1, 2024):
Hi, it seems like your issue report has the following item(s) that need to be addressed:
This is an automated message, currently under testing. Please file an issue here if you encounter any problems.
@cvium commented on GitHub (Jul 1, 2024):
The default is actually Environment.ProcessorCount
@grobalt commented on GitHub (Jul 1, 2024):
okay ... somehow makes sense ... but no spinning disk likes current core counts as parallel threads :) only usable for old CPUs with low core count
@felix920506 commented on GitHub (Jul 2, 2024):
From your post on the Unraid forums, you are using the Linuxserver.io image. That image has broken ffprobe thread limiting. Please switch to the official image.
@grobalt commented on GitHub (Jul 2, 2024):
i changed yesterday to the official - still not good using core count as parallel threads. this does not help .. the intention of this issue was to change the default parallel thread setting of new installations to 1 or 2 ...